FlashRec – Wide-beam generative recommendation. Every SID is a real item
Posted 3 hours ago by vect0ry
1 points
An inference engine for generative recommendation: catalog-constrained wide beam search, executed inside CUDA graphs.
https://github.com/sohu-mptc/FlashRec