Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation

Posted 8 hours ago by fheinsen
136 points

https://arxiv.org/abs/2602.00294

15 comments

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..