AdapTive-LeArning Speculator System (ATLAS): Faster LLM inference

Posted 13 hours ago by alecco
183 points

https://www.together.ai/blog/adaptive-learning-speculator-system-atlas

10 comments

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..