AdapTive-LeArning Speculator System (ATLAS): Faster LLM inference

Posted 4 months ago by alecco
198 points

https://www.together.ai/blog/adaptive-learning-speculator-system-atlas

10 comments

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..