Bursty arrivals speed up LLM inference

  • Posted 1 hour ago by ak33ra
  • 2 points
https://systems.seas.harvard.edu/blog/burstiness-is-all-you-need/

1 comments

    Loading..