LRU is harder to beat than the KV-cache papers suggest

Posted 3 days ago by gauravapiscean
103 points

https://github.com/gauravapiscean/agentic-kv-cache

12 comments

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..