Janas: Run LLMs larger than RAM by streaming experts from SSD
Posted 1 hour ago by
khalidkhair
2
points
https://github.com/prabanta-dev/janas
0
comments