180B Parameters, 32GB of RAM: Pushing Moe Inference to the Limit
Posted 2 hours ago by
joshcsimmons
2
points
https://huggingface.co/blog/moe-expert-streaming
0
comments