180B Parameters, 32GB of RAM: Pushing Moe Inference to the Limit

  • Posted 2 hours ago by joshcsimmons
  • 2 points
https://huggingface.co/blog/moe-expert-streaming

0 comments