AirLLM 70B inference with single 4GB GPU

Posted 8 hours ago by Anon84
150 points

https://github.com/lyogavin/airllm

10 comments

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..

Loading..