Show HN: Cosmos-Reason2-2B on Nano Super

  • Posted 8 hours ago by vottivott
  • 1 points
https://huggingface.co/embedl/Cosmos-Reason2-2B-W4A16-Edge2
Hi! Today, me and my team is releasing a version of Cosmos-Reason2-2B that is quantized so that it fits even on the NVIDIA Jetson Orin Nano Super.

We managed to find a mixed precision configuration such that it maintains virtually the same accuracy as the unquantized model while being able to run really efficiently on the Nano Super and other edge devices :)

0 comments