Show HN: Shoehorn – Quantize any model down to run on your machine

  • Posted 3 days ago by rhgraysonii
  • 62 points
https://notactuallytreyanastasio.github.io/shoehorn/
Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so far. https://github.com/notactuallytreyanastasio/shoehorn

7 comments

    Loading..
    Loading..
    Loading..
    Loading..
    Loading..
    Loading..
    Loading..