Ask HN: What are you running locally on your machine with LLMs?

  • Posted 3 hours ago by agcat
  • 3 points
There is a lot of buzz around this topic but i am really curious about what's actually useful day to day when running AI/LLMs locally on your PC. A few things I'm trying to understand:

Which models are you running locally and on what hardware? What use cases have actually worked out considering the speed and memory limitation? At what point did local start making more sense than just hitting an API? What's still not there yet?

Feels like we're at an interesting inflection point but hard to cut through the noise on what's working v/s just setting it up

1 comments

    Loading..