Ask HN: Why are desktop AI apps so heavy?

  • Posted 6 hours ago by yconst
  • 2 points
I mean they are text apps basically, they should be flying on modern PCs that can do close to a trillion ops per second. Inference is done elsewhere, so what's the deal?

3 comments

    Loading..
    Loading..
    Loading..