Show HN: Local and Cloud LLM Comparison Using Nvidia DGX Spark

  • Posted 6 hours ago by devashish86
  • 1 points
https://www.devashish.me/p/local-cloud-llm-comparison-using
Sharing a recording and notes from my demo at AI Tinkerers Seattle last week. I ran 6 different models in parallel on identical coding tasks and had a judge score each output on a 10-point scale.

Local models (obviously) didn't compare well with the cloud counterparts for this experiment. But I've found them to be useful for simpler tasks with a well defined scope e.g. testing, documentation, compliance. etc

0 comments