Ask HN: Do you have any kind of sandboxing for those who run LLMs locally?

  • Posted 1 hour ago by az09mugen
  • 1 points
I have the project of running a LLM locally on a Windows. Since no one can tell for sure what's going on I was thinking of sandboxie https://sandboxie-plus.com/ or better open sandbox https://open-sandbox.ai/ around a llama.cpp or whatever.

Even if it's also on MacOs or Linux, I would like to know if anyone run these kind of sandbox and what is the experience like. And also if someone detected some weird behaviour (unsolicited system or web calls for example)

0 comments