We also provide a basic orchestrator that handles placement of the microVMs, creating clusters with HA, maintaining a warm pool of VMs, and takes care of setting up networking and monitoring.
Our benchmarks on a metal instance shows an acquire VM from pool and execute code p99 of 35ms which places it as one of the fastest VM based sandboxes you can get right now. You could also snapshot a small sandbox and resume in ~80ms.
You can easily self-host a multi-node cluster of this right now on your cloud with nested-virt enabled machines or better on bare metal by providing the docs to your coding agent.
Tarit - https://github.com/instavm/tarit
Quickstart - https://github.com/instavm/tarit/blob/main/orch/docs/QUICKST...