Tired of that, I built Rehearse.
I know there is a lot of YC money going into voice testing companies, but I wanted to build something open source and code first so Claude Code can spin up and manage test cases.
Example usage:
- call.listen() -> get audio or transcript of what the agent is saying
- call.say("I'd like to book a table for 2 at midnight") -> speak with the agent
- assertions on responses
It only supports Twilio (my use case) and ElevenLabs (transcription), with basic text and LLM based assertions for now.
It makes real calls and is BYOK.
I have a bunch of ideas in mind (not implemented yet, not sure if useful):
1. simulations like accents, background noise, languages, network issues, interruptions, etc
2. voice agent testing another voice agent
3. native audio based assertions
4. more connection options like Vapi, Retell, Websockets etc
GitHub https://github.com/thenullterminator/rehearse
PyPI https://pypi.org/project/rehearse/
Everything is a bit janky right now.
Appreciate all your feedback!