I work in venture capital, and before that I worked in information retrieval. When agents went viral, I built a due diligence agent for my day job. I vibe-coded the first version. It was pretty bad. My first reaction is to blame the model. I tried to change backend models, maybe because Fable doesn't want to help me do people search? Maybe because GPT 5.5 overthinks things? I tried DeepSeek, Kimi, Qwen; I changed prompts again and again, no good. Then I stopped just simply checking the final answer and started reading the actual trajectories: what did the agent search for? What came back? What pages did it read? At what point agents were off the rail?
Pretty interesting: Sometimes the agent is stuck and confused because the information provided is irrelevant or even wrong; Sometimes the agent keeps iterate the same query, like "XXX lab UCB CS PhD founder 2026" "2026 XXX lab machine learning systems students startup" because the web search provider is not up-to-date; Sometimes sub-agents give up too early because the agent's intelligence is not enough or too "guardrailed"; Sometimes everything is just slow. A run jeopardized at minute 1 but still ran for another 10 before returning nonsense. That's because of bad searches, but nothing reveals it.
So I built two things:
1. Web Search/Fetch router: One gateway for Exa, Parallel, Tavily, Brave, Ceramic, Linkup, Seltz, You, SerpAPI, etc. You or your agent can pick one or query several concurrently, and the responses come back in a homogeneous format. 2. Web Search Observability: Trace every search your agent (and its sub-agents) makes with an evaluator scoring relevance, diversity, and a few other things. Point is to answer one question: is your pipeline broken because the web search is bad? If so, where?
Everything is agent-operated. All u need to do is to run this shell script: <curl -fsSL https://docs.telem.ai/alpha_install.sh | sh> Please give it a try, any feedback/suggestion would be great! Especially I’d like to ask: how are you debugging search/retrieval failures nowadays?