saharmor/voice-lab
Testing and evaluation framework for voice agents
Provides LLM-as-a-Judge custom metrics scoring, systematic prompt and model comparison across personas/scenarios defined in JSON, and cost-optimization analysis when migrating between language models. Executes text-based agent interactions with configurable system prompts, tool calls, and success criteria, evaluating performance through dynamically-defined metrics rather than manual log review.
165 stars. No commits in the last 6 months.
Stars
165
Forks
13
Language
Python
License
Apache-2.0
Category
Last pushed
Jun 04, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/saharmor/voice-lab"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
bolna-ai/bolna
Conversational voice AI agents
MCERQUA/OpenVoiceUI
Open voice UI shell for AI agents. Bring any LLM, TTS, or framework — handles voice I/O, Agent...
SaynaAI/sayna
Sayna is a unified Voice Layer for AI Agents with a seemless integration to an existing agentic...
jesuscopado/samantha-os1-openai-realtime
Samantha OS1 is a conversational AI assistant powered by the Realtime API from OpenAI
HaoZhang615/Realtime-Synthetic-Call-Center-Agents
a solution that simulates AI-driven contact center scenarios using synthetic data and real-time...