Canonical evaluation registry
Voice AI Evaluations
Inspect deterministic local fixtures and their limits before interpreting any result. No public evaluation calls a provider or consumes credits.
- Stable fixtures12
- Provider callsNone
- EvidenceSimulated
- Human reviewPreserved
Evaluation catalog
Every card is a real link, and every slug is shared by the page, public API, and MCP tools.
interrupt-mid-response
Customer interrupts mid-response
Test barge-in and cancellation.
Implemented with deterministic fixtures · no provider calls
Open Customer interrupts mid-response evaluationlong-pause
Long pause but unfinished thought
Test false endpoint risk.
Implemented with deterministic fixtures · no provider calls
Open Long pause but unfinished thought evaluationbackground-noise
Background noise
Inspect robustness and uncertainty behavior.
Implemented with deterministic fixtures · no provider calls
Open Background noise evaluationitalian-speaker
Italian speaker
Validate supported language configuration using representative Italian speech.
Implemented with deterministic fixtures · no provider calls
Open Italian speaker evaluationspelled-order-number
Spelling an order number
Test alphanumeric entity capture.
Implemented with deterministic fixtures · no provider calls
Open Spelling an order number evaluationambiguous-appointment
Ambiguous appointment time
Test clarification and timezone handling.
Implemented with deterministic fixtures · no provider calls
Open Ambiguous appointment time evaluationtool-timeout
Tool timeout
Test bounded wait and recovery.
Implemented with deterministic fixtures · no provider calls
Open Tool timeout evaluationduplicate-booking
Duplicate booking request
Test idempotency and confirmation.
Implemented with deterministic fixtures · no provider calls
Open Duplicate booking request evaluationhuman-request
User requests a human
Test explicit opt-out/handoff.
Implemented with deterministic fixtures · no provider calls
Open User requests a human evaluationunsupported-request
Unsupported request
Test safe scope boundaries.
Implemented with deterministic fixtures · no provider calls
Open Unsupported request evaluationsentiment-shift
Angry customer sentiment shift
Use sentiment only as a review/routing signal, not proof.
Implemented with deterministic fixtures · no provider calls
Open Angry customer sentiment shift evaluationtwo-speakers-one-channel
Two speakers on one channel
Test speaker-label limitations on mixed audio.
Implemented with deterministic fixtures · no provider calls
Open Two speakers on one channel evaluation