Deterministic evaluation · simulated evidence
Long pause but unfinished thought
Test false endpoint risk.
- EvidenceSimulated
- Provider callsNone
- BillableNo
- Last verified2026-08-19
Reproduction record
A deterministic trace for long pause but unfinished thought should emit the expected evidence while preserving every human-review requirement.
- Stable evaluation ID
- long-pause
- Fixture version
- 1.0.0
- Fixture hash
- fnv1a32:876da904
- Environment
- Local deterministic simulation
Task and acceptance criteria
- • Avoid final response during an unfinished thought
- • Handle resume/cancellation deterministically
Run the public fixture
The browser calls the versioned public endpoint, which invokes the shared deterministic evaluator used by MCP. No live provider path is imported or called.
Ready. This action makes no provider call.
Review criteria
- resume-detected · conversation-behavior
Expected: Avoid final response during an unfinished thought
Deterministic assertion
- no-stale-response · agent-behavior
Expected: Handle resume/cancellation deterministically
Human review required
Limitations
- • The fixture is synthetic and does not demonstrate production provider behavior.
- • No provider model, network path, audio device, or customer environment is measured.
- • Human review remains required wherever the criterion is marked subjective.