Deterministic evaluation · simulated evidence
Spelling an order number
Test alphanumeric entity capture.
- EvidenceSimulated
- Provider callsNone
- BillableNo
- Last verified2026-08-19
Reproduction record
A deterministic trace for spelling an order number should emit the expected evidence while preserving every human-review requirement.
- Stable evaluation ID
- spelled-order-number
- Fixture version
- 1.0.0
- Fixture hash
- fnv1a32:784022ad
- Environment
- Local deterministic simulation
Task and acceptance criteria
- • Repeat the interpreted identifier
- • Require confirmation before lookup
Run the public fixture
The browser calls the versioned public endpoint, which invokes the shared deterministic evaluator used by MCP. No live provider path is imported or called.
Ready. This action makes no provider call.
Review criteria
- identifier-repeated · agent-behavior
Expected: Repeat the interpreted identifier
Deterministic assertion
- confirmation-obtained · safety-trust
Expected: Require confirmation before lookup
Deterministic assertion
Limitations
- • The fixture is synthetic and does not demonstrate production provider behavior.
- • No provider model, network path, audio device, or customer environment is measured.
- • Human review remains required wherever the criterion is marked subjective.