Live demo · reliability harness

Watch the agent get silently starved

Pick a real complaint. Triage it. Then inject the truncation failure and watch the harness catch what an accuracy score would hide.

▶ Real recorded model outputs, replayed. Not a live API call. Every number below is what the eval actually captured.

The complaint

Agent output · full input

✂ Inject failure: silent input truncation
Cut the complaint to the first 600 characters, the way a real pipeline quietly would.

This is 1 of 8 failure modes in the harness. Full writeup and scoreboard: complaint-triage-harness.vercel.app