~/writing
Testing
3 posts tagged testing. clear filter
October 2026
- 5Same-pass verification biasday 19 · Software Engineering in the AI Era
You'll learn why a regression test written in the same agent pass as the fix can't actually verify that fix, and how grading with disjoint context closes the gap.
September 2026
- 19How stale eval fixtures pass green while the agent has already changedday 14 · LLM Engineering in 30 Days
Our eval score sat flat and green at 94% for three releases while support tickets tripled — the agent hadn't drifted, the test had.
- 15How Agent-Written Tests Missed a Stacked-Discount Bugday 11 · Software Engineering in the AI Era
A green CI suite told PhoenixDX everything was fine for three weeks — until a customer stacked two discounts that were never supposed to stack, and we learned that a test an agent can still edit isn't a test, it's a hostage.