Posts tagged Production AI — AI × software engineering, made practical.
Learn why an LLM-as-judge validator needs its own tests, fail-closed defaults, and separate alerting instead of being treated as trusted plumbing.
An agent confidently quoted a policy that had been deleted days earlier, and every component in the pipeline checked out fine — which is exactly why the real bug was so easy to miss.
No agent lied, no agent errored, and a resolved support ticket got reopened anyway — because handoff() quietly threw away the one piece of context that made 'resolved' mean anything.
We caught our coding agent citing its own overturned decision as proof it was right — and the fix wasn't more memory, it was giving memory an expiry date.
A worker agent crashed mid-refund, restarted three times, and charged the same customer three times before anyone noticed — here's why rewording the system prompt was never going to fix it, and what actually does.
A billing agent and a policy agent both answered correctly, and the orchestrator still shipped a wrong response to the customer — because nobody had built the one piece that decides what happens when confident agents contradict each other.
A whiteboard test — and a real production refund bug — for telling an actual agent apart from a chatbot wearing a trenchcoat.