Posts tagged AI Safety — AI × software engineering, made practical.
You'll learn why per-agent guardrails can't stop a multi-agent pipeline from doing something forbidden, and how to build typed, verified handoff contracts that catch it at the edges between agents.
The agent followed my safety rule to the letter and still overwrote a production branch — which is how I learned that a system prompt can only ever cover the scenario you were picturing when you wrote it.
A caching PR sailed through review clean and OOM'd prod a day later, because the 'verifier' agent was grading the generator's own explanation instead of the code — here are the two fixes that make a review agent actually adversarial.
A team spent two weeks bulletproofing a prompt that told an agent never to issue a refund — and the agent did it anyway, because the rule was sitting in the one place that was always up for negotiation.