~/writing
LLM Evals
3 posts tagged llm-evals. clear filter
October 2026
- 13Evals from real failuresday 26 · AI Fundamentals in 30 Days
You will learn what an eval actually is, why large generated test suites miss the failures real users hit, and how to turn each incident into a small regression case with the cheapest check that catches it.
September 2026
- 20How stale eval labels keep a passing score while quality dropsday 15 · LLM Engineering in 30 Days
A flat, high eval score feels like good news — until you realize it might just mean nobody's checked whether the answers it's grading against are still true.
- 19How stale eval fixtures pass green while the agent has already changedday 14 · LLM Engineering in 30 Days
Our eval score sat flat and green at 94% for three releases while support tickets tripled — the agent hadn't drifted, the test had.