~/blog/

Blog

Agentic Software Engineering — AI × software engineering, made practical.

Filtered bycache-hit-ratio clear

The 95% Cache Hit Ratio That's Quietly Burning Your Origin

Sep 5, 2026

Your CDN dashboard and your origin server are both telling the truth about the same traffic — which is exactly how a 95% hit ratio and rising origin CPU coexist, and the same trick is now hiding inside your LLM inference stack.

cache-hit-ratio cdn-caching http-caching llm-inference prompt-caching