~/blog/http-caching/

Http Caching

Posts tagged Http Caching — AI × software engineering, made practical.

Filtered byhttp-caching all posts

How a 95% Cache Hit Ratio Can Still Overload Your Origin Server

Sep 5, 2026

Your CDN dashboard and your origin server are both telling the truth about the same traffic — which is exactly how a 95% hit ratio and rising origin CPU coexist, and the same trick is now hiding inside your LLM inference stack.

cache-hit-ratio cdn-caching http-caching llm-inference prompt-caching