Posts tagged Ttft — AI × software engineering, made practical.
You'll learn how prompt caching makes time-to-first-token depend on the order of your prompt, how to find the lines that break the cache in your agent harness, and how to order the prompt so the cache keeps hitting on every turn.