~/writing
Cost Optimization
2 posts tagged cost-optimization. clear filter
October 2026
- 5Prompt Cache Invalidationday 19 · LLM Engineering in 30 Days
You'll learn how prompt caching keys on an exact prefix, why a one-line edit to a shared tool schema silently invalidates it across every agent that imports it, and what to monitor so it doesn't cost you a week of spend before anyone notices.
September 2026
- 17How a bloom filter skips vector-DB lookups for duplicate chunksday 15 · One Concept a Day — The AI-Era Engineer's Glossary
Most of what RAG teams call 'dedup logic' is a 56-year-old bit array in disguise — here's why a Bloom filter should sit in front of your embedding call, not after it.