Posts tagged LLM Engineering — AI × software engineering, made practical.
Three weeks of swapping embedding models and tuning rerankers won't fix a retriever that's been fed half a function signature — here's the 10-minute check that tells you if chunking, not your model, is the real problem.
If your retrieval eval scores refuse to budge no matter which embedding model you throw at them, the fix isn't a bigger model — it's the chunk boundary that quietly amputated your answer before encoding ever happened.
Nothing overflowed, nothing got truncated, and the model still ignored an explicit rule sitting in plain sight — because a bigger context window doesn't buy the model more attention, it buys it more competition for the same fixed budget.