Consistent Hashing

Consistent hashing promises that adding a node only moves 1/N of your keys — nobody tells you what happens in the gap before that node has anything cached, and why the same trap is even nastier in front of an LLM inference fleet.

Consistent hashing was built to make moving a cache key cheap — but an agent session isn't a cache key, and treating it like one turns every routine scale-up into a silent, expensive case of amnesia.