The Semantic Cache That Made a Free LLM Quota Feel Infinite

A token allowance is usually treated as a spending budget, which is the wrong mental model for free...