KV Cache Quantization in LLM Serving: FP8 and INT8 Tradeoffs, the Silent config.json Trap, and How to Measure It Fairly

FP8 and INT8 KV cache quantization can double your context budget, but a silent config.json setting can change your accuracy without warning. Here is