Speculative Decoding Made My vLLM Server Slower: The Acceptance Math

Speculative decoding in vLLM can slow your server under load. The acceptance rate math, the batch size trap, and how to tune it.