When batch traffic competes with interactive LLM requests

Not all LLM traffic is equally urgent. A user waiting for a response cares about the next few...