One Request, End to End: Tokenize, Prefill, Decode, Stream

You type "Why is the sky blue?" and press Enter. There's a short pause. Then words start appearing,...