vLLM Fast Start Explained: What Preload and Snapshots Save, What They Cannot, and the Fingerprint Gap
DEV Community
vLLM Fast Start Explained: What Preload and Snapshots Save, What They Cannot, and the Fingerprint Gap
vLLM 0.31 added weight preload and CRIU snapshots for fast restarts. What they save, a burst-headroom simulation, and an open fingerprint gap.
0 comments
No comments yet.