Your 128K Context Fits on a 4090 — If You Quantize the KV Cache
DEV Community
Your 128K Context Fits on a 4090 — If You Quantize the KV Cache
Researched October 2026. Sizing math from public model cards and the vLLM docs; not my own...
0 comments
No comments yet.