How Much Context Fits Beside a 12B on an 8 GB GPU? Gemma 4 12B's Context Cache on an RTX 3050

A 4-bit context cache lets Gemma 4 12B hold 81,920 tokens beside its drafter on an 8 GB RTX 3050, 3.3x the 16-bit cache, with the same GSM8K, BFCL and long-document recall scores, at 55 tok/s empty and 31 tok/s with 65,536 tokens held.