Budgeting memory for a local language model: weights, KV cache, and room to run

An “8B, 4-bit” label gives you a starting estimate for weight storage. A useful memory budget also...