Fine-tuning a 7B model needs 112 GB. The model is only 14 GB of it.

Ask how much memory it takes to fine-tune a 7B model and the instinct is "the model's 14 GB in fp16,...