Digital Minimalism for AI: How Reducing Compute Could Actually Improve Model Quality

A 7B parameter model with a well-designed data pipeline beat GPT-4 on a medical reasoning benchmark...