My first fine-tuning patch made my model worse. The second one, with fewer examples and half the learning rate, fixed it

Notes from shipping v5.1 of a 7B model that designs pixel art games: what went wrong with the first patch, what worked, the numbers, and why the project is now pixel art only.