A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC

A from-scratch model scored 44% on ARC-AGI-1 in 67 cents of compute. The lesson for small models: the training bill is optional.