How the Transformer Paper Came About

Attention Is All You Need was a translation-throughput paper. What it proposed, what it reported, and how much of a modern transformer is not in it.