Attention Is All You Need: The Translation Problem That Led to ChatGPT

Google researchers were improving machine translation. The bottlenecks they removed led to the Transformer, then GPT, BERT, instruction tuning, and conversational AI.