What If a Transformer Never Had to Forget? Meet the Recurrent Looped Transformer (RLT)

You ask a language model a one-line question — it processes it through 48 layers. You paste a...