Depth-Attention: Opening an Attention Channel Between Transformer Layers

This is the second article in my Attention Mechanism Evolution series. The first covered the...