Attention Maps: What They Show and What They Do Not

Attention weights show where information could flow, not why an output happened. The distinction, and the experiments that established it.