FP16 Quantization Quality Loss: We Blamed the Architecture, the Bug Was One Overflowed Tensor

Our fp16 quantization post-mortem was wrong in the expensive direction: it told anyone with a...