We spent two days bisecting a prompt change. The regression was noise.

Quality went from 0.81 to 0.78. Someone had edited a prompt that week. Obvious culprit, obvious...