Backtest 63.7%, production AUC 0.51 - a postmortem

We fitted a logistic model on seven scoring blocks. It backtested at 63.7% and served at coin-flip accuracy. The cause was an undocumented dataset, not the code.