acc vs acc_norm: Why Length Bias Skews LLM Eval Scores

Why acc and acc_norm disagree in lm-eval-harness: log-likelihood length bias, byte-length normalization, and when each multiple-choice metric lies.