A/B testing: how to test your test

A clean p-value doesn't mean the test was clean. A/A tests, sample ratio mismatch, and Simpson's Paradox are the checks that catch a broken testing setup before you trust anything it tells you.