A/B testing: when the standard test is the wrong tool

The standard test answers one narrow question. When you're maximizing revenue instead of detecting a difference, or your users aren't independent, or there's only one of you to test on, that question is the wrong one.