Same Model, Same Scaffold, 10 Runs: Agent Benchmark Scores Still Move by Up to 6 Points

A 2026 study ran 60,000 SWE-bench trajectories and found single-run agent scores vary by 2.2-6.0 points. How to read a leaderboard, and how many runs your eval needs.