Where to Find robots.txt and What the File Reveals About Crawling

Where to find robots.txt, what each line actually controls, and how to fix a blocked-by-robots.txt error without handing the check to anyone else.