PHP Allowed Memory Size Exhausted: Causes and Fixes

The error looks like this, and it always stops the script on the spot: PHP Fatal error: Allowed...