What's actually inside an image's DPI tag (and why changing it is lossless)

A print shop rejected a 4000 × 2667 px photo last week because the file "was only 72 DPI". The photo...