On-Demand vs Spot GPUs for AI Inference: The Cost Rules We Actually Use

GPU capacity is the tightest it has been in a while. Amazon just crossed three trillion dollars...