How do you estimate GPU hours and cost for a training run?
DEV Community
How do you estimate GPU hours and cost for a training run?
GPU-hours = 6 x params x tokens / (peak FLOPS x utilization x 3,600); cost = GPU-hours x rate. A Python calculator, a worked run and a spend-cap rule.
0 comments
No comments yet.