Deploy AI models on H100, A100, H200, and AMD MI300X GPUs with up to 40% cost savings. Lightning-fast machine learning inference on enterprise GPU infrastructure.
Estimate training time and cost from model size, token count, and GPU choice, priced against Aquanode's live marketplace, per GPU / hr.
The math
Total FLOPs ≈ 6 × parameters × tokens (2 FLOPs/param/token forward + 4 backward, the standard dense transformer approximation; it overstates true FLOPs for mixture-of-experts models). Training time = total FLOPs ÷ (GPU's peak BF16 FLOP/s × assumed utilization). Cost = training time × the GPU's live $/hr rate.
Worked example: 7B params, 300B tokens, at assumed 40% utilization
GPU
Provider
Rate (per GPU / hr)
Estimated time
Estimated cost
RTX 3070
SimplePod
$0.050/hr
3645.8 days
$4,375
A16
Vultr
$0.059/hr
3645.8 days
$5,163
RTX 5060 Ti
SimplePod
$0.100/hr
3645.8 days
$8,750
RTX A2000
RunPod
$0.120/hr
3645.8 days
$10,500
RTX 4070 Super
Vast.ai
$0.137/hr
3645.8 days
$12,007
All figures assume a single GPU: a real multi-GPU cluster trains faster but is not linearly modeled here (interconnect overhead varies by topology).
Try your own numbers
1.26e+22
Total training FLOPs
40 TFLOP/s
Effective throughput
3645.8 days
Estimated training time
RTX 3070 (SimplePod)
GPU used
$0.050/hr
Per-GPU rate
$4,375
Estimated cost (1 GPU)
Formula: FLOPs = 6 × parameters × tokens. Time = FLOPs ÷ (peak GPU FLOP/s × utilization). Cost = time × live per-GPU $/hr. Assumes a single logical accelerator, a real multi-GPU cluster scales throughput roughly linearly minus interconnect overhead, which is not modeled here.
