H100 vs H200: Specs, VRAM & Price
Short answer: pick the H200 when your model plus KV cache doesn't fit in 80GB, or you're bandwidth-bound on inference. Pick the H100 when 80GB is enough for your model and you'd rather take the lower hourly rate and wider availability.
The H100 has 80 GB of VRAM; the H200 has 141 GB.
You can rent both by the hour, no purchase required. H100 from $2.78/GPU/hr; H200 from $5.05/GPU/hr. The H100 is 45% cheaper at the entry rate.
H100
Good for training and serving frontier-scale LLMs
H200
Good for training and serving frontier-scale LLMs
Last updated: 2026-11-03 UTCRefreshes every 6 hours
Specs side by side
| Spec | H100 | H200 |
|---|---|---|
| VRAM | 80 GB | 141 GB |
| Memory bandwidth | 3.35 TB/s | 4.8 TB/s |
| Architecture | Hopper | Hopper |
| Compute capability | 9.0 | 9.0 |
| Precisions in hardware | FP32, FP16, BF16, FP8, INT4 | FP32, FP16, BF16, FP8, INT4 |
| Peak FP16/BF16 tensor TFLOPS | 989 TFLOPS | 989 TFLOPS |
| Peak FP8 tensor TFLOPS | 1,979 TFLOPS | 1,979 TFLOPS |
| NVLink / multi-GPU interconnect | NVLink 4, 900 GB/s bidirectional | NVLink 4, 900 GB/s bidirectional |
| Max board power (TDP) | Up to 700W (configurable) | Up to 700W (configurable) |
| Form factor | SXM5 | SXM |
| Regions | 7 | 3 |
On-demand price
| Rate | H100 | H200 |
|---|---|---|
| Lowest per GPU/hr | $2.78/GPU/hr | $5.05/GPU/hr |
Which is better for AI: H100 or H200?
The H200 carries 141GB of HBM3e at 4.8 TB/s against the H100's 80GB of HBM3 at 3.35 TB/s (NVIDIA, Aug 2026). NVIDIA's own copy calls it "nearly double the capacity" with "1.4x more memory bandwidth," which mostly matters for serving larger models or longer context windows without sharding. Pick the H200 when your model plus KV cache doesn't fit in 80GB, or you're bandwidth-bound on inference; pick the H100 when 80GB is enough for your model and you'd rather take the lower hourly rate and wider availability. On price the H100 undercuts the H200 by 45% at the entry rate ($2.78 vs $5.05/GPU/hr). Worth weighing if the deciding factor above isn't a hard requirement for your job.
Decision criteria
| VRAM | 80 GB (H100) vs 141 GB (H200). HBM3 vs HBM3e per NVIDIA's own page. |
| Memory bandwidth | H100: 3.35 TB/s. H200: 4.8 TB/s, a 1.4x jump per NVIDIA's H200 product page (Aug 2026). |
| Compute precision | Both are Hopper-generation with FP8 tensor cores: same compute capability, the difference is memory. |
| Availability | 7 region(s) list the H100 vs 3 for the H200. |
| Entry price | $2.78/GPU/hr (H100) vs $5.05/GPU/hr (H200). |
Pick the H100 when
- Your model and KV cache fit inside 80GB with room to spare
- You want the wider availability and lower hourly rate
- You're doing FP8 inference at a scale the H100 already handles
Pick the H200 when
- You're serving a model too large or too long-context to fit on an H100
- You're bandwidth-bound and need the extra 1.4x throughput
- You want headroom against future model growth without re-architecting
Price-performance
At list rates, 1,000 GPU-hours costs $2,778 on the H100 against $5,050 on the H200. Neither NVIDIA nor Aquanode publishes a workload-normalized $/token or $/epoch figure for this pair, so $/GPU-hour below is the only apples-to-apples number. A faster card can still cost less per finished job even at a higher hourly rate.
H100 vs H200: common questions
Is the H100 or the H200 better for AI?
Short answer: pick the H200 when your model plus KV cache doesn't fit in 80GB, or you're bandwidth-bound on inference. Pick the H100 when 80GB is enough for your model and you'd rather take the lower hourly rate and wider availability.
Is the H100 or the H200 cheaper to rent?
On Aquanode's live marketplace the H100 starts at $2.78/GPU/hr (median $3.70/GPU/hr) and the H200 starts at $5.05/GPU/hr (median $5.05/GPU/hr). The H100 is the cheaper of the two at the entry rate, by 45%.
What is the difference between the H100 and the H200?
The H100 has 80 GB of VRAM against the H200's 141 GB; both are Hopper parts; both run BF16, FP8, INT4 workloads in hardware. On price, the H100 lists from $2.78/GPU/hr and the H200 from $5.05/GPU/hr.
How widely available are the H100 and the H200?
The H100 is listed in 7 regions and the H200 in 3 regions right now.
How much does 1,000 GPU-hours cost on the H100 vs the H200?
At the lowest rates listed today, 1,000 GPU-hours costs $2,778 on the H100 and $5,050 on the H200, a difference of $2,272 for the same runtime. Rates are per GPU per hour and update hourly.
How much VRAM does the H100 have compared to the H200?
The H100 has 80 GB of VRAM; the H200 has 141 GB.
Is the H200 just an H100 with more memory?
Mostly, yes. Same Hopper compute (FP8 tensor cores, same generation), but 141GB of HBM3e at 4.8 TB/s versus the H100's 80GB HBM3 at 3.35 TB/s (NVIDIA, Aug 2026). That extra headroom carries a price: the H200 lists from $5.05/GPU/hr against the H100's $2.78/GPU/hr on Aquanode today.
Does the H100 or the H200 support NVLink?
Yes, both support a multi-GPU interconnect: the H100 has NVLink 4, 900 GB/s bidirectional and the H200 has NVLink 4, 900 GB/s bidirectional.
How this comparison is calculated
Every price is normalized to a per-GPU hourly rate using the same pipeline as every other pricing surface on Aquanode, and only the cheapest qualifying offer per provider is shown. A dash means that provider does not currently list that GPU.
Architecture, compute capability and supported precisions come from each vendor's published datasheet for that generation, not from the marketplace feed. This page regenerates at most once per hour.
Memory bandwidth, tensor TFLOPS, NVLink/interconnect and max board power are the same verified-from-datasheet figures shown on each model's own H100 page and H200 page, which link the primary vendor source for that model. A dash here means Aquanode hasn't verified that figure from a primary source yet, never a guess.
Go further
Check what fits in each card's memory with the H100 VRAM calculator and the H200 VRAM calculator, see vendor-published throughput in the GPU benchmarks and specs table, or browse every model by generation in the GPU index.
More H100 comparisons
More H200 comparisons
Related reading: H100 pricing and specs, H100 vs H200, A100 vs H100, H100 and H200: SXM vs NVL vs PCIe, and The best GPUs for AI, ranked.
