H100 vs RTX A4000: Specs
Architecture, compute capability and supported precisions for the H100 and the RTX A4000, from vendor datasheets.
No live price to compare
No provider on Aquanode is listing at least one of these two cards right now, so no hourly rate is shown. This page shows live prices as soon as both are listed.
Specs side by side
| Spec | H100 | RTX A4000 |
|---|---|---|
| VRAM | 80GB HBM3 | 16GB GDDR6 with ECC |
| Memory bandwidth | 3.35 TB/s | 448 GB/s |
| Architecture | Hopper | Ampere |
| Compute capability | 9.0 | 8.6 |
| Precisions in hardware | FP32, FP16, BF16, FP8, INT4 | FP32, FP16, BF16, INT4 |
| Peak FP16/BF16 tensor TFLOPS | 989 TFLOPS | – |
| Peak FP8 tensor TFLOPS | 1,979 TFLOPS | – |
| NVLink / multi-GPU interconnect | NVLink 4, 900 GB/s bidirectional | – |
| Max board power (TDP) | Up to 700W (configurable) | 140W |