AMD MI325X vs H100 NVL: Specs
Architecture, compute capability and supported precisions for the AMD MI325X and the H100 NVL, from vendor datasheets.
No live price to compare
No provider on Aquanode is listing at least one of these two cards right now, so no hourly rate is shown. This page shows live prices as soon as both are listed.
Specs side by side
| Spec | AMD MI325X | H100 NVL |
|---|---|---|
| VRAM | 256GB HBM3E | 94GB HBM3 |
| Memory bandwidth | 6 TB/s | 3.9 TB/s |
| Architecture | CDNA3 | Hopper |
| Compute capability | n/a | 9.0 |
| Precisions in hardware | FP32, FP16, BF16, FP8, INT4 | FP32, FP16, BF16, FP8, INT4 |
| Peak FP16/BF16 tensor TFLOPS | 1,307.4 TFLOPS | 835.5 TFLOPS |
| Peak FP8 tensor TFLOPS | 2,614.9 TFLOPS | 1,670.5 TFLOPS |
| NVLink / multi-GPU interconnect | Infinity Fabric, 8 links at 128 GB/s peak each | NVLink, 600 GB/s |
| Max board power (TDP) | 1000W peak | 350-400W (configurable) |
