AMD MI300X GPU rental price
AMD AMD MI300X · 192 GB VRAM. Live per-GPU pricing aggregated across 2 providers and 2 regions.
The AMD MI300X (192GB HBM3) currently rents from $2.39 per GPU per hour on Aquanode, across 2 providers.
AMD MI300X specs
AMD MI300X full specs
| Architecture | AMD, launched 2023 |
| VRAM | 192GB HBM3 |
| Memory bandwidth | 5.3 TB/s |
| FP16 / BF16 tensor throughput | 1,307.4 TFLOPS (peak, dense) |
| FP8 tensor throughput | 2,614.9 TFLOPS (peak, dense) |
| Interconnect | Infinity Fabric |
| TDP | 750W |
| Form factor | OAM |
Specs sourced from the vendor's public datasheet. See the source.
What fits in 192GB HBM3 of VRAM
| Model | Precision | Fits? |
|---|---|---|
| Llama 3.1 70B | BF16 | ~140GB. Fits on a single card with room to spare. |
| Llama 3.1 405B | FP8 | ~410GB. Needs 3+ cards even at 192GB each. |
| Llama 3.1 405B | INT4 | ~200-230GB. Fits on a single card. |
| Mixtral 8x22B | BF16 | ~280GB. Needs 2 cards. |
Approximate, based on published parameter counts and standard bytes-per-parameter rules of thumb (FP16 ≈ 2 bytes/param, INT4 ≈ 0.5-0.6 bytes/param). Real footprint also depends on KV-cache size and framework overhead.
Good for
The largest single-card VRAM pool on this marketplace at 192GB (more than double an H100's 80GB), so it's the card that fits the biggest models without splitting across GPUs, at a memory bandwidth (5.3 TB/s) ahead of H100's 3.35 TB/s.
Not good for
Runs on AMD's ROCm software stack rather than CUDA. Most inference/training frameworks support it, but some CUDA-only tooling and custom kernels need a ROCm port or don't run at all. Worth checking your stack's ROCm support before committing to it.
Get notified when the price drops
GPU supply moves hourly. Tell us what you're waiting for and we'll email you when a matching offer appears across any provider we track.
How this price is calculated
All prices on this page are normalized to a per-GPU hourly rate using each offer's authoritative GPU count, so that raw price is divided by the number of GPUs it actually covers; Akash reports its price as already per-GPU, so it is used as-listed. An offer with a missing, zero, or invalid GPU count is excluded entirely rather than published at a guessed rate.
No offers were excluded from this snapshot for a missing or invalid price. No offers were dropped as price outliers in this snapshot.
Only the cheapest qualifying offer per provider is shown in the table above. This page regenerates at most once per hour.
Frequently asked questions
How much does it cost to rent a AMD MI300X?
Live AMD MI300X rental prices currently range from $2.39 to $2.51 per GPU per hour across 2 providers, with a median of $2.39 per GPU per hour.
Which provider has the cheapest AMD MI300X?
RunPod currently offers the lowest AMD MI300X rate on Aquanode's marketplace at $2.39 per GPU per hour in eu-ro-1.
How is the AMD MI300X price calculated?
All prices are normalized to a per-GPU hourly rate using each offer's authoritative GPU count, which the raw price is divided by; Akash reports its price as already per-GPU. Offers whose price can't be safely normalized, or whose rate is an extreme outlier against the rest of the market, are excluded.
How much does an AMD MI300X cost per hour?
Live AMD MI300X rental rates on Aquanode currently range from $2.39 to $2.51 per GPU per hour, with a median of $2.39/hr. See the live table above for current per-provider pricing.
How much VRAM does an AMD MI300X have?
The AMD MI300X has 192GB HBM3, with 5.3 TB/s of peak memory bandwidth.
Is renting cheaper than buying?
Renting avoids the upfront hardware cost and lets you match spend to actual usage. A rented AMD MI300X at $2.39/hr only costs money while it's running, whereas buying ties up capital in hardware that keeps depreciating whether it's in use or not. Which is cheaper depends on how continuously you'd run it; short or bursty workloads usually favor renting.
