People searching for a GPU rental marketplace are usually one step past "which cloud should I use." They have already worked out that an H100 costs one thing on a hyperscaler and something very different on a market of independent operators, and they want the second number. What nobody tells them is that a marketplace is not just a cheaper cloud. It is a structurally different product with a different failure mode, and the thing that decides whether it works for you is almost never the hourly rate.
I work on the aggregation layer underneath one of these, so this is written from the feed side: what the supply actually looks like when you pull all of it at once, what the categories really mean, and the six checks that matter before you put work on a machine you do not own.
TL;DR: A GPU rental marketplace resells third-party supply instead of owning datacenters, which is why it is cheap and why it is uneven. RunPod's own terms say it plainly for its Community tier: it "does not make any specific uptime warranties." There are four distinct structures and they fail differently. Before renting, check interruptibility, storage locality, port forwarding, host verification, GPU-count arithmetic, and how you get your environment back out. The last one is the one everyone skips and the only one that really locks you in.
What a GPU rental marketplace actually is
A GPU cloud owns hardware. It buys cards, racks them, runs the datacenter, and rents you a slice at a price it sets and an SLA it underwrites. Its price reflects its cost of capital; its reliability reflects its operations.
A GPU rental marketplace does not own the hardware. It runs the matching layer — a catalogue, a billing relationship, a provisioning API — over supply belonging to somebody else. TensorDock states the model about as directly as anyone: "We're a marketplace of independent hosts who compete and set their own pricing." Spheron draws the same line: "Spheron is not a single cloud provider. It is a marketplace that aggregates GPU supply from multiple enterprise-grade data center partners." Shadeform sells the aggregator version of it, "Deploy high quality GPUs at the best prices across 30+ top clouds worldwide."
That single structural difference explains nearly everything downstream. Prices are lower because you are buying from operators whose cost base is not a hyperscaler's, and because they compete against each other in public. Reliability is uneven because "the operator" is not one company with one standard. And the SLA is thin or absent, because a marketplace cannot underwrite uptime on a machine it does not control.
The category is not small or fringe, either. Precedence Research puts the GPU-as-a-service market at USD 4.96 billion in 2025, rising to about USD 6.10 billion in 2026 and projecting USD 37.10 billion by 2035 at a 22.29% CAGR. The rental layer is where a growing share of that lands.
The mistake is treating the price difference as free money. It is a real discount with a real trade attached, and the trade is that you have absorbed the operational risk the cloud used to carry.
The four structures, and how each one breaks
"Marketplace" gets used for four genuinely different things. They are not interchangeable, and each has its own failure mode.
| Structure | Who owns the GPU | What you gain | How it breaks |
|---|---|---|---|
| Host marketplace (Vast.ai, TensorDock, SimplePod) | Independent operators, any scale | The lowest prices anywhere; enormous selection | Quality varies per host; a machine can leave the market; storage is often pinned to one physical box |
| Community tier inside a cloud (RunPod Community Cloud) | Third-party hosts, listed beside first-party supply | One account, one API, materially cheaper than the secure tier | Explicitly weaker guarantees than the same provider's own datacenter tier |
| Order-book / decentralized market (SF Compute, Akash) | Anyone who can list capacity | Genuinely open bidding; you can resell what you do not use | Listed capacity that never actually fills your order; settlement mechanics you have to learn |
| Cross-cloud aggregator (Shadeform, Spheron, Aquanode) | Several clouds and marketplaces at once | One interface over supply otherwise fragmented across many accounts | You inherit every underlying provider's quirks; coverage is the real product |
The categories blur. RunPod runs both a community tier and its own datacenters, so it is a cloud and a marketplace simultaneously — its docs describe Secure Cloud as operating "in T3/T4 data centers, providing high reliability and security for enterprise and production workloads" and Community Cloud as connecting "individual compute providers to users through a vetted, secure peer-to-peer system, with competitive pricing options." SF Compute goes the other way and runs an actual order book, where you "place a sell order as a standing order" and it "stays open on the orderbook until it fills or you cancel it."
Knowing which structure produced an offer tells you which questions to ask about it.
What the supply actually looks like
Here is the aggregate. A single snapshot of our own public marketplace feed on August 18, 2026 — 744 live offers from the providers reporting at the time, covering 52 distinct GPU models across 112 different region labels.
Two things fall out of that shape.
First, the same card is not one price. Per GPU-hour, dividing each offer by its GPU count:
| GPU | Offers | Providers | Cheapest | Median | Dearest | Spread |
|---|---|---|---|---|---|---|
| RTX 5090 | 99 | 4 | $0.401 | $0.751 | $1.521 | 3.8x |
| RTX 4090 | 82 | 4 | $0.331 | $0.597 | $1.261 | 3.8x |
| H100 | 49 | 4 | $2.590 | $3.290 | $5.001 | 1.9x |
| RTX PRO 6000 | 48 | 6 | $1.000 | $2.090 | $2.304 | 2.3x |
| A100 | 34 | 5 | $0.768 | $1.539 | $1.617 | 2.1x |
| H200 | 16 | 3 | $3.882 | $4.590 | $5.011 | 1.3x |
Consumer cards disperse; datacenter cards converge. An H100 is sold by a handful of operators running real facilities with comparable cost structures, so it trades near a market rate. A 4090 might be in a Tier III facility or under a desk, and those do not cost the same to run. We went deeper on why in the real price spread across providers — the short version being that on consumer GPUs, picking the right host beats picking the right provider.
Second, the gap against a hyperscaler is real and large. AWS lists the p5.48xlarge, an eight-way H100 box, at $55.04 per hour on demand in US East — about $6.88 per GPU-hour. RunPod's public price list puts H100 SXM at $2.69/hr on Community and $3.29/hr on Secure, with H100 PCIe at $1.99 and $2.89. That is roughly 2.5x on the like-for-like SXM comparison and about 3.5x at the bottom end. Both of those numbers are off the vendors' own pages, and the difference is the entire reason this category exists.
Third, "cheapest provider" is not a stable answer. In this snapshot the cheapest H100 was on RunPod, the cheapest H200 and A100 on Vast.ai, and SimplePod had the tightest 4090 distribution — a predictable price without hunting. Which provider wins depends on the model, and it changes. That is the argument for a marketplace over a favourite vendor, and equally the argument against hard-wiring yourself to whichever one won this week.
The six checks before you rent
Price is the easy variable. These decide whether the box is usable.
1. Is it interruptible, and what happens when it is? Vast.ai's pricing page is refreshingly blunt: interruptible instances are 50%+ cheaper but "preemptible — may be reclaimed", suited to fault-tolerant work that can "checkpoint and resume easily," while on-demand carries "guaranteed uptime" and "no interruptions." RunPod draws the same line — spot instances "can be interrupted without notice". Assume the honest answer to "how much notice do I get" is none, and capture anything you cannot lose before the interruption.
2. Where does your storage live, and can it leave? This is the check that quietly decides your future. Vast.ai documents its local volumes as "local only: tied to the physical machine where created" — they "cannot migrate between different physical machines" and "can only attach to instances on the same host." That is the marketplace trade in one line: the thing that makes your setup survive a restart is the same thing that cannot follow you to a cheaper machine. The datacenter-scoped network-volume version of this trap is covered in the RunPod network volume alternative.
3. Which ports are actually forwarded? A marketplace box usually sits behind the host's NAT, and you only get the ports the provider declared when it created the instance. If you need a web UI, a Jupyter server, a browser terminal or an inference endpoint, confirm the port is mapped before you rent. A feature riding an unmapped port is not flaky, it is structurally impossible — and every log will look normal while it fails.
4. Is the host verified, and what does that word mean here? Vast.ai runs three states: Unverified, Verified and Deverified. Verified means a host "passed automated checks for reliability, network stability, operational health, and performance"; Unverified means it "hasn't yet completed enough testing to confirm platform standards"; Deverified means it once passed and no longer does, after "sustained degradation." Providers mixing first-party and third-party supply label the tiers for the same reason. Read the labels — they are the provider telling you which promises apply.
5. Read the SLA on the cheap tier specifically. RunPod's terms of service state that it "does not make any specific uptime warranties with respect to the Community Cloud Offerings", adding that it "has no responsibility for the actions of Hosts" and makes no warranty the offering "will be available on an uninterrupted, error-free basis." That is not a gotcha — it is the honest description of what you bought, and it is why the price is what it is. Just do not book the cheap row expecting the expensive row's promises.
6. Check the GPU-count arithmetic yourself. Marketplace feeds quote inconsistently — some per GPU, some for the whole node. The sanity check: within one provider and one GPU model, the correct divisor makes the per-GPU rate collapse to roughly one number. If your figure still varies wildly across offers of the same card on the same provider, you are dividing by the wrong thing and about to compare a node price against a card price. On 8-GPU nodes the error is exactly 8x, in whichever direction hurts most.
The thing a marketplace does not solve
Everything above assumes the useful move is switching machines when price or availability changes. That assumption is where most of a marketplace's value leaks away.
A 3.8x spread on a 4090 is only worth acting on if acting is cheap. If moving to the cheaper box means an afternoon reinstalling CUDA, rebuilding a Python environment, re-cloning custom nodes at the right commits and re-downloading eighty gigabytes of weights, a 40% cut in the hourly rate is not a saving. It is a worse effective rate on your own time, and you will rationally decline it. People keep boxes running at well above the going rate for exactly this reason: the rebuild is worse than the overspend.
Notice that both of the storage answers above make this worse rather than better. A local volume tied to one physical machine, or a network volume pinned to one datacenter, is a portability cost dressed as a persistence feature. It buys you surviving a restart in one place, and charges you the ability to leave.
So the marketplace hands you price discovery, and the environment problem takes the discovery back. The missing primitive is not a better catalogue — it is capturing a working box whole and putting it down somewhere else. That is what we build: capturing the full filesystem rather than a mounted volume, so the environment survives being stopped and survives a change of provider. For the mechanics rather than the pitch, moving a GPU workload to another cloud provider walks through what has to come with the box, and what a volume snapshot misses covers why the obvious approach falls short.
Choosing one, by what you are actually doing
- Short experiments and price-sensitive batch work. A host marketplace wins outright. Take the cheap machine, accept the reclaim risk, and make sure anything valuable is captured before you walk away.
- Interactive work — ComfyUI, notebooks, iterating on a model. Optimise for the environment surviving, not the hourly rate. The rebuild tax dominates the compute cost at this scale, so a predictable catalogue price often beats a marginally cheaper auction.
- Multi-day training. Availability and interruption behaviour matter more than price. Prefer datacenter-tier supply and have a checkpoint-and-restore story before you start, not after the first reclaim.
- Anything with a compliance or data-residency constraint. Read region labels sceptically and prefer a named datacenter tier. A marketplace region string is a label supplied by the operator, not an audited claim.
- Teams. The binding problem is usually visibility — who started what, and what is still running — rather than the rate. Cost attribution beats a per-hour discount as soon as more than two people can launch boxes.
Common mistakes
- Booking the community tier and expecting the secure tier. Same provider, same API, different promises, and the difference is written into the terms of service.
- Comparing a node price to a per-card price. The most common arithmetic error in the category, and it is silent — nothing throws, the number just looks plausible and is wrong by the GPU count.
- Treating a persistent volume as portability. It makes your setup survive a restart in one location. It is not a way out of that location, and it keeps billing while the GPU is off.
- Chasing the spread without a way to move. If switching costs you an afternoon, you do not have access to the cheap price. You have access to a number.
- Assuming a listed offer is real. On open bidding markets especially, listed capacity and capacity that will actually take your job are different sets.
FAQ
What is a GPU rental marketplace? A platform that lets you rent GPU compute from third-party operators rather than from hardware the platform owns. It handles discovery, provisioning and billing; the machines belong to independent hosts, which is why prices are lower and reliability more variable than a first-party cloud.
How is a GPU marketplace different from a GPU cloud? A cloud owns its datacenters and underwrites the SLA. A marketplace matches you with someone else's hardware and generally cannot promise uptime it does not control — RunPod's terms say exactly that about its Community tier. You trade guarantees for price and selection.
How much cheaper is a GPU marketplace than AWS? On published prices for H100, roughly 2.5x to 3.5x. AWS's eight-way p5.48xlarge is $55.04/hr on demand, about $6.88 per GPU-hour; RunPod lists H100 SXM at $2.69/hr on Community and H100 PCIe at $1.99/hr. Rates move, so check both pages before quoting them.
Are decentralized GPU marketplaces worth using? They can be genuinely cheap and are open to any provider, but open bidding carries the specific risk of listed capacity that never actually fills your order. Budget for a failed lease attempt and configure a fallback provider.
How do I compare prices across GPU marketplaces fairly? Normalise to price per GPU per hour by dividing each offer by its GPU count, then compare within a single GPU model. Comparing across models, or a whole-node price against a single-card price, produces differences of several hundred percent that are pure arithmetic.
Is the cheapest GPU always the best deal? No, and the reason is rarely reliability. A cheaper machine only saves money if moving to it is cheap. Factor in the time to rebuild your environment on the new box; below a few days of runtime that cost usually exceeds the hourly saving.
About the author
I am Ansh Saxena, working on Aquanode. I spend my time on the layer underneath the models — aggregating GPU supply across providers and moving box state between them for people who rent one card at a time and hop between providers to chase price. The figures above come from our own live marketplace feed on a single August afternoon; the live version is on the marketplace and the GPU index, which is where to look before acting on any table with a date on it.
Sources
- Pods overview — Secure Cloud and Community Cloud (RunPod Documentation)
- Terms of Service (RunPod)
- GPU pricing (RunPod)
- Spot vs on-demand instances (RunPod)
- Host verification stages (Vast.ai Documentation)
- Instance storage types (Vast.ai Documentation)
- Pricing (Vast.ai)
- Secure short-term GPU capacity with EC2 Capacity Blocks (AWS Machine Learning Blog)
- How the market works (SF Compute Documentation)
- TensorDock
- Spheron
- Shadeform
- GPU as a Service Market (Precedence Research)