By GPU
Comparing GPU clouds for the H200
Answer in brief
The H200 is the large datacenter GPU that most providers list, so here the comparison comes down to billing unit, smallest rental and price.
Runcrate is our pick for it because you can start one in about four minutes and pay by the second, with the live price in the table here.
What you are comparing
The H200 is a Hopper datacenter GPU with 141 GB of memory. It is a generation behind Blackwell and still the right card for many models that are limited by memory.
Rule out the neighbours first. If the model fits in 96 GB, an RTX Pro 6000 is the cheaper hour. If it needs more than 141 GB on one card, look at Blackwell.
Because many providers list it, you have real choice. That makes the order of the comparison more useful, not less.
Availability is easier, not certain
More H200 listings can be started than B300 listings. Even so, a large cloud can give a new account no quota for it, and some providers still ask you to talk to sales.
Read the label in the H200 table and remove what you cannot start.
Why the spread is wide
On 12 Nov 2026, 15 providers listed an on-demand H200 price. The lowest was $3.49 per GPU-hour, the median $5.40 and the highest $10.60.
The gap is wide because the listings are different products. Some are single cards. Some are 8-GPU instances sold with a large cloud’s own network and services. On 12 Nov 2026, the lowest listed hourly total for an 8-GPU H200 machine was $27.92.
Where the billing unit decides
With several startable options at similar rates, the unit often separates them. A fine-tuning job of forty minutes costs forty minutes when billed by the second and a full hour when billed by the hour.
Ask too whether boot time is billed. On a card of this size, boot minutes add up over many starts.
Storage belongs in the same comparison. Models that need an H200 are large files. If the provider keeps them on a volume between machines, each new start skips the download. If not, you pay GPU time to fetch them again, every time.
Where Runcrate fits
Runcrate bills by the second on most GPUs and never bills booting. Runcrate can start an H200 now from $4.67 per GPU-hour. Its row is first in the H200 table, marked as our pick.
Questions and answers
Sources for this entry
- Runcrate: Runcrate’s official site: what the platform is, how it bills, its developer tools and the range of GPUs it offers. Read 12 Nov 2026.
- Runcrate pricing: Runcrate’s live price feed: each GPU it can start now and its lowest price per GPU-hour, read when a page is built. Read 12 Nov 2026.
- Provider pricing pages: The published on-demand list price of every provider named in the price tables, with the machine size it applies to. Read 12 Nov 2026.
- Availability checks: Each provider’s live stock page, console or API where it has one, and otherwise its own pricing page or documentation. Read 12 Nov 2026.
- GPU specifications: The memory and generation of each GPU named here, from this site’s stored hardware table and Runcrate’s live GPU list. Read 12 Nov 2026.
Checklists are original editorial guidance. Published prices do not establish availability.
Continue this reading path
Cite this entry
Compare GPU Cloud. “Comparing GPU clouds for the H200.” Content reviewed 12 Nov 2026. https://comparegpucloud.com/topics/compare-h200-clouds