NVIDIA H200 141GB SXM5

Price history

Daily low across every tracked vendor, last 3 days.

Where to buy

On eBay now

No active listing passes our filters at the moment. Checked 7 min ago. We check every 28 minutes.

Rent one by the hour

Try it before you buy, or skip buying: the cheapest on-demand price for one H200 141GB SXM5 in the cloud right now, checked every hour.

Rental prices for every card · Rental links are referral links: we earn a small share of what you spend, at no cost to you.

What it runs

For each model, grouped by vendor with the newest first: the largest quant that fits with 8K of context and the estimated speed for one user, at 8K and at 32K of context. On a card, a model too big for its memory can still run with part of the weights in system RAM; we assume 64 GB, and the speed shown accounts for it. The model you picked on the ladder is highlighted. Estimates from the spec sheet, not measurements: see how we estimate.

Specifications

Memory

141 GB HBM3e

Memory bandwidth

4,800 GB/s

Bus width

6144-bit

Shader cores

16,896

Tensor cores

528

FP32

67.0 TFLOPS

FP16 (dense)

989 TFLOPS

FP8 (dense)

1979 TFLOPS

Power

700 W

Form factor

SXM5 module: needs an HGX baseboard, or an SXM5-to-PCIe adapter board that supports it, and serious cooling

Interface

PCIe 5.0 x16

Architecture

Hopper

Launched

2024

Source: manufacturer specifications.