NVIDIA · Blackwell · 96 GB · Qwen3.8 27B · Q4_K_M: ~71 tok/s
NVIDIA RTX PRO 6000 Blackwell
The most memory you can put on one PCIe card: 96 GB of GDDR7 with ECC and 1.8 TB/s of bandwidth. Enough for a 70B model at Q8, or a 120B mixture-of-experts model at Q4 with context to spare. Sold as Workstation Edition (600 W), Max-Q (300 W) and Server Edition.
Lowest price right now
$16,499
eBay · free shipping · $171 per GB · observed 2026-10-14 22:18 UTC
Where to buy
| Vendor | Price | Condition | Observed | |
|---|---|---|---|---|
| eBay cheapest active listing |
$16,499 free shipping |
new and used | 2026-10-14 22:18 UTC | Go to eBay |
| Amazon price tracking coming |
price on Amazon | new | Go to Amazon |
On eBay now
76 listings passed our filters at the last check. Cheapest delivered first. Seller reputation is feedback count and positive rate.
-
$16,499free shipping -
$17,399.95free shipping -
$17,499free shipping -
$17,499.99free shipping -
$17,499.99free shipping -
$17,500free shipping
What it runs
For each model, grouped by vendor with the newest first: the largest quant that fits with 8K of context and the estimated speed for one user. The model you picked on the ladder is highlighted. Estimates from the spec sheet, not measurements: see how we estimate.
| Model | Quant | Needs at 8K | Fit | Max context | Decode tok/s | Prefill tok/s |
|---|---|---|---|---|---|---|
| DeepSeek | ||||||
| DeepSeek V4.1 Flash 552B-A16B Sep 2026 | Q4_K_M | 338 GB | does not fit | |||
| DeepSeek V4 Flash 284B-A13B Jul 2026 | Q4_K_M | 175 GB | does not fit | |||
| DeepSeek V3.1 671B-A37B Aug 2025 | Q4_K_M | 411 GB | does not fit | |||
| Gemma | ||||||
| Gemma 4 12B May 2026 | Q8_0 | 14 GB | fits | 128K+ | ~92 | ~7,400 |
| Gemma 4 31B Mar 2026 | Q8_0 | 35 GB | fits | 128K+ | ~36 | ~2,900 |
| Gemma 4 26B-A4B Mar 2026 | Q8_0 | 28 GB | fits | 128K+ | ~290 | ~23,000 |
| Gemma 3 27B Mar 2025 | Q8_0 | 31 GB | fits | 128K+ | ~40 | ~3,200 |
| GLM | ||||||
| GLM-5.3 753B-A40B Aug 2026 | Q4_K_M | 462 GB | does not fit | |||
| GLM-5.3 Flash 320B-A18B Aug 2026 | Q4_K_M | 197 GB | does not fit | |||
| GLM-4.6 355B-A32B Sep 2025 | Q4_K_M | 221 GB | does not fit | |||
| GLM-4.5 Air 106B-A12B Jul 2025 | Q6_K | 90 GB | fits | 39K | ~120 | ~7,300 |
| gpt-oss | ||||||
| gpt-oss-120b Aug 2025 | Q5_K_M | 85 GB | fits | 128K+ | ~320 | ~17,000 |
| gpt-oss-20b Aug 2025 | Q8_0 | 24 GB | fits | 128K+ | ~310 | ~24,000 |
| Llama | ||||||
| Llama 4 Scout 109B-A17B Apr 2025 | Q6_K | 92 GB | fits | 25K | ~84 | ~5,200 |
| Llama 3.3 70B Dec 2024 | Q8_0 | 79 GB | fits | 58K | ~16 | ~1,200 |
| Llama 3.1 8B Jul 2024 | Q8_0 | 11 GB | fits | 128K+ | ~140 | ~11,000 |
| MiMo | ||||||
| MiMo V2.6 Pro 1.02T-A42B Sep 2026 | Q4_K_M | 624 GB | does not fit | |||
| MiMo V2.6 Flash 309B-A15B Sep 2026 | Q4_K_M | 190 GB | does not fit | |||
| Mistral | ||||||
| Mistral Medium 3.5 128B Mar 2026 | Q5_K_M | 95 GB | fits | 9K | ~13 | ~690 |
| Mistral Small 4 119B-A6.5B Mar 2026 | Q5_K_M | 91 GB | fits | 16K | ~250 | ~14,000 |
| Mistral Small 3.2 24B Jun 2025 | Q8_0 | 28 GB | fits | 128K+ | ~46 | ~3,700 |
| Qwen | ||||||
| Qwen3.8 Flash-Next 125B-A6B Aug 2026 | Q5_K_M | 90 GB | fits | 128K+ | ~270 | ~15,000 |
| Qwen3.8 27B Aug 2026 (your pick) | Q8_0 | 31 GB | fits | 128K+ | ~41 | ~3,300 |
| Qwen3.6 27B Apr 2026 | Q8_0 | 31 GB | fits | 128K+ | ~41 | ~3,300 |
| Qwen3.6 35B-A3B Apr 2026 | Q8_0 | 39 GB | fits | 128K+ | ~370 | ~29,000 |
| Qwen3 Coder 480B-A35B Jul 2025 | Q4_K_M | 296 GB | does not fit | |||
| Qwen3 235B-A22B Jul 2025 | IQ2_M | 83 GB | fits | 74K | ~160 | ~4,000 |
| Qwen3 32B Apr 2025 | Q8_0 | 38 GB | fits | 128K+ | ~34 | ~2,700 |
Specifications
- Memory
- 96 GB GDDR7 ECC
- Memory bandwidth
- 1,792 GB/s
- Bus width
- 512-bit
- Shader cores
- 24,064
- Tensor cores
- 752
- FP32
- 125.0 TFLOPS
- FP16 (dense)
- 504 TFLOPS
- FP8 (dense)
- 1008 TFLOPS
- Power
- 600 W
- Form factor
- Dual slot, full height (Workstation Edition)
- Interface
- PCIe 5.0 x16
- Architecture
- Blackwell
- Launched
- 2025
- MSRP
- $8,565
Source: manufacturer specifications.