GPUs for local AI
Workstation, consumer and used data-center cards, ranked by memory and priced live. The speed column uses the model and quant you pick.
Memory ladder
Ranked by memory unless you sort by speed or price, because memory decides what fits. Bars are to scale within each list: solid for dedicated VRAM, hatched for unified memory shared with the CPU. The speed column is the estimated decode rate for the model and quant you pick, for one user with 8K of context.
- ProductMemoryBandwidthQwen3.8 27B · Q4_K_MLowest price $/GB
-
RTX PRO 6000 Blackwell
96 GB1,792 GB/s ~71 tok/s $16,499eBay, 6 min ago · $171/GB
-
H100 80GB PCIe
80 GB2,000 GB/s ~79 tok/s $27,000eBay, 6 min ago · $337/GB
-
A100 80GB PCIe
80 GB1,935 GB/s ~76 tok/s $15,299eBay, 6 min ago · $191/GB
-
RTX PRO 5000 Blackwell
48 GB1,344 GB/s ~53 tok/s $7,099.99eBay, 6 min ago · $147/GB
-
RTX 6000 Ada
48 GB960 GB/s ~38 tok/s $7,499.99eBay, 6 min ago · $156/GB
-
RTX A6000
48 GB768 GB/s ~30 tok/s $4,500eBay, 6 min ago · $93/GB
-
GeForce RTX 5090
32 GB1,792 GB/s ~71 tok/s $4,920.99eBay, 6 min ago · $153/GB
-
RTX PRO 4500 Blackwell
32 GB896 GB/s ~35 tok/s $4,450eBay, 6 min ago · $139/GB
-
Radeon AI PRO R9700
32 GB640 GB/s ~19 tok/s $1,820eBay, 6 min ago · $56/GB
-
GeForce RTX 4090
24 GB1,008 GB/s ~40 tok/s $2,083.48eBay, 6 min ago · $86/GB
-
Radeon RX 7900 XTX
24 GB960 GB/s ~29 tok/s $900eBay, 6 min ago · $37/GB
-
GeForce RTX 3090
24 GB936 GB/s ~37 tok/s $1,500eBay, 6 min ago · $62/GB
-
RTX PRO 4000 Blackwell
24 GB672 GB/s ~27 tok/s $2,827.16eBay, 6 min ago · $117/GB
-
RTX PRO 4000 Blackwell SFF
24 GB432 GB/s ~17 tok/s $2,899eBay, 6 min ago · $120/GB
-
Tesla P40
24 GB346 GB/s ~14 tok/s $273eBay, 6 min ago · $11/GB
-
RTX 4000 SFF Ada
20 GB280 GB/s ~11 tok/s $1,510.30eBay, 6 min ago · $75/GB