buyaigear
Prices checked 6 min ago

NVIDIA · Ampere · 48 GB · Qwen3.8 27B · Q4_K_M: ~30 tok/s

NVIDIA RTX A6000

48 GB for the least money per gigabyte among NVIDIA cards that still get driver updates. Slower than the Ada and Blackwell cards, but a 70B model at Q4 fits, and two of them bridge with NVLink.

Lowest price right now

$4,500

eBay · free shipping · $93 per GB · observed 2026-10-14 22:18 UTC

See it on eBaySee it on Amazon

Where to buy

VendorPriceConditionObserved
eBay
cheapest active listing		 $4,500
free shipping		 new and used 2026-10-14 22:18 UTC Go to eBay
Amazon
price tracking coming		 price on Amazon new Go to Amazon

On eBay now

61 listings passed our filters at the last check. Cheapest delivered first. Seller reputation is feedback count and positive rate.

All 61 listings · Open the search on eBay

What it runs

For each model, grouped by vendor with the newest first: the largest quant that fits with 8K of context and the estimated speed for one user. The model you picked on the ladder is highlighted. Estimates from the spec sheet, not measurements: see how we estimate.

ModelQuantNeeds at 8KFitMax contextDecode tok/sPrefill tok/s
DeepSeek
DeepSeek V4.1 Flash 552B-A16B Sep 2026Q4_K_M338 GBdoes not fit
DeepSeek V4 Flash 284B-A13B Jul 2026Q4_K_M175 GBdoes not fit
DeepSeek V3.1 671B-A37B Aug 2025Q4_K_M411 GBdoes not fit
Gemma
Gemma 4 12B May 2026Q8_014 GBfits128K+~39~2,300
Gemma 4 31B Mar 2026Q8_035 GBfits128K+~15~880
Gemma 4 26B-A4B Mar 2026Q8_028 GBfits128K+~120~7,100
Gemma 3 27B Mar 2025Q8_031 GBfits128K+~17~990
GLM
GLM-5.3 753B-A40B Aug 2026Q4_K_M462 GBdoes not fit
GLM-5.3 Flash 320B-A18B Aug 2026Q4_K_M197 GBdoes not fit
GLM-4.6 355B-A32B Sep 2025Q4_K_M221 GBdoes not fit
GLM-4.5 Air 106B-A12B Jul 2025IQ2_M39 GBfits54K~120~2,300
gpt-oss
gpt-oss-120b Aug 2025IQ2_M42 GBfits89K~290~5,300
gpt-oss-20b Aug 2025Q8_024 GBfits128K+~130~7,500
Llama
Llama 4 Scout 109B-A17B Apr 2025IQ2_M40 GBfits46K~86~1,600
Llama 3.3 70B Dec 2024Q4_K_M47 GBfits10K~12~380
Llama 3.1 8B Jul 2024Q8_011 GBfits128K+~59~3,400
MiMo
MiMo V2.6 Pro 1.02T-A42B Sep 2026Q4_K_M624 GBdoes not fit
MiMo V2.6 Flash 309B-A15B Sep 2026Q4_K_M190 GBdoes not fit
Mistral
Mistral Medium 3.5 128B Mar 2026IQ2_M48 GBfits8K~11~210
Mistral Small 4 119B-A6.5B Mar 2026IQ2_M47 GBfits10K~230~4,200
Mistral Small 3.2 24B Jun 2025Q8_028 GBfits125K~20~1,100
Qwen
Qwen3.8 Flash-Next 125B-A6B Aug 2026IQ2_M44 GBfits128K+~240~4,500
Qwen3.8 27B Aug 2026 (your pick)Q8_031 GBfits128K+~17~1,000
Qwen3.6 27B Apr 2026Q8_031 GBfits128K+~17~1,000
Qwen3.6 35B-A3B Apr 2026Q8_039 GBfits128K+~160~9,000
Qwen3 Coder 480B-A35B Jul 2025Q4_K_M296 GBdoes not fit
Qwen3 235B-A22B Jul 2025Q4_K_M146 GBdoes not fit
Qwen3 32B Apr 2025Q8_038 GBfits43K~14~830

Specifications

Memory
48 GB GDDR6 ECC
Memory bandwidth
768 GB/s
Bus width
384-bit
Shader cores
10,752
Tensor cores
336
FP32
38.7 TFLOPS
FP16 (dense)
155 TFLOPS
Power
300 W
Form factor
Dual slot, full height
Interface
PCIe 4.0 x16
Architecture
Ampere
Launched
2020
MSRP
$4,650

Source: manufacturer specifications.