buyaigear

NVIDIA · Ampere · 24 GB · Qwen3.8 27B · Q4_K_M: ~30 tok/s

NVIDIA RTX A5000

A 3090's memory in a 230 W blower card that stacks in a case. Less bandwidth, but ECC, NVLink and workstation drivers.

Lowest price right now

$2,325.65

eBay · $2,300 + $25.65 shipping · $96 per GB · observed 2026-10-15 11:51 UTC

$2,300 + $25.65 shipping · Used · rwl-parts 429 · 99.3%

Where to buy

VendorPriceConditionObserved
eBay
cheapest active listing
$2,325.65
$2,300 + $25.65 shipping
new and used 2026-10-15 11:51 UTC Go to eBay

On eBay now

4 listings passed our filters at the last check. Cheapest delivered first. Seller reputation is feedback count and positive rate.

What it runs

For each model, grouped by vendor with the newest first: the largest quant that fits with 8K of context and the estimated speed for one user. The model you picked on the ladder is highlighted. Estimates from the spec sheet, not measurements: see how we estimate.

ModelQuantNeeds at 8KFitMax contextDecode tok/sPrefill tok/s
DeepSeek
DeepSeek V4.1 Flash 552B-A16B Sep 2026Q4_K_M338 GBdoes not fit
DeepSeek V4 Flash 284B-A13B Jul 2026Q4_K_M175 GBdoes not fit
DeepSeek V3.1 671B-A37B Aug 2025Q4_K_M411 GBdoes not fit
Gemma
Gemma 4 12B May 2026Q8_014 GBfits128K+~39~1,600
Gemma 4 31B Mar 2026Q5_K_M24 GBfits8K~23~630
Gemma 4 26B-A4B Mar 2026Q6_K22 GBfits87K~160~5,100
Gemma 3 27B Mar 2025Q5_K_M22 GBfits36K~26~710
GLM
GLM-5.3 753B-A40B Aug 2026Q4_K_M462 GBdoes not fit
GLM-5.3 Flash 320B-A18B Aug 2026Q4_K_M197 GBdoes not fit
GLM-4.6 355B-A32B Sep 2025Q4_K_M221 GBdoes not fit
GLM-4.5 Air 106B-A12B Jul 2025Q4_K_M68 GBdoes not fit
gpt-oss
gpt-oss-120b Aug 2025Q4_K_M73 GBdoes not fit
gpt-oss-20b Aug 2025Q6_K19 GBfits104K~170~5,400
Llama
Llama 4 Scout 109B-A17B Apr 2025Q4_K_M70 GBdoes not fit
Llama 3.3 70B Dec 2024Q4_K_M47 GBdoes not fit
Llama 3.1 8B Jul 2024Q8_011 GBfits104K~59~2,400
MiMo
MiMo V2.6 Pro 1.02T-A42B Sep 2026Q4_K_M624 GBdoes not fit
MiMo V2.6 Flash 309B-A15B Sep 2026Q4_K_M190 GBdoes not fit
Mistral
Mistral Medium 3.5 128B Mar 2026Q4_K_M83 GBdoes not fit
Mistral Small 4 119B-A6.5B Mar 2026Q4_K_M79 GBdoes not fit
Mistral Small 3.2 24B Jun 2025Q6_K23 GBfits16K~25~810
Qwen
Qwen3.8 Flash-Next 125B-A6B Aug 2026Q4_K_M78 GBdoes not fit
Qwen3.8 27B Aug 2026 (your pick)Q5_K_M21 GBfits49K~26~720
Qwen3.6 27B Apr 2026Q5_K_M21 GBfits49K~26~720
Qwen3.6 35B-A3B Apr 2026Q4_K_M23 GBfits54K~270~6,500
Qwen3 Coder 480B-A35B Jul 2025Q4_K_M296 GBdoes not fit
Qwen3 235B-A22B Jul 2025Q4_K_M146 GBdoes not fit
Qwen3 32B Apr 2025Q4_K_M24 GBfits9K~25~590

Specifications

Memory
24 GB GDDR6 ECC
Memory bandwidth
768 GB/s
Bus width
384-bit
Shader cores
8,192
Tensor cores
256
FP32
27.8 TFLOPS
FP16 (dense)
111 TFLOPS
Power
230 W
Form factor
Dual slot, full height, blower
Interface
PCIe 4.0 x16
Architecture
Ampere
Launched
2021
MSRP
$2,250

Source: manufacturer specifications.