RTX A6000

NVIDIA · 48 GB · 768 GB/s

2 models2 model configurations2 exact recipes

Official product-page og:image; RTX A6000 closeup render. NVIDIA ›

Model configurations

Each card is a model and hardware setup, including any documented host RAM, storage or CPU requirements. Select a recipe to update its speeds, context and exact command.

Search configurations

Sort by

2 configurations · 2 recipes

Gemma 4 26B A4B

RTX A600048 GB1 card per machine · 1 machine

TabbyAPIEXL3 6.1 bpw

86.9decode tok/s

1,894prefill tok/s

128Kcontext

Tested on this card · Sep 26, 2026

Full recipe ›

Qwen3.8-27B

RTX A600048 GB1 card per machine · 1 machine

TabbyAPIEXL3 5 bpw

69.4decode tok/s

579prefill tok/s

256Kcontext

Tested on this card · Sep 25, 2026

Full recipe ›

Speeds are the selected recipe’s recorded measurements, not estimates; “—” means unmeasured. Evidence distinguishes checks on this card, sibling-card checks, earlier checks and publisher reports.

Hardware

Memory	48 GB GDDR6 ECC
Bandwidth	768 GB/s
Architecture	NVIDIA Ampere
CUDA cores	10,752
Tensor cores	336
RT cores	84

Precision	Dense TFLOPS	2:4 sparse
INT8	309.7	619.4
FP16	154.8	309.6
BF16	154.8	309.6
TF32	77.4	154.8
FP32	38.7	–

MSRP

$4,650

Listing	Price	Seen	Where
MSRP	$4,650	2026-09-01	NVIDIA ›

Sources: NVIDIA, NVIDIA (2)