RTX 4080

NVIDIA · 16 GB · 717 GB/s

4 models4 model configurations5 exact recipes

Representative image: 4080-family og:image depicts the 4080 SUPER FE; representative for the original 4080 (same FE chassis). — 4080-family og:image depicts the 4080 SUPER FE; representative for the original 4080 (same FE chassis). NVIDIA ›

Model configurations

Each card is a model and hardware setup, including any documented host RAM, storage or CPU requirements. Select a recipe to update its speeds, context and exact command.

Search configurations

Sort by

4 configurations · 5 recipes

Gemma 4 26B A4B

RTX 408016 GB1 card per machine · 1 machine

TabbyAPIEXL3 3.1 bpw

136.2decode tok/s

2,573prefill tok/s

32Kcontext

Tested on this card · Sep 26, 2026

Full recipe ›

Qwen3.5-9B

RTX 408016 GB1 card per machine · 1 machine

TabbyAPIEXL3 4 bpw

159.9decode tok/s

—prefill tok/s

256Kcontext

Earlier check · Sep 22, 2026

Full recipe ›

Qwen3.8-27B

RTX 408016 GB1 card per machine · 1 machine

Exact recipe

—decode tok/s

—prefill tok/s

172Kcontext

Reported by MiaAI-Lab · Sep 10, 2026

Full recipe ›

Qwen3.8-Flash-Next

RTX 408016 GB1 card per machine · 1 machine

Host RAM: ≥ 48 GB free
Disk: ≥ 64 GB NVMe

SGLangEXL3 2.05 bpw

60.5decode tok/s

1,414prefill tok/s

256Kcontext

Tested on this card · Oct 16, 2026

Full recipe ›

Speeds are the selected recipe’s recorded measurements, not estimates; “—” means unmeasured. Evidence distinguishes checks on this card, sibling-card checks, earlier checks and publisher reports.

Hardware

Memory	16 GB GDDR6X
Bandwidth	717 GB/s
Architecture	NVIDIA Ada Lovelace
CUDA cores	9,728

Precision	Dense TFLOPS	2:4 sparse
FP8	389.9	779.8
INT8	389.9	779.8
FP16	194.9	389.8
BF16	97.5	195
TF32	48.7	97.4
FP32	49	–

MSRP	$1,199
Street price	$1,799
Availability	In stock

Listing	Price	Seen	Where
NVIDIA GeForce RTX 4080 Founders Edition Graphics Card 16GB GDDR6X	$1,799	2026-08-31	newegg ›
MSRP	$1,199	2022-11	NVIDIA ›

Sources: NVIDIA, NVIDIA (2), NVIDIA (3), newegg