RTX 4060

NVIDIA · 8 GB · 272 GB/s

2 models2 model configurations2 exact recipes

Representative image: 4060/4060 Ti family og:image shows the 4060 Ti FE; representative for the 4060 (same chassis family, no 4060 FE sold separately). — 4060/4060 Ti family og:image shows the 4060 Ti FE; representative for the 4060 (same chassis family, no 4060 FE sold separately). NVIDIA ›

Model configurations

Each card is a model and hardware setup, including any documented host RAM, storage or CPU requirements. Select a recipe to update its speeds, context and exact command.

Search configurations

Sort by

2 configurations · 2 recipes

Gemma 4 12B

RTX 40608 GB1 card per machine · 1 machine

TabbyAPIEXL3 3 bpw

31.3decode tok/s

661prefill tok/s

32Kcontext

Tested on this card · Sep 26, 2026

Full recipe ›

LFM2.5-2.6B

RTX 40608 GB1 card per machine · 1 machine

SGLangFormat not recorded

42.9decode tok/s

—prefill tok/s

128Kcontext

Earlier check · Sep 3, 2026

Full recipe ›

Speeds are the selected recipe’s recorded measurements, not estimates; “—” means unmeasured. Evidence distinguishes checks on this card, sibling-card checks, earlier checks and publisher reports.

Hardware

Memory	8 GB GDDR6
Bandwidth	272 GB/s
Architecture	NVIDIA Ada Lovelace
CUDA cores	3,072

Precision	Dense TFLOPS	2:4 sparse
FP32	15	–

MSRP	$299
Street price	$499
Availability	In stock

Listing	Price	Seen	Where
MSI Ventus GeForce RTX 4060 8GB GDDR6 PCI Express 4.0 x8 ATX Graphics Card RTX 4060 VENTUS 2X BLACK 8G OC	$499	2026-08-31	newegg ›
MSRP	$299	2023-07	NVIDIA ›

Sources: NVIDIA, NVIDIA (2), NVIDIA (3), newegg