83.6decode tok/s
—prefill tok/s
128Kcontext
Earlier check · Sep 2, 2026
RTX 4090
NVIDIA · 24 GB · 1008 GB/s
7 models7 model configurations13 exact recipes
Model configurations
Each card is a model and hardware setup, including any documented host RAM, storage or CPU requirements. Select a recipe to update its speeds, context and exact command.
140.8decode tok/s
4,173prefill tok/s
64Kcontext
Tested on this card · Sep 26, 2026
—decode tok/s
—prefill tok/s
128Kcontext
Earlier check · Date not recorded
—decode tok/s
—prefill tok/s
128Kcontext
Earlier check · Date not recorded
359.8decode tok/s
4,115prefill tok/s
256Kcontext
Tested on this card · Sep 27, 2026
—decode tok/s
—prefill tok/s
195Kcontext
Reported by MiaAI-Lab · Sep 1, 2026
- Host RAM
- ≥ 55 GB free
- Disk
- ≥ 86 GB NVMe
56.1decode tok/s
2,615prefill tok/s
256Kcontext
Tested on this card · Oct 16, 2026
Speeds are the selected recipe’s recorded measurements, not estimates; “—” means unmeasured. Evidence distinguishes checks on this card, sibling-card checks, earlier checks and publisher reports.
| Memory | 24 GB GDDR6X |
| Bandwidth | 1,008 GB/s |
| Architecture | NVIDIA Ada Lovelace |
| CUDA cores | 16,384 |
| Precision | Dense TFLOPS | 2:4 sparse |
|---|---|---|
| FP8 | 660.6 | 1,321.2 |
| INT8 | 660.6 | 1,321.2 |
| FP16 | 330.3 | 660.6 |
| BF16 | 165.2 | 330.4 |
| TF32 | 82.6 | 165.2 |
| FP32 | 82.6 | – |
| MSRP | $1,599 |
| Street price | $3,898 |
| Availability | In stock |
| Listing | Price | Seen | Where |
|---|---|---|---|
| NVIDIA GeForce RTX 4090 Founders Edition 24GB GDDR6X GeForce RTX 4090 FE | $3,898 | 2026-08-31 | newegg › |
| MSRP | $1,599 | 2022-10-12 | NVIDIA › |
Sources: NVIDIA, NVIDIA (2), NVIDIA (3), newegg