40.9decode tok/s
1,279prefill tok/s
64Kcontext
Tested on this card · Sep 26, 2026
NVIDIA · 12 GB · 504 GB/s
RepresentativeEach card is a model and hardware setup, including any documented host RAM, storage or CPU requirements. Select a recipe to update its speeds, context and exact command.
Speeds are the selected recipe’s recorded measurements, not estimates; “—” means unmeasured. Evidence distinguishes checks on this card, sibling-card checks, earlier checks and publisher reports.
| Memory | 12 GB GDDR6X |
| Bandwidth | 504 GB/s |
| Architecture | NVIDIA Ada Lovelace |
| CUDA cores | 7,680 |
| Precision | Dense TFLOPS | 2:4 sparse |
|---|---|---|
| FP32 | 40 | – |
| MSRP | $799 |
| Listing | Price | Seen | Where |
|---|---|---|---|
| MSRP | $799 | 2023-01 | NVIDIA › |
Sources: NVIDIA, NVIDIA (2)