Instinct MI300X

Model configurations

Each card is a model and hardware setup, including any documented host RAM, storage or CPU requirements. Select a recipe to update its speeds, context and exact command.

Search configurations

Sort byModelHardware setupTotal memory (GB)RecipeContextDecode (tok/s)Prefill (tok/s)Evidence↑ A–Z

3 configurations · 3 recipes

LFM2.5-2.6B

Instinct MI300X192 GB1 card per machine · 1 machine

SGLangFormat not recorded

—decode tok/s

—prefill tok/s

128Kcontext

Earlier check · Date not recorded

CommandFull recipe ›

Ornith-1.5-35B-A3B

Instinct MI300X192 GB1 card per machine · 1 machine

SGLangFormat not recorded

—decode tok/s

—prefill tok/s

128Kcontext

Earlier check · Date not recorded

CommandFull recipe ›

Qwen3.8-27B

Instinct MI300X192 GB1 card per machine · 1 machine

SGLangFP8

—decode tok/s

—prefill tok/s

128Kcontext

Earlier check · Date not recorded

CommandFull recipe ›

Speeds are the selected recipe’s recorded measurements, not estimates; “—” means unmeasured. Evidence distinguishes checks on this card, sibling-card checks, earlier checks and publisher reports.

Sources: AMD