MiniMax-M2 VRAM Requirements

MiniMax-M2 needs about 218 GB of VRAM at FP8 (official) with an 8K context: 215 GB for weights, 1.9 GB for the KV cache and 0.9 GB of runtime overhead. At Q4_K_M it needs 133 GB. At Q8_0 it needs 230 GB and at full FP16 precision 431 GB. The smallest GPU that runs it fully is the Apple M3 Ultra 512GB.

By MiniMax · Updated October 14, 2026 · Values from config.json on Hugging Face

218 GB VRAM

MiniMax-M2 at FP8 (official) with 8K context and the KV cache in FP16.

  • Weights 215 GB
  • KV cache 1.9 GB
  • Runtime overhead 0.9 GB

Mixture of experts: all 230B parameters need memory, but only 10B are read per token, so it runs at the speed of a much smaller model.

Which GPUs can run it

MiniMax-M2 VRAM by quantization

Total memory with an FP16 KV cache. "Smallest tier" is the smallest standard VRAM size with a 6% safety margin at 8K.

QuantizationBits/weightWeightsTotal at 8KTotal at 32KSmallest tier
FP8 (official)8.03215 GB218 GB224 GBMulti-GPU / server
Q4_K_M4.85130 GB133 GB139 GBMulti-GPU / server
Q5_K_M5.69152 GB155 GB161 GBMulti-GPU / server
Q6_K6.59176 GB179 GB185 GBMulti-GPU / server
Q8_08.50228 GB230 GB236 GBMulti-GPU / server
FP16 / BF1616.00428 GB431 GB437 GBMulti-GPU / server
Q3_K_M3.91105 GB108 GB113 GB128 GB
Q2_K3.0080.3 GB83.2 GB89.0 GB96 GB

VRAM by context length

At FP8 (official). The KV cache grows linearly with context: 0.24 GB per 1,000 tokens in FP16.

ContextKV cache (FP16)KV cache (Q8_0)Total, FP16 cacheTotal, Q8_0 cache
4K tokens1.0 GB0.5 GB217 GB216 GB
8K tokens1.9 GB1.0 GB218 GB217 GB
32K tokens7.8 GB4.1 GB224 GB220 GB
128K tokens31.0 GB16.5 GB247 GB232 GB
192K tokens46.5 GB24.7 GB262 GB241 GB

GPUs that can run MiniMax-M2

At FP8 (official) with 8K context. "Best quant" is the highest-quality format that fits fully; "max context" is at FP8 (official).

GPUUsable memoryStatusBest quantMax contextSpeed
Apple M3 Ultra 512GB384 GBFitsFP8 (official)192K~37 tok/s
AMD Instinct MI300X 192GB192 GB83% on GPUQ6_K–~18 tok/s
NVIDIA H200 141GB141 GB61% on GPUIQ4_XS–~9.0 tok/s
RTX PRO 6000 Blackwell 96GB96.0 GB41% on GPUQ2_K–~6.1 tok/s
A100 80GB80.0 GB35% on GPU––~5.5 tok/s
H100 80GB SXM80.0 GB35% on GPU––~5.5 tok/s

About MiniMax-M2

A 230B mixture-of-experts with only 10B active parameters, built for coding agents. The official weights are FP8. Every one of its 62 layers uses full attention, so the KV cache grows quickly with long agent sessions: about 248 KB per token in FP16.

SpecValue
Parameters230B total, 10B active (MoE)
Layers62
Hidden size3072
Attention heads / KV heads48 / 8
Head dimension128
Vocabulary200,064
Max context (used here)192K tokens
KV cache per token (FP16)248 KB
Released2025-10
LicenseMIT

MiniMax-M2 VRAM: common questions

What do I need to run MiniMax-M2 locally?

At Q4_K_M about 130 GB plus cache, so a 192 GB or 512 GB Mac Studio, or four to six 24–48 GB GPUs. A 128 GB machine needs a Q2-level quant.

How much VRAM does MiniMax-M2 need?

About 218 GB at FP8 (official) with an 8K context, 230 GB at Q8_0 and 431 GB at FP16. Longer contexts add 0.24 GB per 1,000 tokens with an FP16 cache.

What is the cheapest GPU that can run MiniMax-M2?

The smallest listed device that fits it fully at FP8 (official) with 8K context is the Apple M3 Ultra 512GB (384 GB usable).

Does MiniMax-M2 need VRAM for all 230B parameters?

Yes. All experts must be loaded because any token can use any expert. Only 10B parameters are read per token, so it generates text about as fast as a 10B dense model.

Related