by Mistral AI · Mistral Small family · best for best price-to-capability open multimodal model
Mistral Small 4 (release 26.03, shipped 16 March 2026) is the cost-disruption release of the 2026 lineup: a 119B-parameter Mixture-of-Experts with only 6.5B active per token (128 experts, 4 active), priced at $0.15/$0.60 per 1M tokens, under genuine Apache 2.0. Despite the "Small" label it scores 78.0% on MMLU-Pro and 71.2% on GPQA Diamond — within reach of Medium 3.1 and Large 3 — while running on a single GPU. It unifies chat, reasoning, and coding in one efficient model. The buyer's sentence: the best price-to-capability open multimodal model in 2026, with Apache 2.0 as a structural moat.
| Benchmark | Score | Source |
|---|---|---|
| MMLU-Pro | 78% | venturebeat.com 2026-03-16T00:00:00.000Z |
| GPQA Diamond | 71.2% | huggingface.co 2026-03-16T00:00:00.000Z |
| Artificial Analysis Index | 28 | artificialanalysis.ai 2026-05-28T00:00:00.000Z |
Six personas, six verdicts — the same panel that reviews every product on TopReviewed.
“It re-anchors the 'cheap and good' tier: single-GPU production, Apache 2.0, and one endpoint for chat and reasoning. My new EU default unless workload justifies more.”
Small 4 changes the cost curve. A 119B MoE with 6.5B active runs in production on a single A100 and absorbs meaningful traffic without flagship spend. Apache 2.0 means I fine-tune and self-host with zero license friction — a genuinely cleaner story than Medium 3.5's modified-MIT. The unified reasoning toggle collapses architecture: one endpoint covers chat and lightweight reasoning. For any EU SaaS shipping multilingual features, Small 4 is now my default; I only step up to Medium 3.5 or Large 3 when a workload specifically justifies it. The vision encoder is the one soft spot.
“Small 4 is Mistral's most disruptive product on a per-dollar basis — it makes 'good enough' frontier capability nearly free to self-host.”
Strategically this is the model that pressures the entire cost-optimised tier. By delivering MMLU-Pro 78 and GPQA 71 at $0.15/$0.60 and single-GPU self-host under Apache 2.0, Mistral undercuts both closed small models (Haiku, GPT-5 mini) and forces open competitors (Qwen, Llama) to answer on price-per-intelligence. The AA Index 28 exceeding the flagship's 23 is a clean talking point. The wedge is the combination — cheap + open + reasoning + vision + EU residency — which no single competitor matches on all axes. Market timing aligns with the 2026 push toward agentic, cost-controlled deployments.
“At $0.15/$0.60 with reasoning, vision, and 256K context, the value-per-dollar crushes anything closed at this capability — and self-host makes it nearly free at scale.”
This is the cost story of the lineup. $0.15/$0.60 with a ~50% batch discount delivers reasoning-capable multimodal at a price closed competitors can't match at the same capability. The deeper lever is Apache 2.0 self-host on a single GPU, which converts opex to capex for steady-state workloads with no license fee — unlike Medium 3.5. Annual forecasts become trivially predictable. For any high-volume chat or agent product chasing a unit-economics target, Small 4 is the obvious starting point and frequently the finish line.
“Same API as the rest of the family, a genuinely useful reasoning dial, real 256K context, and Apache 2.0 so I ship private fine-tunes without a second thought.”
Ergonomically Small 4 is identical to the rest of Mistral, so swapping with Medium 3.5 is a model-name change. The reasoning-effort dial is the standout: lean fast for simple tasks, crank it up for hard ones, no routing to a different model. 256K context is real. Apache 2.0 lets me ship private fine-tunes with confidence and the MLA attention keeps long-context serving affordable. Negatives: vision is "fine" not "great," and structured-output stability under heavy reasoning is still being shaken out. Best price-to-capability open-weight multimodal small model in the market.
“180 tps makes it feel snappier than Medium, and for everyday tasks I rarely notice it isn't a flagship.”
In Le Chat the small tier feels fast — ~180 tps is noticeably snappier than Medium. For summarising, drafting, simple coding, and multilingual help the quality is good enough that the gap to a flagship rarely shows. Vision works on screenshots and receipts well enough. With reasoning toggled on, responses take longer but become markedly more careful. Conversational warmth is below Claude or GPT-5 — efficient rather than friendly. Strong everyday utility at a price low enough that product teams can give it away in a free tier.
“The price and the Apache license are real wins — but 'matches GPT-OSS 120B on AIME' is a curated comparison, and the vision encoder is genuinely weak.”
Small 4 is the rare Mistral launch where the value claim mostly survives scrutiny: the price is real, the license is genuinely Apache 2.0, and AA Index 28 is independently measured. Where I push back is the framing. Mistral benchmarks against GPT-OSS 120B (a deliberately chosen open peer) rather than the strongest closed small models, and headlines AIME at high reasoning effort, which masks the latency and token-count cost of that mode. The vision encoder is small and the vision quality shows it. The honest claim is "best open price-to-capability multimodal," not "matches the frontier" — but for once the gap between marketing and reality is narrow.
The full research notes behind this review — verified against primary sources.
Small 4 is a sparse Mixture-of-Experts: 119B total parameters, 128 experts of which 4 activate per token for ~6.5B active. The Hugging Face card specifies an MLA (multi-head latent attention) backend (FLASH_ATTN_MLA in the vLLM serving command), which is part of what keeps the active footprint and KV-cache cost low at 256K context. It ships in FP8 with NVFP4/BF16/GGUF variants. Tokenizer is mistral_common. The sparse design is the whole point: it delivers capability associated with a much larger model at the inference cost of a ~7B dense model, which is what unlocks the price and the single-GPU self-host story. Layer count, training-token count, and vocab size are undisclosed.
Small 4 punches far above its size class. On knowledge and reasoning it scores MMLU-Pro 78.0% and GPQA Diamond 71.2% — close to Medium 3.1 and Large 3 (cap_reasoning 7.5, cap_math 7.5). Its configurable reasoning effort lets one SKU cover fast chat through AIME-class math (it matches or surpasses GPT-OSS 120B on AIME 2025 at high reasoning). Coding is decent (cap_coding 7.0) and on LiveCodeBench it reportedly beats GPT-OSS 120B while emitting ~20% less output. Native vision is present but the encoder is small, so vision quality is acceptable rather than excellent (cap_vision 6.5). The 256K context is rare at this tier (cap_long_context 8.0). Multilingual European quality carries through (cap_multilingual 8.5). High reasoning effort sharply increases latency and output tokens. No native real-time retrieval (cap_realtime_data 0.0).
| Benchmark | Score | vs Predecessor | vs Top Competitor | Source |
|---|---|---|---|---|
| MMLU-Pro | 78.0% | well above Small 3.2 | near Medium 3.1 / Large 3 | VentureBeat |
| GPQA Diamond | 71.2% | new | strong for the tier | HF card |
| AIME 2025 (high reasoning) | matches/surpasses GPT-OSS 120B | new | leader at price tier | VentureBeat |
| Artificial Analysis Index | 28 | +~13 vs Small 3.2 | well above price-tier median (~15) | Artificial Analysis |
Notably, Small 4's AA Index of 28 exceeds Large 3's 23 — the small MoE with reasoning effort scores higher on the aggregate intelligence index than the flagship generalist. Mistral published GPQA Diamond and MMLU-Pro but left some standard slots (MMLU, standardized LiveCodeBench number) unpublished; coverage is partial.
Output throughput is ~180 tokens/sec — well above the price-tier median and noticeably snappier than Medium or Large. The sparse 6.5B-active design is what enables it. Time-to-first-token is not separately published (null). Fast latency tier. With reasoning effort high, latency and output token count rise sharply, so the fast feel applies to the chat/low-effort path.
| Surface | Cost | Notes |
|---|---|---|
| API input | $0.15 / 1M tok | La Plateforme |
| API output | $0.60 / 1M tok | La Plateforme |
| Batch (in/out) | $0.075 / $0.30 | ~50% async discount |
| Direct UI | free | Le Chat free tier |
| Free tier | ~25 msg/day (Le Chat); La Plateforme quota | no card |
| Self-host | Apache 2.0 | weights on Hugging Face, single-GPU viable |
| Cloud | Bedrock, Azure AI Foundry, Vertex AI | managed |
Apache 2.0 weights on Hugging Face (FP8/NVFP4/BF16/GGUF) — a clean, unrestricted license, unlike Medium 3.5. The sparse architecture means it self-hosts on a single GPU (~80GB at FP8, less at NVFP4; viable on one A100/H100 or strong consumer pairs). Managed on Bedrock, Azure AI Foundry, and Vertex AI; La Plateforme EU-hosted by default. For EU SaaS shipping multilingual features on commodity hardware, this is the default open option — frontier-adjacent capability at single-GPU cost with no license friction.
Standard Mistral posture: GDPR-native, SOC 2 Type II, ISO 27001/27701, EU AI Act aligned, EU residency by default, 30-day abuse retention, no training on inputs unless opt-in, ZDR available. No built-in moderation; separate Mistral Moderation API. Moderate, consistent refusals.
SDKs in Python and TypeScript/JavaScript; integrations with LangChain, LlamaIndex, Vercel AI SDK, vLLM, and Ollama. Powers Le Chat and Mistral AI Studio. Apache 2.0 weights drive a fast-growing self-host and fine-tune community (FP8/NVFP4/BF16/GGUF derivatives). Popularity is growing quickly given the price-per-intelligence story.
Yes — genuine Apache 2.0 on the Hugging Face card, no revenue threshold (unlike Medium 3.5). Fine-tune, self-host, and redistribute freely.
Yes — sparse 6.5B-active means ~80GB at FP8 (one A100/H100), less at NVFP4, despite 119B total parameters.
Close on MMLU-Pro and reasoning at a fraction of the cost; Medium 3.1 has a more polished overall profile but no reasoning toggle and no self-host.
Not per token, but high reasoning effort produces far more output tokens and higher latency — budget for that on hard queries.
Acceptable for screenshots/receipts/simple charts; not Pixtral-class for complex documents.
EU by default on La Plateforme; or fully on your hardware via self-host.
Bedrock, Azure AI Foundry, and Vertex AI, plus self-host and La Plateforme.
Closed weights, similar everyday capability, ~2-3x the price, no self-host.
Closed weights, broader ecosystem, several times the price; no open-weight option.
Comparable MoE small tier and price; weaker EU-language quality.
Open weights but dense; weaker multilingual and a less clean small-MoE efficiency story.
Primary references used to verify this review.
Does not train on API inputs by default
Last verified 2026-05-27