by Mistral AI · Ministral 3 family · best for fast multilingual edge model with vision
Ministral 3 8B (release 25.12, shipped 2 December 2025) is Mistral's mid-edge model: a 9B-total dense transformer (8.4B language model + 0.4B vision encoder) under Apache 2.0, with 256K context and native vision. The reasoning variant posts AIME 2025 78.7%, GPQA Diamond 66.8%, MATH 87.6%, LiveCodeBench 61.6%, and MMLU 76.1% — strong for the tier. Symmetric pricing at $0.15/$0.15. The buyer's sentence: the right default for fast, multilingual, vision-capable edge work on consumer GPUs or laptops, with a clean license.
| Benchmark | Score | Source |
|---|---|---|
| MMLU | 76.1% | huggingface.co 2025-12-02T00:00:00.000Z |
| MATH-500 | 87.6% | huggingface.co 2025-12-02T00:00:00.000Z |
| AIME 2025 | 78.7% | huggingface.co 2025-12-02T00:00:00.000Z |
| GPQA Diamond | 66.8% | huggingface.co 2025-12-02T00:00:00.000Z |
| LiveCodeBench | 61.6% | huggingface.co 2025-12-02T00:00:00.000Z |
Six personas, six verdicts — the same panel that reviews every product on TopReviewed.
“When the constraint is 'must run on a laptop or small server,' this is the default — native vision, real reasoning, and clean Apache 2.0 in one 8B.”
For any feature constrained to a laptop or small server, Ministral 3 8B is now the default. The combination of native vision, real reasoning (AIME 78.7%), EU-language quality, and a clean Apache 2.0 license is unusual at this size. I would route premium queries to Medium 3.5 or Small 4 and let the 8B handle the long tail of simpler tasks and on-device features. For embedded EU deployments where data must stay on the customer's hardware, this is the model — full on-prem control, no license fee, modest hardware.
“Native vision plus real reasoning at 8B, fully open — it strengthens Mistral's edge-tier story against Llama and Qwen on the axes EU buyers care about.”
Strategically the 8B reinforces Mistral's edge-tier position. Native vision and credible reasoning at 8B, under clean Apache 2.0, beat Llama 4 8B and Qwen 3 8B on the EU-relevant axes (multilingual quality, vision, license clarity). It is the bridge between the on-device 3B and the more capable 14B, giving product teams a clean ladder. The differentiation is the bundle at the size, not a single benchmark. Market timing aligns with edge/on-device demand and the EU AI Act compliance tailwind; the open license maximises adoption.
“$0.15/$0.15 makes monthly forecasting boring in the best way, and self-host on a consumer GPU caps cost at infrastructure for very high volume.”
Symmetric $0.15/$0.15 pricing makes monthly forecasting trivial — request count is the only variable. Self-host under clean Apache 2.0 on a consumer GPU caps cost at infrastructure for very high volume, with no license fee (unlike Medium 3.5 or the 125B Devstral). For any cost-sensitive workload that doesn't demand flagship quality, this is the right starting point, and the reasoning variant avoids escalating to a pricier model for many queries. Strong unit economics for the embedded-AI and high-volume-chat use cases.
“Fast and 'fine' for routine tasks; the reasoning variant gives me a careful answer without paying for a bigger model, and it runs locally.”
The instruct variant is fast and reliable for routine tasks — summarisation, extraction, classification, simple agent steps. The reasoning variant is useful when I want a careful answer without a bigger model. Vision is usable for screenshot triage. Same API shape as the rest of Mistral, so swapping is trivial, and clean Apache 2.0 makes fine-tuning straightforward. Runs locally via vLLM/Ollama/llama.cpp/LM Studio at a 16GB footprint. Not a model for hard problems, but a strong default for the easy 80% with a reasoning escape hatch.
“Snappy and capable for routine tasks, occasionally rough on nuance — and EU-language quality feels native, not translated.”
Snappy and capable for routine tasks, occasionally rough on nuanced queries. Vision works on simple things. The standout is European-language quality, which feels native rather than translated. Refusal rate is moderate. With reasoning toggled on it takes longer but is noticeably more careful. Conversational warmth is mid — efficient rather than friendly. A solid "free tier" model behind consumer features, especially when on-device delivery gives instant, private responses.
“Honest published numbers and a clean license — the only thing to flag is that 8B reasoning headlines come from the reasoning variant at full effort.”
Like the 14B, this is an honest small-model launch with real published benchmarks across variants, so there's little to debunk. The fair caveats: the AIME 78.7% headline is the reasoning variant at full effort (latency/token cost), the instruct variant most apps use is less spectacular, and an 8B's ceiling on hard, broad tasks is real — it won't stand in for the 14B or Small 4 where capability matters. Vision is genuinely soft at this size. The honest claim — "fast multilingual edge model with vision and a reasoning option" — holds; just pick the right variant and don't over-extend it.
The full research notes behind this review — verified against primary sources.
Ministral 3 8B is a 9B-total dense transformer: an 8.4B language model plus a 0.4B vision encoder (per the HF card). Not a MoE. Context is 256K. Three variants — base, instruct, reasoning — all Apache 2.0. Available in FP8/BF16/GGUF/AWQ; runs on a single 16GB GPU quantised (consumer cards, beefier laptops). Tokenizer is mistral_common. Layer count, attention type, and training scale are undisclosed.
Ministral 3 8B targets edge and resource-constrained deployment: laptops, single-GPU servers, on-prem appliances. The reasoning variant is genuinely strong for the size: AIME 2025 78.7%, MATH 87.6%, GPQA Diamond 66.8% (cap_math 8.0, cap_reasoning 7.5). MMLU 76.1% and Multilingual MMLU 70.6% show solid knowledge and European-language strength (cap_multilingual 7.5). LiveCodeBench 61.6% is decent coding for 8B (cap_coding 6.0). Native vision via the 0.4B encoder handles screenshot, document, and chart understanding on commodity hardware, though quality is "useful" rather than polished at this size (cap_vision 5.5). The 256K context is rare at 8B (cap_long_context 8.0). Apache 2.0 means unfettered commercial fine-tuning. The right model for "good enough" cases where the constraint is latency, hardware, or cost rather than ceiling capability. No native real-time retrieval (cap_realtime_data 0.0).
| Benchmark | Score | vs Predecessor | vs Top Competitor | Source |
|---|---|---|---|---|
| AIME 2025 (reasoning) | 78.7% | new | strong for 8B | HF card |
| AIME 2024 (reasoning) | 86.0% | new | strong for size | HF card |
| GPQA Diamond | 66.8% | new | strong for 8B | HF card |
| MATH (Maj@1) | 87.6% | new | top of class | HF card |
| LiveCodeBench | 61.6% | new | decent for 8B | HF card |
| MMLU (5-shot) | 76.1% | up | strong for 8B | HF card |
The HF card publishes real reasoning, instruct, and base suites, so coverage is strong for the tier. Reasoning-variant scores are recorded with the variant noted.
Mistral does not publish official tps/TTFT (null), but a 9B dense model is fast — solidly in the fast latency tier for the instruct variant, and the smallest viable footprint here (16GB quantised) makes it well-suited to interactive on-device use. The reasoning variant trades speed for accuracy. On a consumer GPU or laptop the instruct variant gives near-instant responses, which is much of the point.
| Surface | Cost | Notes |
|---|---|---|
| API input | $0.15 / 1M tok | La Plateforme |
| API output | $0.15 / 1M tok | symmetric pricing |
| Cached input | $0.015 / 1M tok | cache read |
| Batch (in/out) | $0.075 / $0.075 | ~50% async discount |
| Self-host | Apache 2.0 | weights on Hugging Face, consumer GPU / laptop |
| Free tier | La Plateforme quota; self-host | no card for self-host |
| Cloud | Bedrock, Azure AI Foundry | managed |
Apache 2.0 weights on Hugging Face (FP8/BF16/GGUF/AWQ) — clean license, no carve-out. Runs on a single 16GB GPU quantised, including consumer cards and beefier laptops via llama.cpp/Ollama/LM Studio. Three variants (base/instruct/reasoning). Managed on Bedrock and Azure AI Foundry; La Plateforme EU-hosted by default. The right choice for embedded EU deployments where data must stay on the customer's hardware and the device is modest.
Standard Mistral posture: GDPR-native, SOC 2 Type II, ISO 27001/27701, EU AI Act aligned, EU residency by default (and full on-prem control via self-host), 30-day abuse retention on API, no training on inputs unless opt-in, ZDR available. No built-in moderation; separate Mistral Moderation API. Moderate refusal calibration.
SDKs in Python and TypeScript/JavaScript; runs via vLLM, Ollama, llama.cpp, and LM Studio, with LangChain integration. Available through La Plateforme, Bedrock, and Azure AI Foundry. Apache 2.0 weights drive a growing edge/on-device community across the three variants. Popularity is growing, strongest in mobile/embedded and branch-office EU deployments.
Yes — genuine Apache 2.0, no revenue carve-out. Fine-tune and self-host freely.
256K (Mistral 3 family standard) — corrects an earlier 131K figure.
Instruct for routine tasks, reasoning for careful multi-step/math answers, base for fine-tuning. Most apps want instruct.
A single 16GB GPU quantised — consumer cards and beefier laptops work.
Yes — a 0.4B encoder, useful for screenshot triage and light OCR, not polished for complex documents.
Cheaper and faster, lower reasoning ceiling; step up to the 14B when hard math/reasoning matters.
EU by default on La Plateforme, or fully on your device via self-host.
Comparable size; weaker EU multilingual and weaker/absent native vision.
Comparable size; stronger Chinese, weaker EU-language quality.
Bigger sibling — meaningfully stronger reasoning, same family API, ~1.3x the price.
Comparable tier; no native vision, weaker multilingual.
Primary references used to verify this review.
Does not train on API inputs by default
Last verified 2026-05-27