Llama 3.1 405B vs Llama 4 Scout

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 3.1 405BGA
6.3
AI Panel
Meta
Llama 4 ScoutGA
7.5
AI Panel

Identity & lifecycle

ProviderMetaMeta
Family / tierLlama 3 · LargeLlama 4 · Scout
StatusGAGA
Released2024-07-232025-04-05
Knowledge cutoff2023-122024-08

Architecture & context

Context window128K10M
Max output tokens4K8K
Input modalitiestexttext, image
Reasoning modenonenone
Open weightsYesYes

Pricing (per Mtok)

Input$3$0.1
Output$3$0.34
Cached input——
Batch input——
Free tierNoNo

Speed

Output speed (tok/s)29106.1
Time to first token (s)0.70.56
Latency tierslowfast

Trust & deployment

Trains on inputsNoNo
LicenseLlama-3-CommunityLlama-4-Community
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonx
Compliance——

AI Panel scoring

Unified score6.37.5
Decision Maker6.58.5
Domain Strategist67.5
Finance Lead59
Domain Practitioner6.57.5
Power User66.5
Skeptic65.5
Value score4.59.5

Benchmarks

MMLU88.679.6
MMLU-Pro73.374.3
GPQA Diamond51.157.2
MATH-50073.850.3
HumanEval8982
LiveCodeBench—32.8
MMMU—69.4
IFEval88.6—
BBH81.3—
LMArena Elo13351321
LMArena Coding Elo13761362

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.