Llama 3.1 405B vs Llama 4 Scout

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 3.1 405BGA
6.3
AI Panel
Meta
Llama 4 ScoutGA
7.5
AI Panel

Identity & lifecycle

ProviderMetaMeta
Family / tierLlama 3 · LargeLlama 4 · Scout
StatusGAGA
Released2024-07-222025-04-04
Knowledge cutoff2023-122024-08

Architecture & context

Context window128K10M
Max output tokens4K8K
Input modalitiestexttext, image
Reasoning modenonenone
Open weightsYesYes

Pricing (per Mtok)

Input$3$0.1
Output$3$0.34
Cached input
Batch input
Free tierNoNo

Speed

Output speed (tok/s)29106.1
Time to first token (s)0.70.56
Latency tierslowfast

Trust & deployment

Trains on inputsNoNo
LicenseLlama-3-CommunityLlama-4-Community
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonx
Compliance

AI Panel scoring

Unified score6.37.5
Decision Maker6.58.5
Domain Strategist67.5
Finance Lead59
Domain Practitioner6.57.5
Power User66.5
Skeptic65.5
Value score4.59.5

Benchmarks

MMLU88.679.6
MMLU-Pro73.374.3
GPQA Diamond51.157.2
MATH-50073.850.3
HumanEval8982
LiveCodeBench32.8
MMMU69.4
IFEval88.6
BBH81.3
LMArena Elo1267
Artificial Analysis Index1714

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.