Llama 3.1 8B vs Llama 4 Scout

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 3.1 8BGA
7.4
AI Panel
Meta
Llama 4 ScoutGA
7.5
AI Panel

Identity & lifecycle

ProviderMetaMeta
Family / tierLlama 3 · SmallLlama 4 · Scout
StatusGAGA
Released2024-07-222025-04-04
Knowledge cutoff2023-122024-08

Architecture & context

Context window128K10M
Max output tokens4K8K
Input modalitiestexttext, image
Reasoning modenonenone
Open weightsYesYes

Pricing (per Mtok)

Input$0.05$0.1
Output$0.08$0.34
Cached input
Batch input
Free tierYesNo

Speed

Output speed (tok/s)159.4106.1
Time to first token (s)0.30.56
Latency tierfastfast

Trust & deployment

Trains on inputsNoNo
LicenseLlama-3-CommunityLlama-4-Community
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonx
Compliance

AI Panel scoring

Unified score7.47.5
Decision Maker88.5
Domain Strategist7.57.5
Finance Lead9.59
Domain Practitioner8.57.5
Power User66.5
Skeptic6.55.5
Value score9.59.5

Benchmarks

MMLU69.479.6
MMLU-Pro48.374.3
GPQA Diamond30.457.2
MATH-50051.950.3
HumanEval72.682
LiveCodeBench32.8
MMMU69.4
IFEval80.4
BBH64.2
LMArena Elo1176
Artificial Analysis Index1214

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.