Llama 4 Scout vs Claude Opus 4.8 vs GPT-5.5

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 4 ScoutGA
7.5
AI Panel
Anthropic
Claude Opus 4.8GA
9.2
AI Panel
OpenAI
GPT-5.5GA
8.7
AI Panel

Identity & lifecycle

ProviderMetaAnthropicOpenAI
Family / tierLlama 4 · ScoutClaude 4 · OpusGPT-5 · Pro
StatusGAGAGA
Released2025-04-052026-05-282026-04-24
Knowledge cutoff2024-082026-012025-12

Architecture & context

Context window10M1M1.1M
Max output tokens8K128K128K
Input modalitiestext, imagetext, imagetext, image
Reasoning modenonealwaysoptional
Open weightsYesNoNo

Pricing (per Mtok)

Input$0.1$5$5
Output$0.34$25$30
Cached input—$0.5$0.5
Batch input—$2.5$2.5
Free tierNoNoNo

Speed

Output speed (tok/s)106.16068.7
Time to first token (s)0.560.564
Latency tierfastmediumslow

Trust & deployment

Trains on inputsNoNoNo
LicenseLlama-4-CommunityProprietaryProprietary
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxBedrock, Vertex AI, Azure AI FoundryAzure OpenAI, Azure AI Foundry
Compliance—SOC2, HIPAA, GDPR, ISO27001SOC2, GDPR, CCPA, HIPAA

AI Panel scoring

Unified score7.59.28.7
Decision Maker8.599
Domain Strategist7.598.8
Finance Lead98.57
Domain Practitioner7.59.59.2
Power User6.599
Skeptic5.587.8
Value score9.586.5

Benchmarks

MMLU79.6——
MMLU-Pro74.3—92.4
GPQA Diamond57.293.693.6
MATH-50050.3——
SWE-bench Verified—88.688.7
HumanEval82——
LiveCodeBench32.8——
MMMU69.4—81.2
TAU-bench——98
Terminal-Bench—74.682.7
MRCR Long Context——74
Humanity's Last Exam——41.4
LMArena Elo132114811482
LMArena Coding Elo136215331520

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.