Llama 4 Scout vs Gemini 3.1 Pro vs Claude Opus 4.8 vs GPT-5.5

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 4 ScoutGA
7.5
AI Panel
Google
Gemini 3.1 Propreview
8.7
AI Panel
Anthropic
Claude Opus 4.8GA
9.2
AI Panel
OpenAI
GPT-5.5GA
8.7
AI Panel

Identity & lifecycle

ProviderMetaGoogleAnthropicOpenAI
Family / tierLlama 4 · ScoutGemini 3 · ProClaude 4 · OpusGPT-5 · Pro
StatusGApreviewGAGA
Released2025-04-052026-02-192026-05-282026-04-24
Knowledge cutoff2024-082025-012026-012025-12

Architecture & context

Context window10M1.0M1M1.1M
Max output tokens8K66K128K128K
Input modalitiestext, imagetext, image, audio, videotext, imagetext, image
Reasoning modenoneoptionalalwaysoptional
Open weightsYesNoNoNo

Pricing (per Mtok)

Input$0.1$2$5$5
Output$0.34$12$25$30
Cached input—$0.2$0.5$0.5
Batch input—$1$2.5$2.5
Free tierNoNoNoNo

Speed

Output speed (tok/s)106.1142.76068.7
Time to first token (s)0.5630.780.564
Latency tierfastslowmediumslow

Trust & deployment

Trains on inputsNoNoNoNo
LicenseLlama-4-CommunityProprietaryProprietaryProprietary
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxVertex AI, GCPBedrock, Vertex AI, Azure AI FoundryAzure OpenAI, Azure AI Foundry
Compliance—SOC2, HIPAA, GDPR, ISO27001, FedRAMP, CCPASOC2, HIPAA, GDPR, ISO27001SOC2, GDPR, CCPA, HIPAA

AI Panel scoring

Unified score7.58.79.28.7
Decision Maker8.5999
Domain Strategist7.5998.8
Finance Lead98.58.57
Domain Practitioner7.58.59.59.2
Power User6.58.599
Skeptic5.57.587.8
Value score9.58.586.5

Benchmarks

MMLU79.692.6——
MMLU-Pro74.3——92.4
GPQA Diamond57.294.393.693.6
MATH-50050.3———
SWE-bench Verified—80.688.688.7
HumanEval82———
LiveCodeBench32.82887——
MMMU69.480.5—81.2
TAU-bench—90.8—98
Terminal-Bench—68.574.682.7
MRCR Long Context—84.9—74
Humanity's Last Exam—44.4—41.4
LMArena Elo1321148714811482
LMArena Coding Elo1362152015331520

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.