Llama 4 Scout vs Gemini 3.1 Pro vs Claude Opus 4.8

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 4 ScoutGA
7.5
AI Panel
Google
Gemini 3.1 Propreview
8.7
AI Panel
Anthropic
Claude Opus 4.8GA
9.2
AI Panel

Identity & lifecycle

ProviderMetaGoogleAnthropic
Family / tierLlama 4 · ScoutGemini 3 · ProClaude 4 · Opus
StatusGApreviewGA
Released2025-04-052026-02-192026-05-28
Knowledge cutoff2024-082025-012026-01

Architecture & context

Context window10M1.0M1M
Max output tokens8K66K128K
Input modalitiestext, imagetext, image, audio, videotext, image
Reasoning modenoneoptionalalways
Open weightsYesNoNo

Pricing (per Mtok)

Input$0.1$2$5
Output$0.34$12$25
Cached input—$0.2$0.5
Batch input—$1$2.5
Free tierNoNoNo

Speed

Output speed (tok/s)106.1142.760
Time to first token (s)0.5630.780.5
Latency tierfastslowmedium

Trust & deployment

Trains on inputsNoNoNo
LicenseLlama-4-CommunityProprietaryProprietary
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxVertex AI, GCPBedrock, Vertex AI, Azure AI Foundry
Compliance—SOC2, HIPAA, GDPR, ISO27001, FedRAMP, CCPASOC2, HIPAA, GDPR, ISO27001

AI Panel scoring

Unified score7.58.79.2
Decision Maker8.599
Domain Strategist7.599
Finance Lead98.58.5
Domain Practitioner7.58.59.5
Power User6.58.59
Skeptic5.57.58
Value score9.58.58

Benchmarks

MMLU79.692.6—
MMLU-Pro74.3——
GPQA Diamond57.294.393.6
MATH-50050.3——
SWE-bench Verified—80.688.6
HumanEval82——
LiveCodeBench32.82887—
MMMU69.480.5—
TAU-bench—90.8—
Terminal-Bench—68.574.6
MRCR Long Context—84.9—
Humanity's Last Exam—44.4—
LMArena Elo132114871481
LMArena Coding Elo136215201533

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.