Llama 4 Scout vs Gemini 3.1 Pro

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 4 ScoutGA
7.5
AI Panel
Google
Gemini 3.1 Propreview
8.7
AI Panel

Identity & lifecycle

ProviderMetaGoogle
Family / tierLlama 4 · ScoutGemini 3 · Pro
StatusGApreview
Released2025-04-052026-02-19
Knowledge cutoff2024-082025-01

Architecture & context

Context window10M1.0M
Max output tokens8K66K
Input modalitiestext, imagetext, image, audio, video
Reasoning modenoneoptional
Open weightsYesNo

Pricing (per Mtok)

Input$0.1$2
Output$0.34$12
Cached input—$0.2
Batch input—$1
Free tierNoNo

Speed

Output speed (tok/s)106.1142.7
Time to first token (s)0.5630.78
Latency tierfastslow

Trust & deployment

Trains on inputsNoNo
LicenseLlama-4-CommunityProprietary
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxVertex AI, GCP
Compliance—SOC2, HIPAA, GDPR, ISO27001, FedRAMP, CCPA

AI Panel scoring

Unified score7.58.7
Decision Maker8.59
Domain Strategist7.59
Finance Lead98.5
Domain Practitioner7.58.5
Power User6.58.5
Skeptic5.57.5
Value score9.58.5

Benchmarks

MMLU79.692.6
MMLU-Pro74.3—
GPQA Diamond57.294.3
MATH-50050.3—
SWE-bench Verified—80.6
HumanEval82—
LiveCodeBench32.82887
MMMU69.480.5
TAU-bench—90.8
Terminal-Bench—68.5
MRCR Long Context—84.9
Humanity's Last Exam—44.4
LMArena Elo13211487
LMArena Coding Elo13621520

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.