Llama 4 Scout vs Gemini 3.1 Pro vs GPT-5.5

Best cell per row highlighted. Null means undisclosed — never counted as zero.

Meta
Llama 4 ScoutGA
7.5
AI Panel
Google
Gemini 3.1 Propreview
8.7
AI Panel
OpenAI
GPT-5.5GA
8.7
AI Panel

Identity & lifecycle

ProviderMetaGoogleOpenAI
Family / tierLlama 4 · ScoutGemini 3 · ProGPT-5 · Pro
StatusGApreviewGA
Released2025-04-052026-02-192026-04-24
Knowledge cutoff2024-082025-012025-12

Architecture & context

Context window10M1.0M1.1M
Max output tokens8K66K128K
Input modalitiestext, imagetext, image, audio, videotext, image
Reasoning modenoneoptionaloptional
Open weightsYesNoNo

Pricing (per Mtok)

Input$0.1$2$5
Output$0.34$12$30
Cached input—$0.2$0.5
Batch input—$1$2.5
Free tierNoNoNo

Speed

Output speed (tok/s)106.1142.768.7
Time to first token (s)0.5630.7864
Latency tierfastslowslow

Trust & deployment

Trains on inputsNoNoNo
LicenseLlama-4-CommunityProprietaryProprietary
CloudsBedrock, Vertex AI, Azure AI Foundry, GCP, OCI, IBM watsonxVertex AI, GCPAzure OpenAI, Azure AI Foundry
Compliance—SOC2, HIPAA, GDPR, ISO27001, FedRAMP, CCPASOC2, GDPR, CCPA, HIPAA

AI Panel scoring

Unified score7.58.78.7
Decision Maker8.599
Domain Strategist7.598.8
Finance Lead98.57
Domain Practitioner7.58.59.2
Power User6.58.59
Skeptic5.57.57.8
Value score9.58.56.5

Benchmarks

MMLU79.692.6—
MMLU-Pro74.3—92.4
GPQA Diamond57.294.393.6
MATH-50050.3——
SWE-bench Verified—80.688.7
HumanEval82——
LiveCodeBench32.82887—
MMMU69.480.581.2
TAU-bench—90.898
Terminal-Bench—68.582.7
MRCR Long Context—84.974
Humanity's Last Exam—44.441.4
LMArena Elo132114871482
LMArena Coding Elo136215201520

Scores link to their sources. Missing cells mean the vendor hasn't disclosed a result — honesty over padding.