Compare Frontier Models by Reasoning Effort & Use Case

OpenAI describes GPT-6.1 Sol as near-Astra in performance at lower cost: $2 / $10 per 1M input/output tokens against $10 / $50 for GPT-6 Astra, for prompts up to 272K tokens. On Arena Text, both rated at Max effort, Sol scores 1481 and Astra 1476, a gap too small to call. Artificial Analysis scores Astra 57 and Sol 55 on its Intelligence Index (Max). OpenAI publishes DeepSWE v1.1 (74.1%) and Terminal-Bench 4.0 (57.9%) for Astra, and no comparable scores for Sol. Reasoning tokens bill as output, so higher effort costs more; the break-even calculator shows how many more output tokens Sol can use before it costs as much as Astra.

GPQA Diamond (graduate science): Gemini 4 Argon 96.4% (Epoch AI), GPT-6 Astra 96.0% (reported by OpenAI), Claude Sonnet 5.5 95.6% (Epoch AI, max effort) and Gemini 3.8 Flash 95.4% (Epoch AI). The evaluators differ, so treat gaps under a point as ties. Coding and agents: OpenAI reports 57.9% on Terminal-Bench 4.0 for Astra; Anthropic reports 66.4% for Claude Opus 5.5 at xhigh effort. Artificial Analysis Intelligence Index v5.0.1: Opus 5.5 59, Astra 57 (Max), Sol 55 (Max), Argon 50 (High). Prices per 1M input/output: Astra $10 / $50, Opus 5.5 $4 / $20, Argon $2 / $10, Sonnet 5.5 $2 / $10, 3.8 Flash $0.75 / $3.75.

Anthropic suggests starting with Claude Opus 5.5 for most workloads; its API default effort is medium. Opus 5.5 leads Sonnet 5.5 on SWE-bench Pro (89.9% vs 81.3%, Anthropic system cards), ranks #1 on Arena WebDev (1810) and scores 1509 vs 1477 on Arena Text. On GPQA Diamond, run by Epoch AI at max effort, Sonnet 5.5 scores 95.6% against 90.6% for Opus 5.5, streams faster (155 vs 110 tok/s, Artificial Analysis) and costs half as much ($2 / $10 vs $4 / $20). Anthropic calls Claude Fable 5.1 ($10 / $50) its most capable generally available model, for demanding reasoning and long-horizon agentic work; on Terminal-Bench 4.0, Anthropic reports Opus 5.5 at 66.4% and Fable 5.1 at 55.8%.

On Epoch AI's GPQA Diamond, Gemini 3.8 Flash scores 95.4% against 96.4% for Gemini 4 Argon, and Google reports 73.7% against 77.9% on DeepSWE v1.1. 3.8 Flash streams at 117 tok/s against 74 (Artificial Analysis) and costs $0.75 / $3.75 against $2 / $10 per 1M. On Arena Text (High thinking), Argon scores 1520 and 3.8 Flash 1496 (preliminary). Scheduled changes: Gemini 4 Argon becomes $4 / $20 on Dec 1, 2026; Gemini 3.8 Flash becomes $1.5 / $7.5 on Jan 1, 2027.

On Arena Text, V4.1-Flash (Sep 10 version) scores 1476 ±6 and V4-Pro-0813 scores 1465 ±7, a gap inside the margin of error. V4-Pro scores higher on GPQA Diamond (92.4% vs 90.9%, DeepSeek). The only coding test both have is SWE-bench Verified from the April V4 preview cards, at Max: V4-Pro 80.6%, V4-Flash 79.0%. The Oct 17 V4.1-Flash update reports 77.0% on DeepSWE v1.1. Off-peak prices per 1M: V4.1-Flash $0.15 / $0.60, V4-Pro $0.66 / $1.98, so Flash costs 23% to 30% as much. DeepSeek says V4-Pro API service continues until V4.1-Pro launches.

1. Multi-File Agentic Coding, Terminal Tasks & WebDev UI

Anthropic reports Claude Opus 5.5 at 66.4% on Terminal-Bench 4.0 (xhigh), 57.8% on CursorBench 4.0 (max effort; 52.5% at its default effort) and 89.9% on SWE-bench Pro, and it ranks #1 on Arena WebDev (1810). OpenAI describes GPT-6.1 Sol as near-Astra at $2 / $10 per 1M. Google reports 77.9% on DeepSWE v1.1 for Gemini 4 Argon ($2 / $10). Among open weights, DeepSeek V4.1-Flash-1017 reports 77.0% on DeepSWE v1.1 at $0.15 / $0.60 off-peak.

2. Graduate-Level Science, Quantitative Research & Math (GPQA Diamond)

GPQA Diamond: Gemini 4 Argon 96.4% (Epoch AI), GPT-6 Astra 96.0% (reported by OpenAI), Claude Sonnet 5.5 95.6% (Epoch AI, max effort) and Gemini 3.8 Flash 95.4% (Epoch AI). Sonnet 5.5 outscores Opus 5.5 (90.6%) here. Among open weights, DeepSeek reports 92.4% for V4-Pro.

3. General Human-Preference Writing, Synthesis & Hard Prompts (Arena Text)

On Arena Text (Oct 27, 2026), four models you can use today score above 1500: Gemini 4 Argon (1520, High), Claude Opus 5.5 (1509), Muse Wonder (1507, Max) and Claude Fable 5.1 (1504). Google's gated Gemini 4 Carbon shows 1528 (preliminary). Gemini 3.8 Flash scores 1496 (preliminary) and DeepSeek V4.1-Flash 1476.

4. Occupational Knowledge Work, Financial Analysis & Long Documents (1M Context)

Anthropic reports Claude Opus 5.5 at 1846 on GDPval-AA v2.1 (44 occupations), against 1735 for Fable 5.1. GPT-6.1 Sol has a 1.05M-token context at $2 / $10 per 1M for prompts up to 272K tokens and $4 / $15 above. Muse Spark Open has a 1M context window and open weights.

5. High-Throughput Production Chat, Tool Calling & Sub-Second Loops

Artificial Analysis measures DeepSeek V4.1-Flash-1017 at 174 tok/s, Claude Sonnet 5.5 at 155, Muse Spark Open at 153 (varies by host), Gemini 3.8 Flash at 117 and Claude Opus 5.5 at 110. Lower effort means fewer reasoning tokens before the answer; Anthropic's effort guide describes lower effort as faster and cheaper for simpler tasks.

6. Open-Weights Self-Hosting, On-Prem Privacy & Custom Fine-Tuning

DeepSeek publishes V4.1-Flash and V4-Pro weights under the MIT license, with a 1M context and a setting to turn thinking on or off. Meta's Muse Spark Open (816B total, 42B active, 1M context, 89.0% GPQA Diamond) uses the Muse Model License with limited commercial terms; Muse Glimmer 30B is Apache 2.0.