AI Agent Store/Model intelligenceBuild an AI worker ↗THE MODEL SELECTION SERIES
Writing a function and fixing a repository are different jobs. Our Coding assistant profile gives 45% weight to LiveBench agentic coding, 30% to coding tasks, 15% to reasoning and 10% to instruction following.
Snapshot · LiveBench question set: 25 June 2026 · View every source ↗
Coding measures contained code generation and completion. Agentic coding measures performance in a tool-using workflow across JavaScript, TypeScript and Python. A model that excels at the first may need a better harness or more attempts for the second.
Repository search, patch application, terminal access and the test loop change results. Use the same harness for every candidate, and record the model version and reasoning setting. Our tables preserve the source’s tested configuration.
Add the codebase context sent on each turn and all billed output across planning, edits and tests. Cached context can reduce costs, but cache policies differ. The calculator intentionally shows an uncached baseline so its assumptions are visible.
Run your own tests for framework knowledge, unfamiliar dependencies, migrations, security-sensitive code and multi-file changes. Benchmarks support a shortlist; your regression suite decides whether a change is acceptable.
YOUR WORKLOAD. YOUR PRIORITIES.
Standard text API estimate. Include reasoning tokens in output.
A scenario estimate, not a measured task bill. Excludes cache discounts, tool fees, retries and provider premiums. Workloads exceeding a catalog context limit receive no cost or Value rating. Advertised context is not a guarantee of retrieval quality.
Practical Value Our blend of Agent Fit and affordability: 70% capability + 30% cost percentile by default. Cost uses your token workload. A relative score within this 56-model snapshot, not a claim of dollars saved. · Coding assistant
70% Agent Fit + 30% affordability. Rankings use your workload; filters do not change the reference cohort.
THE EVIDENCE, SIDE BY SIDE
| Compare | Our task-weighted mix of LiveBench category scores. A useful shortlist signal, not a measured agent success rate. Change the task profile to change the weights. | Our blend of Agent Fit and affordability: 70% capability + 30% cost percentile by default. Cost uses your token workload. A relative score within this 56-model snapshot, not a claim of dollars saved. | Equal-weight average of LiveBench and Arena percentile ranks within the same nine matched configurations. Models without both results receive no score. This small cohort does not rank the whole market. | Automatically checked tasks in seven areas: reasoning, coding, agentic coding, mathematics, data analysis, language and instruction following. Overall is the equal-weight category mean. All rows use the 2026-06-25 question set. | People compare answers without knowing which model wrote them. A higher rating means more preferred answers, not a percent correct. Published ± ranges can overlap; small score gaps may not mean a real difference. | Estimated text API bill: requests × (input tokens × input price + output tokens × output price) ÷ 1,000,000. Include billed reasoning in output tokens. Excludes caching, tools, retries, taxes, hosting and long-context premiums. | The advertised token capacity for the prompt, conversation and response. This is a size limit, not proof the model can reliably use every detail. Catalog endpoints may have different limits. | Input / outputUSD / 1M tokens | |
|---|---|---|---|---|---|---|---|---|---|
01 Claude Opus 5.5 ↗Anthropic · max | 79.4 | 61.0 | — | 83.2 | — | $80 | 1.00M | $4 / $20Direct API | |
02 DeepSeek V4.1 Flash ↗DeepSeek · maxOpen weights | 78.8 | 83.5 | — | 81.1 | — | $2.14 | 1.05M | $0.094 / $0.6OpenRouter catalog | |
03 Claude Fable 5.1 ↗Anthropic · max | 76.7 | 54.3 | 87.52 sources | 83.4 | 1,498±8 | $200 | 1.00M | $10 / $50Direct API | |
04 Claude Fable 5 ↗Anthropic · source ID max; display xhighConfiguration discrepancy | 74.8 | 52.9 | — | 83.0 | — | $200 | 1.00M | $10 / $50Direct API | |
05 Muse Spark 1.3 ↗Meta · xhigh | 74.4 | 66.8 | — | 81.6 | — | $21 | 1.05M | $1.25 / $4.25OpenRouter catalog | |
06 Claude Opus 5 ↗Anthropic · max | 73.8 | 55.1 | 56.32 sources | 80.1 | 1,487±5 | $100 | 1.00M | $5 / $25Direct API | |
07 Kimi K3 ↗Moonshot AI · source defaultOpen weights | 73.1 | 57.7 | — | 79.2 | — | $60 | 1.05M | $3 / $15OpenRouter catalog | |
08 Qwen3.8 Max ↗Alibaba · source default · version mapping unconfirmed | 71.6 | — | — | 78.5 | — | — | Not verified | Not verified | |
09 GPT-5.6 Sol ↗OpenAI · source ID max; display xhighConfiguration discrepancy | 71.4 | 55.4 | — | 81.1 | — | $80 | 1.05M | $4 / $20Direct API | |
10 GPT-6 Astra ↗OpenAI · max | 71.4 | 50.5 | 53.12 sources | 82.2 | 1,480±12 | $200 | 1.05M | $10 / $50Direct API | |
11 Gemini 3.7 Flash ↗Google · high | 71.1 | 68.4 | 56.32 sources | 78.8 | 1,490±8 · preliminary | $15 | 1.05M | $0.75 / $3.75OpenRouter catalog | |
12 GLM-5.3 ↗Z.ai · source defaultOpen weights | 70.9 | 69.4 | — | 76.1 | — | $13.68 | 1.31M | $0.84 / $2.64OpenRouter catalog | |
13 Claude Sonnet 5 ↗Anthropic · xhigh | 70.6 | 59.9 | — | 76.0 | — | $40 | 1.00M | $2 / $10Direct API | |
14 Qwen3.8 Flash Next ↗Alibaba · source defaultOpen weights | 70.3 | — | — | 76.2 | — | — | Not verified | Not verified | |
15 Muse Spark 1.2 ↗Meta · xhigh | 70.1 | 63.8 | 68.82 sources | 78.0 | 1,500±11 | $21 | 1.05M | $1.25 / $4.25OpenRouter catalog | |
16 DeepSeek V4 Flash Vision Exp ↗DeepSeek · experimental · source defaultOpen weightsPreview | 69.7 | 75.9 | — | 76.8 | — | $3.52 | 1.05M | $0.22 / $0.66OpenRouter catalog | |
17 Muse Spark 1.1 ↗Meta · source ID xhigh; display highConfiguration discrepancy | 69.6 | 63.4 | — | 75.3 | — | $21 | 1.05M | $1.25 / $4.25OpenRouter catalog | |
18 Qwen3.8 27B ↗Alibaba · source defaultOpen weights | 69.6 | 71.9 | — | 75.3 | — | $10.2 | 1.00M | $0.42 / $3OpenRouter catalog | |
19 GPT-5.5 ↗OpenAI · xhigh | 69.5 | 50.3 | — | 80.2 | — | $110 | 1.05M | $5 / $30Direct API | |
20 Grok 4.6 ↗xAI · source default | 69.5 | 60.8 | — | 78.0 | — | $32 | 500K | $2 / $6OpenRouter catalog | |
21 GPT-6 Sol ↗OpenAI · max | 68.5 | 58.4 | — | 79.2 | — | $40 | 1.05M | $2 / $10Direct API | |
22 GPT-5.6 Terra ↗OpenAI · source ID max; display xhighConfiguration discrepancy | 68.3 | 57.1 | — | 77.9 | — | $44 | 1.05M | $2 / $12Direct API | |
23 Claude Opus 4.8 ↗Anthropic · max | 67.9 | 50.9 | — | 76.2 | — | $100 | 1.00M | $5 / $25Direct API | |
24 GPT-5.4 ↗OpenAI · xhigh | 67.7 | 54.8 | — | 78.0 | — | $55 | 1.05M | $2.5 / $15Direct API | |
25 Gemini 3.8 Flash ↗Google · high | 67.7 | 66.1 | 50.02 sources | 75.8 | 1,493±9 · preliminary | $15 | 1.05M | $0.75 / $3.75OpenRouter catalog | |
26 DeepSeek V4 Pro 0813 ↗DeepSeek · source defaultOpen weights | 67.5 | 69.9 | — | 77.4 | — | $10.56 | 1.05M | $0.66 / $1.98OpenRouter catalog | |
27 Grok 4.7 ↗xAI · xhigh | 67.4 | 60.2 | — | 77.4 | — | $25.6 | 500K | $1.6 / $4.8OpenRouter catalog | |
28 Claude Opus 4.7 ↗Anthropic · xhigh | 67.2 | 50.4 | — | 76.5 | — | $100 | 1.00M | $5 / $25Direct API | |
29 Grok 4.5 ↗xAI · source default | 66.2 | 58.5 | — | 75.8 | — | $32 | 500K | $2 / $6OpenRouter catalog | |
30 GLM-5.3 Flash ↗Z.ai · source defaultOpen weights | 66.2 | 74.0 | — | 71.6 | — | $2.5 | 1.31M | $0.15 / $0.5OpenRouter catalog | |
31 GPT-5.2 Codex ↗OpenAI · source default | 65.6 | 54.1 | — | 74.0 | — | $45.5 | 400K | $1.75 / $14OpenRouter catalog | |
32 GPT-5.6 Luna ↗OpenAI · source ID max; display xhighConfiguration discrepancy | 65.5 | 72.5 | — | 73.6 | — | $4.4 | 1.05M | $0.2 / $1.2Direct API | |
33 Gemini 3.5 Flash ↗Google · high | 65.4 | 57.1 | 12.52 sources | 74.6 | 1,478±4 | $33 | 1.05M | $1.5 / $9OpenRouter catalog | |
34 GLM-5.2 ↗Z.ai · source defaultOpen weights | 65.2 | 67.7 | — | 73.2 | — | $10.58 | 1.05M | $0.6496 / $2.04OpenRouter catalog | |
35 Claude Opus 4.6 ↗Anthropic · high · adaptive thinking | 65.1 | 49.0 | 56.32 sources | 74.5 | 1,505±4 | $100 | 1.00M | $5 / $25Direct API | |
36 GPT-6 Luna ↗OpenAI · max | 64.6 | 74.1 | — | 72.0 | — | $2 | 1.05M | $0.1 / $0.5Direct API | |
37 GPT-5.2 ↗OpenAI · high · 2025-12-11 | 64.1 | 53.1 | — | 74.6 | — | $45.5 | 400K | $1.75 / $14OpenRouter catalog | |
38 Gemini 3.1 Pro Preview ↗Google · highPreview | 63.3 | 53.7 | — | 77.0 | — | $44 | 1.05M | $2 / $12OpenRouter catalog | |
39 Gemini 3.6 Flash ↗Google · high | 63.2 | 62.9 | 9.42 sources | 73.6 | 1,480±5 | $15 | 1.05M | $0.75 / $3.75OpenRouter catalog | |
40 DeepSeek V4 Flash 0731 ↗DeepSeek · source defaultOpen weights | 63.1 | 73.6 | — | 74.2 | — | $1.68 | 1.31M | $0.04 / $0.64OpenRouter catalog | |
41 Kimi K2.6 ↗Moonshot AI · thinkingOpen weights | 63.0 | 60.8 | — | 70.5 | — | $17.5 | 262K | $0.95 / $4OpenRouter catalog | |
42 Inkling ↗Thinking Machines · xhighOpen weights | 62.3 | 59.5 | — | 71.9 | — | $18.1 | 1.05M | $1 / $4.05OpenRouter catalog | |
43 Claude Sonnet 4.6 ↗Anthropic · medium · adaptive thinking | 62.0 | 49.9 | — | 73.0 | — | $60 | 1.00M | $3 / $15Direct API | |
44 Qwen3.7 Max ↗Alibaba · source default | 61.8 | 56.8 | — | 73.1 | — | $23.6 | 1.00M | $1.48 / $4.43OpenRouter catalog | |
45 GPT-5.4 nano ↗OpenAI · xhigh | 61.2 | 68.9 | — | 69.6 | — | $4.5 | 400K | $0.2 / $1.25Direct API | |
46 Kimi K2.7 Code ↗Moonshot AI · source defaultOpen weights | 60.8 | 62.9 | — | 68.4 | — | $13.66 | 262K | $0.7062 / $3.3OpenRouter catalog | |
47 Claude Opus 4.5 ↗Anthropic · high · 64K thinking | 60.0 | 45.4 | — | 72.6 | — | $100 | 200K | $5 / $25Direct API | |
48 Qwen3.6 Plus ↗Alibaba · source default | 59.3 | 66.4 | — | 68.9 | — | $7.15 | 1.00M | $0.325 / $1.95OpenRouter catalog | |
49 Gemini 3.5 Flash-Lite ↗Google · high | 58.9 | 65.6 | — | 63.9 | — | $8 | 1.05M | $0.3 / $2.5OpenRouter catalog | |
50 DeepSeek V4 Pro ↗DeepSeek · source defaultOpen weights | 58.8 | 62.1 | — | 71.6 | — | $13.37 | 1.05M | $0.9553 / $1.91OpenRouter catalog | |
51 Nemotron 3 Ultra ↗NVIDIA · 550B A55B · source defaultOpen weights | 57.2 | 61.5 | — | 67.4 | — | $10.8 | 262K | $0.6 / $2.4OpenRouter catalog | |
52 GPT-5.4 mini ↗OpenAI · xhigh | 56.9 | 57.4 | — | 66.4 | — | $16.5 | 400K | $0.75 / $4.5Direct API | |
53 MiniMax M3 ↗MiniMax · source default | 55.7 | 64.4 | — | 67.3 | — | $5.4 | 1.05M | $0.3 / $1.2OpenRouter catalog | |
54 Qwen3.6 27B ↗Alibaba · source defaultOpen weights | 55.1 | 62.3 | — | 64.0 | — | $8.6 | 262K | $0.32 / $2.7OpenRouter catalog | |
55 DeepSeek V4 Flash ↗DeepSeek · source defaultOpen weights | 54.6 | 68.2 | — | 65.5 | — | $1.24 | 1.05M | $0.0886 / $0.1772OpenRouter catalog | |
56 Grok 4.3 ↗xAI · source default | 46.2 | 49.1 | — | 62.2 | — | $17.5 | 1.00M | $1.25 / $2.5OpenRouter catalog |
— means missing comparable evidence, never zero. Consensus covers only nine matched configurations. Model IDs, reasoning settings, source links and pricing differences are available on every model page. Open weights does not imply unrestricted commercial use.
LOOK BEYOND ONE NUMBER
| Measure | Claude Opus 5.5max | GPT-6 Solmax | DeepSeek V4.1 Flashmax |
|---|---|---|---|
| Agent FitOur task-weighted mix of LiveBench category scores. A useful shortlist signal, not a measured agent success rate. Change the task profile to change the weights. | 79.4 | 68.5 | 78.8 |
| Practical ValueOur blend of Agent Fit and affordability: 70% capability + 30% cost percentile by default. Cost uses your token workload. A relative score within this 56-model snapshot, not a claim of dollars saved. | 61.0 | 58.4 | 83.5 |
| Evidence ConsensusEqual-weight average of LiveBench and Arena percentile ranks within the same nine matched configurations. Models without both results receive no score. This small cohort does not rank the whole market. | Insufficient evidence | Insufficient evidence | Insufficient evidence |
| Workload costEstimated text API bill: requests × (input tokens × input price + output tokens × output price) ÷ 1,000,000. Include billed reasoning in output tokens. Excludes caching, tools, retries, taxes, hosting and long-context premiums. | $80 | $40 | $2.14 |
| Context windowThe advertised token capacity for the prompt, conversation and response. This is a size limit, not proof the model can reliably use every detail. Catalog endpoints may have different limits. | 1.00M | 1.05M | 1.05M |
| Tool callingThe catalog declares support for returning structured tool calls. Support does not measure whether the model picks the right tool or uses it correctly. | Supported | Supported | Supported |
| ReasoningCan it work through constraints and connect clues? LiveBench uses spatial, navigation, perspective-taking and logic-puzzle tasks. Useful for planning, but not a direct test of long-running agents. | 92.2 | 88.7 | 86.7 |
| CodingCan it write or complete code that passes tests? These are contained programming problems, not entire software projects. | 89.3 | 81.8 | 80.0 |
| Agentic codingCan it edit code in a tool-using workflow? LiveBench tests JavaScript, TypeScript and Python tasks. Results depend on the benchmark harness as well as the model. | 71.7 | 52.9 | 77.3 |
| MathematicsCan it solve difficult quantitative problems with checkable answers? Strong math is useful evidence of reasoning, but does not guarantee better writing or tool use. | 97.1 | 96.4 | 93.3 |
| Data analysisCan it join and reformat tables and reason about event sequences? Useful for agents that process structured business information. | 80.3 | 81.2 | 79.3 |
| LanguageCan it interpret word relationships, reconstruct plots and correct typos? This is a narrow language test, not a full measure of writing quality or multilingual coverage. | 86.3 | 85.3 | 81.2 |
| Instruction followingCan it follow requested constraints while rewriting, simplifying, summarizing and composing text? Relevant to agents that must return a specific format. | 65.7 | 68.6 | 70.0 |
| Input / output per 1M | $4 / $20 | $2 / $10 | $0.094 / $0.6 |