Skip to model comparison
AI Agent Store/Model comparisonsBuild an AI worker ↗

THE MODEL SELECTION SERIES

Open-weight model comparison

Open weights are downloadable files containing a trained model, available under its license. That can create more deployment options, but it does not automatically make a model free to run, fully open source or unrestricted for commercial use.

Data reviewed · LiveBench question set: 25 June 2026 · View every source ↗ · Download the data ↓

01 / WHAT TO CHECK

Choose where the model will run

You can download model files to your own hardware or pay a service to run them. The prices below cover hosted services. Running a model yourself adds hardware, electricity and maintenance costs. Compressed files use less memory, but can change answer quality.

02 / WHAT TO CHECK

Check the license and exact download

Before using a model in a business, read its license. Some downloads are for research only; others restrict commercial hosting. Record the exact version and file, since a smaller compressed download may behave differently from the original.

03 / WHAT TO CHECK

Test tools with your own setup

A model may be able to request a tool, such as a search, while your local software still needs to connect and run it. Check that answers follow your required format, tool calls work and errors are handled. Use the same software and request sizes you plan to use in practice.

04 / WHAT TO CHECK

Compare the total running cost

If you run a model yourself, include hardware, electricity and time spent maintaining it, even when it sits idle. Measure how many useful tasks your computer completes in a typical day. Compare that total cost with paying a hosted service for the same work.

Will the download work on your computer?

Check three things before downloading: free disk space, memory while the model is running, and software that supports the exact file. A “24GB model” can need much more than 24GB on disk.

Example: Gyro-Coder

The publisher lists a 70.6 GiB download, 19.92 GiB of GPU weights and about 21.1 GiB while running its 64K-context example. A large lookup table stays on a fast drive instead of the graphics card.

That example targets a 24GB graphics card. Longer requests and different settings can need more memory. Standard llama.cpp cannot load the file; use the compatible publisher build.

Check the files, setup and license ↗

A small download may need a larger base model

Flora TempSeg is an add-on, called an adapter. It also needs the specified Qwen3.5-9B model. The adapter’s file size alone therefore understates what you need to download and run.

It labels action boundaries in videos for non-commercial robotics research. Check the intended task and license as well as the memory requirement.

Check the required base and research limits ↗

These are publisher specifications, not our hardware measurements. Try your longest expected request and the number of requests you need to run at once before choosing hardware.

The comparison starts with open-weight models. Prices represent hosted API endpoints; check the model license before self-hosting.

YOUR WORKLOAD. YOUR PRIORITIES.

Compare models for your workload

How our ratings work ↗

Estimate your monthly API cost

Tokens are the small pieces of text a model reads or produces. Include charged thinking tokens in output.

This estimate uses your token counts and standard text API rates. It excludes cache discounts, tool fees, retries and provider premiums. If your input and output exceed a model’s listed capacity, we leave its cost and Value rating blank. A large capacity does not guarantee that it will use every detail correctly.

THE MARKET MAP

Quality and cost

Sweet-spot zoneStrong price–quality tradeoffsTap a dot to inspect
SWEET SPOTCAPABILITY FIRST020406080100$0.1$1$10$100Agent Fit / 100 ↑← Lower cost · USD · log scale321SWEET SPOT020406080100$0.1$1$10$100Agent Fit / 100 ↑← Lower cost · USD · log scale321
78.9Agent Fit$1.45your workload
YOUR FAST SHORTLIST

Closest to the sweet spot

How we choose ↗
  1. 1
    DeepSeek V4.1 Flash ↗78.9 Agent Fit · $1.45
  2. 2
    DeepSeek V4 Flash 0731 ↗71.1 Agent Fit · $1.15
  3. 3
    GLM-5.3 Flash ↗67.2 Agent Fit · $0.4682

Shaded zone: 73.4+ points and $10.13 or less. Numbers mark models with strong price–quality tradeoffs in or near this zone. On the dotted line, no other shown model is cheaper with an equal or higher score, or scores higher at the same price. Your chosen measure, usage and filters change this shortlist.

THE EVIDENCE, SIDE BY SIDE

AI model comparison table

19 of 62 models · select up to 4 to comparePrices in USD · tap ? for instant explanations
01
Agent Fit 78.9
Value 83.2
Your cost $1.45
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
81.1
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.045 / $0.5
Price observation
OpenRouter catalog
02
Kimi K3 ↗

Moonshot AI · source default

Agent Fit 77.4
Value 65.4
Your cost $33.92
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
79.2
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.192 / $16
Price observation
OpenRouter catalog
03
Qwen3.8 Flash Next ↗

Alibaba · source default

Agent Fit 76.2
Value —
Your cost —
Not verified contextOpen weights
Benchmarks & API pricing +
LiveBench
76.2
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
Not verified
Price observation
Not verified
04
DeepSeek V4 Flash Vision Exp ↗

DeepSeek · experimental · source default

Agent Fit 75.1
Value 79.0
Your cost $3.45
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
76.8
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.2156 / $0.6468
Price observation
OpenRouter catalog
05
GLM-5.3 ↗

Z.ai · source default

Agent Fit 73.7
Value 77.5
Your cost $3.5
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
76.1
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.0699 / $1.4
Price observation
OpenRouter catalog
06
Qwen3.8 27B ↗

Alibaba · source default

Agent Fit 73.5
Value 75.9
Your cost $5.25
1.02M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
75.3
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.15 / $1.88
Price observation
OpenRouter catalog
07
DeepSeek V4 Pro 0813 ↗

DeepSeek · source default

Agent Fit 73.3
Value 73.2
Your cost $10.35
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
77.4
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.115 / $4.6
Price observation
OpenRouter catalog
08
Mistral Large 4 ↗

Mistral · high

Agent Fit 72.0
Value 71.3
Your cost $11.2
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
71.8
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.7 / $2.1
Price observation
OpenRouter catalog
09
DeepSeek V4 Flash 0731 ↗

DeepSeek · source default

Agent Fit 71.1
Value 78.8
Your cost $1.15
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
74.2
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.0553 / $0.3
Price observation
OpenRouter catalog
10
Inkling ↗

Thinking Machines · xhigh

Agent Fit 68.9
Value 64.5
Your cost $18.1
524K contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
71.9
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$1 / $4.05
Price observation
OpenRouter catalog
11
GLM-5.2 ↗

Z.ai · source default

Agent Fit 68.5
Value 67.3
Your cost $13.66
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
73.2
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.006 / $6.8
Price observation
OpenRouter catalog
12
GLM-5.3 Flash ↗

Z.ai · source default

Agent Fit 67.2
Value 77.0
Your cost $0.4682
1.05M contextOpen weightsTool calling
Benchmarks & API pricing +
LiveBench
71.6
Evidence Consensus
Not enough evidence
Input / output per 1M tokens
$0.0269 / $0.0996
Price observation
OpenRouter catalog
AI model benchmarks, aggregate ratings, API pricing and context windows. Snapshot 2026-11-04.
CompareInput / outputUSD / 1M tokens
01
DeepSeek V4.1 Flash ↗DeepSeek · maxOpen weights
78.983.2—81.1—$1.451.05M$0.045 / $0.5OpenRouter catalog
02
Kimi K3 ↗Moonshot AI · source defaultOpen weights
77.465.4—79.2—$33.921.05M$0.192 / $16OpenRouter catalog
03
Qwen3.8 Flash Next ↗Alibaba · source defaultOpen weights
76.2——76.2——Not verifiedNot verified
04
DeepSeek V4 Flash Vision Exp ↗DeepSeek · experimental · source defaultOpen weightsPreview
75.179.0—76.8—$3.451.05M$0.2156 / $0.6468OpenRouter catalog
05
GLM-5.3 ↗Z.ai · source defaultOpen weights
73.777.5—76.1—$3.51.05M$0.0699 / $1.4OpenRouter catalog
06
Qwen3.8 27B ↗Alibaba · source defaultOpen weights
73.575.9—75.3—$5.251.02M$0.15 / $1.88OpenRouter catalog
07
DeepSeek V4 Pro 0813 ↗DeepSeek · source defaultOpen weights
73.373.2—77.4—$10.351.05M$0.115 / $4.6OpenRouter catalog
08
Mistral Large 4 ↗Mistral · highOpen weightsPreview
72.071.3—71.8—$11.21.05M$0.7 / $2.1OpenRouter catalog
09
DeepSeek V4 Flash 0731 ↗DeepSeek · source defaultOpen weights
71.178.8—74.2—$1.151.05M$0.0553 / $0.3OpenRouter catalog
10
Inkling ↗Thinking Machines · xhighOpen weights
68.964.5—71.9—$18.1524K$1 / $4.05OpenRouter catalog
11
GLM-5.2 ↗Z.ai · source defaultOpen weights
68.567.3—73.2—$13.661.05M$0.006 / $6.8OpenRouter catalog
12
GLM-5.3 Flash ↗Z.ai · source defaultOpen weights
67.277.0—71.6—$0.46821.05M$0.0269 / $0.0996OpenRouter catalog
13
DeepSeek V4 Pro ↗DeepSeek · source defaultOpen weights
67.161.2—71.6—$22.41.05M$1.6 / $3.2OpenRouter catalog
14
Kimi K2.6 ↗Moonshot AI · thinkingOpen weights
66.966.7—70.5—$13.32262K$0.65 / $3.41OpenRouter catalog
15
Kimi K2.7 Code ↗Moonshot AI · source defaultOpen weights
64.865.7—68.4—$13262K$0.6 / $3.5OpenRouter catalog
16
Nemotron 3 Ultra ↗NVIDIA · 550B A55B · source defaultOpen weights
63.866.0—67.4—$10.8262K$0.6 / $2.4OpenRouter catalog
17
DeepSeek V4 Flash ↗DeepSeek · source defaultOpen weights
61.671.6—65.5—$1.271.05M$0.091 / $0.182OpenRouter catalog
18
Qwen3.6 27B ↗Alibaba · source defaultOpen weights
60.064.4—64.0—$9.9262K$0.45 / $2.7OpenRouter catalog
19
Nemotron 3.5 Lightning ↗NVIDIA · source default · thinking budget unspecifiedOpen weights
41.658.6—44.5—$1.1262K$0.07 / $0.2OpenRouter catalog

— means a comparable result is unavailable. Consensus combines results for only 10 matched configurations. Model IDs, reasoning settings, source links and pricing differences are available on every model page. Downloadable model files can still have restrictions on commercial use.

LOOK BEYOND ONE NUMBER

Compare your shortlist

Change models ↑
ReasoningCodingAgentic codeMathematicsDataLanguageInstructions
Claude Opus 5.5GPT-6 SolDeepSeek V4.1 Flash
Selected AI models compared, with scores from the same LiveBench question set
MeasureClaude Opus 5.5maxGPT-6 SolmaxDeepSeek V4.1 Flashmax
Agent Fit79.474.778.9
Practical Value60.762.283.2
Evidence ConsensusInsufficient evidenceInsufficient evidenceInsufficient evidence
Workload cost$80$40$1.45
Context window1.00M1.05M1.05M
Tool callingSupportedSupportedSupported
Reasoning92.288.786.7
Coding89.381.880.0
Agentic coding71.752.977.3
Mathematics97.196.493.3
Data analysis80.381.279.3
Language86.385.381.2
Instruction following65.768.670.0
Input / output per 1M$4 / $20$2 / $10$0.045 / $0.5
AI Agent Store · Model comparisons · Data reviewed 2026-11-04Sources, limitations & corrections ↗