Low
Tested setting0.0 pts vs Low
$0.6101 / source task
111 s median duration
Compare Low vs Medium vs High vs Extra high vs Max where tested. Find the effort setting that fits your task, and see how much extra reasoning changes the result.
Published blended DataBench score, on a 0–100 scale. Judge-based analytical task performance; not a general intelligence or guaranteed success rate.
Analytics in the Hex agent harness · Leaderboard updated: 2026-09-22 · Reviewed 2026-10-15Check the source ↗Lowest measured cost within 1.0 points of the best tested analytics score.
70.5 / 100 · $3.57 / source taskSet 0 for the highest score. Increase the gap to explore cheaper or lighter options.
● Near-best pickOrange = score decreased
Scores out of 100 · Full 0–100 scale · tap a point to select mode B. Cyan band: within 1.0 points of the best tested score.
Measured average USD per benchmark task.
Measured in this study with its particular tools and setup. Your task mix, tools, caching and endpoint can change the result.
Large gap · B scored higher
Same benchmark workload
Measured with the study’s testing setup
We describe gaps under 1 point as small, 1–under 5 as noticeable, and 5 or more as large. These are reading aids, not proof that a difference would hold up in repeated tests. Equal scores can still hide different mistakes.
0.0 pts vs Low
$0.6101 / source task
111 s median duration
+8.5 pts vs Low
$0.9734 / source task
170 s median duration
+11.0 pts vs Low
$1.25 / source task
220 s median duration
+13.0 pts vs Low
$2.16 / source task
388 s median duration
+16.5 pts vs Low
$3.57 / source task
677 s median duration
Swipe inside the table for all measures. Figures from different study selections are not directly comparable.
| Effort | Analytics score | Cost / task | Median seconds | Output tokens | Exact source ID |
|---|---|---|---|---|---|
| Low | 54.0 | $0.6101 | 110.8 | — | Opus 5.5 · Low |
| Medium | 62.5 | $0.9734 | 169.6 | — | Opus 5.5 · Medium |
| High | 65.0 | $1.25 | 220.1 | — | Opus 5.5 · High |
| Extra high | 67.0 | $2.16 | 387.7 | — | Opus 5.5 · XHigh |
| Max | 70.5 | $3.57 | 677.2 | — | Opus 5.5 · Max |
What would A versus B cost if you repeated this benchmark’s average workload?
A source-workload scenario using average measured USD costs. Source prices, caching and tools are already reflected in those observed costs. Your agent’s costs may differ.
Estimate the extra bill from thinking tokens. The starting token counts are editable examples, not measurements of Claude Opus 5.5. Rates start from the current model snapshot.
Mode B costs $80 more per month with these assumptions.
This estimate uses the token counts and prices you enter. Excludes retries, tools, caching, long-context premiums, hosting and taxes. Includes thinking in output billing; do not also include it in “visible output.” Check endpoint limits separately. Changing mode does not automatically predict tokens or quality.
Each card compares settings tested together in one study. Scores from different benchmarks or question sets measure different work and are not averaged together.
Published blended DataBench score, on a 0–100 scale. Judge-based analytical task performance; not a general intelligence or guaranteed success rate.
Near-best pick: Max within 1 point of the best score. Highest-to-lowest score gap: 16.5 points.
Explore this study ↗A dash means the study did not report that result. This table compares only the versions and settings tested on the same questions in this study.
| Effort / budget | Analytics score | Measured USD / task | Median seconds / task | Exact source configuration |
|---|---|---|---|---|
| Low | 54.0 | $0.6101 | 110.8 | Opus 5.5 · Low |
| Medium | 62.5 | $0.9734 | 169.6 | Opus 5.5 · Medium |
| High | 65.0 | $1.25 | 220.1 | Opus 5.5 · High |
| Extra high | 67.0 | $2.16 | 387.7 | Opus 5.5 · XHigh |
| Max | 70.5 | $3.57 | 677.2 | Opus 5.5 · Max |
AI Agent Store task-weighted category mix. An editorial selection aid, not a measured agent success rate; weights match our published Agent Fit methodology.
Near-best pick: Max within 1 point of the best score. Highest-to-lowest score gap: 1.5 points.
Explore this study ↗A dash means the study did not report that result. This table compares only the versions and settings tested on the same questions in this study.
| Effort / budget | Overall benchmark | General agent fit | Coding agent fit | Research agent fit | Writing & support fit | Reasoning | Coding | Agentic Coding | Mathematics | Data Analysis | Language | Instruction following | Exact source configuration |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Extra high | 82.1 | 77.9 | 76.5 | 81.9 | 78.0 | 90.7 | 89.3 | 65.4 | 96.8 | 79.8 | 85.5 | 67.0 | claude-opus-5-5-xhigh-effort |
| Max | 83.2 | 79.4 | 79.4 | 82.4 | 77.9 | 92.2 | 89.3 | 71.7 | 97.1 | 80.3 | 86.3 | 65.7 | claude-opus-5-5-max-effort |
Max is the lowest-cost option within 1 point of the best analytics score in Hex DataBench v1.1. The tested score range is 16.5 points. This allows a score up to 1 point below the best result in the first listed study. Change the study, task and allowed score gap above to explore another comparison. It is a shortlist for testing your own workload.
Low, Medium, High, Extra high, Max appear in the collected studies. Each chart only includes modes tested together in that study. These published labels do not establish that every endpoint or application exposes every setting.
In the first listed Hex DataBench v1.1 sweep, the tested score range is 16.5 points and no adjacent effort increase lowers the score. This does not guarantee a gain on every task or with a different testing setup.
Use the A/B selector and measured-cost calculator when the source reports dollar costs. For your own agent, enter average input, visible output and thinking tokens in the token calculator. Higher effort is adaptive, so the label itself cannot tell you the bill. Missing costs stay missing.