Extra high
Suggested setting0.0 pts vs Extra high
Compare Low vs Medium vs High vs Extra high vs Max where tested. Find the effort setting that fits your task, and see how much extra reasoning changes the result.
AI Agent Store task-weighted category mix. An editorial selection aid, not a measured agent success rate; weights match our published Agent Fit methodology.
Explicit effort rows · Question set: 2026-06-25 · Reviewed 2026-10-15Check the source ↗Lowest tested effort within 1.0 points of the best tested general agent fit.
77.1 / 100Set 0 for the highest score. Increase the gap to explore cheaper or lighter options.
● Near-best pickOrange = score decreased
Scores out of 100 · Full 0–100 scale · tap a point to select mode B. Cyan band: within 1.0 points of the best tested score.
The recommendation uses the lowest tested effort within your allowed score gap. That does not prove it is the cheapest or fastest.
Use the token calculator below with your own usage measurements. Effort labels alone do not tell us a token bill.
Estimate your own token costs ↓Small gap · B scored higher
Best minus lowest tested score
Max
We describe gaps under 1 point as small, 1–under 5 as noticeable, and 5 or more as large. These are reading aids, not proof that a difference would hold up in repeated tests. Equal scores can still hide different mistakes.
0.0 pts vs Extra high
+0.6 pts vs Extra high
Swipe inside the table for all measures. Figures from different study selections are not directly comparable.
| Effort | Overall benchmark | General agent fit | Coding agent fit | Research agent fit | Writing & support fit | Reasoning | Coding | Agentic Coding | Mathematics | Data Analysis | Language | Instruction following | Cost / task | Median seconds | Output tokens | Exact source ID |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Extra high | 81.1 | 77.1 | 70.6 | 84.3 | 81.3 | 91.6 | 80.7 | 56.8 | 96.5 | 82.2 | 88.6 | 71.3 | — | — | — | gpt-6.1-sol-xhigh |
| Max | 81.6 | 77.7 | 70.0 | 85.6 | 83.3 | 92.6 | 80.4 | 54.5 | 96.8 | 82.7 | 90.1 | 74.2 | — | — | — | gpt-6.1-sol-max |
What would A versus B cost if you repeated this benchmark’s average workload?
This source has no comparable dollar-cost observation. Use the token calculator below with your own usage; token counts alone cannot supply a full bill.
Estimate the extra bill from thinking tokens. The starting token counts are editable examples, not measurements of GPT-6.1 Sol. Rates start from the current model snapshot.
Mode B costs $40 more per month with these assumptions.
This estimate uses the token counts and prices you enter. Excludes retries, tools, caching, long-context premiums, hosting and taxes. Includes thinking in output billing; do not also include it in “visible output.” Check endpoint limits separately. Changing mode does not automatically predict tokens or quality.
Each card compares settings tested together in one study. Scores from different benchmarks or question sets measure different work and are not averaged together.
AI Agent Store task-weighted category mix. An editorial selection aid, not a measured agent success rate; weights match our published Agent Fit methodology.
Near-best pick: Extra high within 1 point of the best score. Highest-to-lowest score gap: 0.6 points.
Explore this study ↗A dash means the study did not report that result. This table compares only the versions and settings tested on the same questions in this study.
| Effort / budget | Overall benchmark | General agent fit | Coding agent fit | Research agent fit | Writing & support fit | Reasoning | Coding | Agentic Coding | Mathematics | Data Analysis | Language | Instruction following | Exact source configuration |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Extra high | 81.1 | 77.1 | 70.6 | 84.3 | 81.3 | 91.6 | 80.7 | 56.8 | 96.5 | 82.2 | 88.6 | 71.3 | gpt-6.1-sol-xhigh |
| Max | 81.6 | 77.7 | 70.0 | 85.6 | 83.3 | 92.6 | 80.4 | 54.5 | 96.8 | 82.7 | 90.1 | 74.2 | gpt-6.1-sol-max |
Correct answers out of 88 observed runs on 44 fixed problems, repeated twice. Repeats are not 88 independent questions; reported confidence intervals overlap for the near-ceiling models.
Near-best pick: High within 1 point of the best score. Highest-to-lowest score gap: 2.3 points.
Explore this study ↗A dash means the study did not report that result. This table compares only the versions and settings tested on the same questions in this study.
| Effort / budget | Answers correct | Median seconds / task | Reported 95% accuracy interval | Exact source configuration |
|---|---|---|---|---|
| Medium | 97.7 | 10.1 | 92.1–99.4% | gpt-6.1-sol / medium / 44-problem Codex test |
| High | 100.0 | 11.0 | 95.8–100.0% | gpt-6.1-sol / high / 44-problem Codex test |
Download this study’s data (CSV) ↓
Data: Joonlab · Codex subscription study. CC BY 4.0 ↗. AI Agent Store aggregates the published rows and adapts their labels. These are the same 44 problems at both settings. A small difference, often driven by one question, is a reason to test your tasks rather than a universal effort recommendation. Duration is the source median including network and queue time; no API cost is estimated.
Correct answers in three repeats of one prompt: count ordered integer pairs from 1 to 60 whose product is a perfect square; expected answer 158. One miss changes the score by 33.3 points. This is not a general reasoning benchmark.
Near-best pick: Low within 1 point of the best score. Highest-to-lowest score gap: 0.0 points.
Explore this study ↗A dash means the study did not report that result. This table compares only the versions and settings tested on the same questions in this study.
| Effort / budget | Arithmetic runs correct | Median seconds / task | Average output tokens | Exact source configuration |
|---|---|---|---|---|
| Low | 100.0 | 17.6 | 495 | gpt-6.1-sol / low / reasoning prompt |
| Medium | 100.0 | 19.8 | 593 | gpt-6.1-sol / medium / reasoning prompt |
| High | 100.0 | 26.8 | 756 | gpt-6.1-sol / high / reasoning prompt |
| Extra high | 100.0 | 43.7 | 1,334 | gpt-6.1-sol / xhigh / reasoning prompt |
| Max | 100.0 | 53.5 | 1,544 | gpt-6.1-sol / max / reasoning prompt |
Download this study’s data (CSV) ↓
Data: Joonlab · Codex subscription study. CC BY 4.0 ↗. AI Agent Store aggregates the published rows and adapts their labels. One arithmetic question and three repeats per setting cannot establish general accuracy. The displayed output and reasoning tokens are means of raw runs; durations are medians. All five Sol6.1 settings answered this question correctly, so extra reasoning showed no accuracy gain on this example. These observations predate Ultrafast and do not compare service tiers.
Artificial Analysis · GPT-6.1 Sol effort results ↗ · Checked 2026-10-03. The publisher now lists low, medium, high, extra high and max. Read its current comparison and methodology. Numeric rows are not imported here because reuse permission has not been verified.
Hex DataBench · GPT-6.1 Sol five-level analytics study ↗ · Checked 2026-10-07. The publisher now lists five tested effort levels. Its current table is linked while reuse permission is unresolved; new numeric rows are not included here. Our existing matched LiveBench study uses xhigh and max.
Extra high is the lowest-effort option within 1 point of the best general agent fit in LiveBench. The tested score range is 0.6 points. This allows a score up to 1 point below the best result in the first listed study. Change the study, task and allowed score gap above to explore another comparison. It is a shortlist for testing your own workload.
Low, Medium, High, Extra high, Max appear in the collected studies. Each chart only includes modes tested together in that study. These published labels do not establish that every endpoint or application exposes every setting.
In the first listed LiveBench sweep, the tested score range is 0.6 points and no adjacent effort increase lowers the score. This does not guarantee a gain on every task or with a different testing setup.
Use the A/B selector and measured-cost calculator when the source reports dollar costs. For your own agent, enter average input, visible output and thinking tokens in the token calculator. Higher effort is adaptive, so the label itself cannot tell you the bill. Missing costs stay missing.