Skip to model comparison
AI Agent Store/Model comparisonsBuild an AI worker ↗

vLLM Semantic Router · Download documented

d3 · local decision models

Route support requests, prioritize cases or check an image against a rule on your own machine. Supply the possible answers; d3 scores them instead of writing a reply.

First reviewed 2026-10-27 · Checked 2026-11-03. The launch date has not been confirmed.

We still need comparable independent tests. You can compare the confirmed features and limits below, but we cannot yet give this version an Agent Fit or Practical Value rating. Try it on your hardware and tasks before relying on it.

Runs onYour hardwareHardware and setup costs apply
Documented capacity4KSee input limits below

What you can use today

You download the model files and supply the hardware and software to run them. Capacity is the amount of information a request can contain; settings and available memory can limit what fits.

Exact Ollama package ID: d3:2b / d3:4b / d3:9b / d3:27b. The four packages contain 2B, 4B, 9B and 27B variants. The plain d3 name selects 4B. Ollama supports text, structured data and still images; video and Box/Track decisions are unavailable in these packages.

Requires Ollama 0.40.9 or later. The page recommends Apple Silicon systems with 8GB, 16GB, 32GB and 64GB respectively, based on its default packages at 4,096 context. Other systems use a different format and may need different memory. Apache 2.0.

The package instructions specify 4,096 context tokens despite the larger 256K catalog badge. Do not assume the badge is the usable default. Publisher checkpoint capabilities and scores do not establish equivalent behavior in these compressed packages.

No per-token local API bill is established; you supply hardware and electricity. Check probabilities on real examples before setting thresholds for automatic actions.

Provider release and specifications ↗

Check availability and plans ↗

Provider documentation ↗

More setup and licensing details ↗

More setup and licensing details ↗

More setup and licensing details ↗

Test it before switching

Give each model the same examples, tools and definition of success. Record correct outcomes, response time, retries and total cost. Include the time and hardware needed to run it.

Compare caching and long-context costs ↗
AI Agent Store · Model comparisons · Data reviewed 2026-11-03Sources, limitations & corrections ↗