Skip to content
Quancis
Blog
Engineering3 min read

Why Kael Is Slower, On Purpose

By Response Mosese, Owner, Quancis · Updated

Kael takes longer to answer than most models. That is not a limitation we are working around. It is the trade we chose: accuracy over speed.

Every Kael answer is drafted, checked against your request and refined before you see it, and that takes work. If you want the background, Introducing Kael describes the design. This post is about what the design costs you in time, and how to decide how much of that time to spend.

What slow means in numbers

With thinking on, at any level, Kael spends about 2.2 times as long thinking as an average AI model does. Once it starts writing, though, the answer streams quickly, at roughly 220 to 340 tokens per second. So the wait is at the front. The text itself arrives at a good clip.

With thinking off, the first word usually arrives within 0.7 to 3 seconds, and the output runs at roughly 90 to 140 tokens per second. That is the quickest Kael gets.

Thinking on, any level220–340 tokens/sec
Thinking off90–140 tokens/sec
Figure 1. Output speed once Kael starts writing. These ranges are what we usually see, not guarantees. Time to the first word is a separate figure: 0.7 to 3 seconds with thinking off, and longer with thinking on.
Thinking on220 to 340 tokens a second once it startsfirst word, after the thinkingThinking off90 to 140 tokens a secondfirst word, usually within 0.7 to 3 secondsschematic, not to scale
Figure 2. The shape of the wait, as a schematic. With thinking on, the delay comes before the first word and the text then arrives quickly. With thinking off, the first word comes sooner and the text arrives more slowly. The speeds are the ranges stated above; the drawing is not to scale.

We do not have published worst-case latency numbers for long prompts yet, and we would rather say that than imply otherwise.

Choosing how much Kael thinks

You choose how much thinking a request gets, and the setting does more than a simple on-off switch. It changes how the system works on the request. Three levels are available today, plus off.

less thinkingmore thinkingOffanswer onlyLowthe defaultHighmore roomMaxthe most room
Figure 3. Thinking levels pictured as scratch paper. A schematic: it shows that each level allows more thinking, not how much any level uses.
Thinking levels and prices, per 1 million tokens. Cached input is billed at up to 80% off the standard input rate. Prices for Off and Auto are not listed separately here; the console shows exact numbers.
LevelStatusInputCached inputOutput
OffAvailable———
Low (default)Available$2$0.40$6
HighAvailable$2$0.40$6
MaxAvailable$2$0.40$6
AutoNot available yet———
z-low, z-highNot released, no date$6Not announced$15
Table 1. Thinking levels and prices, per 1 million tokens. Cached input is billed at up to 80% off the standard input rate. Prices for Off and Auto are not listed separately here; the console shows exact numbers.

Two notes on that table. First, the z levels are not out. They are the highest levels of thinking and send requests through a different internal route that costs more; we will say more when there is a date. An Auto level, where Kael decides how much to think, is also not available yet. Second, the billing rule is simple and worth repeating: you pay for your own input tokens and the final output tokens only. The extra calls Kael makes inside the system, which can run to about twenty on a hard task, are never billed to you. The console has the exact numbers for your account.

Rules of thumb

  • Start at Low. It is the default for a reason. Most requests do not need more.
  • Move up to High or Max when being right matters more than being quick: a security review, a large refactor, a bug that touches several files. The research on spending extra compute points the same way: how much extra effort pays off depends on how hard the problem is.
  • Turn thinking off when the question is simple and you want the fastest reply Kael can give.

When Kael is the wrong tool

None of this makes Kael right for every job. If you need the fastest response available, if your work is mostly creative writing, if you need PDFs, video or a language other than English today, or if you need downloadable or self-hosted weights, there are better fits. If you need the answer to be correct, and a few extra seconds are a fair price for that, that is what Kael is for.