Free & open · no paywall, ever

IntegrAuth Academy

Identity, security and practical AI — free, from zero. Byte-sized lessons, real diagrams, hands-on labs, zero fluff. Two programs, each with its own exam and certificate.

20 tracks 241 lessons 242 hands-on labs 230+ diagrams 100% free

English is hard? Your browser can translate this page into Tamil, Telugu, Kannada, Malayalam or Hindi. Tech words stay in English so you learn the real names.

How?
  • Chrome on phone: ⋮ menu → Translate
  • Chrome on computer: right-click → Translate to …
  • Edge: the translate icon in the address bar
Practical AI Track 1 · AI Essentials
0/75 lessons read
AI ESSENTIALS · LESSON 8

Models that pick from a list

Priya's team gets thousands of tickets a day. An LLM picks a team for each one. It is slow, and sometimes its answer is broken. Your goal: know when a model that only picks from a list is better.

🧪 Interactive lab — enable JavaScript to play with this one.

LLM · writes the answer, token by tokenDecision model · one pass, every optionTicket textLLMTicket + questionteam ∈ {4 options}Decision model{"team":"billing"}123456Each token waits for the one before it.Free text: it can write anything — includingbroken JSON or a team that doesn't exist.billing0.86technical0.08account0.04shipping0.02All options scored at once. It can only answer from the list.
Writing vs choosing. The decision model scores all options at once.
Key points
  • A decision model only chooses. It scores your whole list at once.
  • Its answer always comes from your list, but it can still be wrong.
  • Add an "other" option. Send unsure answers to a person.

Writing vs choosing

An LLM writes one token at a time. Each token depends on the ones before it. This is called autoregressive.

A model built only to choose is a decision model. It reads the input once, and scores every allowed answer at once. It writes no text.

How you ask it

You send the text to judge, called the state, plus questions. Each question lists its allowed answers. The ticket: “Help! My payouts have been failing for 3 days.”

TypeQuestionAnswer back
Yes/noNeeds action today?yes: 0.95
ChoiceWhich team? billing, technical, account, shipping, otherbilling, confidence 0.80
ScoreHow upset, from 0 to 4?3.1, confidence 0.90

All answers come back in one call. Each one comes from your list, so the form is never broken. The number is the model's confidence: how sure it is, from 0 to 1. For example, act alone at 0.9 or more, else ask a person.

Now fix 4 broken setups.

🧪 Interactive lab — enable JavaScript to play with this one.

Go deeper: good jobs for it

Use it for quick choices. It can sort tickets and emails. It can find what a user wants in a chat. It can pick a tool from a fixed list. It can check a reply for personal data, as a guardrail. It can also score answers against a checklist, as in evals. The LLM still does the writing and the hard thinking.

TicketDecision modeltenths of a secondRoute automaticallyconfidence ≥ 0.9LLM or a personunsure, or "other"LLM draftsthe reply
Fast first, careful when needed. The fast model makes the easy calls. It hands unsure cases, and any writing, to the LLM or a person.

Models that sort things into groups are called classifiers. They are not new. Teams have trained small ones for years, one per job. The new idea is one general model, built only for typed answers. You describe the choice in plain words, and call it like an LLM.

Go deeper: fast and slow thinking

The psychologist Daniel Kahneman described two ways of thinking, in his 2011 book Thinking, Fast and Slow. System 1 is fast and automatic, like seeing that a face is angry. System 2 is slow and careful, like working out 17 × 24 on paper.

An LLM is more like System 2. A reasoning model even writes many thinking tokens before its answer. A decision model is built to be System 1. It is non-autoregressive: it does not write step by step. So almost nothing is written, or billed as output.

Go deeper: Jev and Laya, two early examples

This kind of model got a lot of attention in September 2026. As of October 2026, two early examples are Jev and Laya.

  • Jev, by TypeSafe AI, is closed and in early access. You call it over the internet, through its maker's API (a way for programs to call it) or some AI gateways. So your text leaves your own systems.
  • Laya, by Convai Innovations, has open weights under Apache-2.0. You can download it and run it yourself. Then your team must run and secure it. It reads text but never writes it.

Laya's model card lists limits. On its own, the base model scores close to guessing on its maker's typed test. It does far better after extra training for the task. It gets weaker with more than about 20 options. The English version reads only 512 tokens per question.

This field is new. Treat most numbers as claims from the makers. TypeSafe says Jev is up to about 200 times faster than LLMs, on tasks it tested.

One early study put Jev into a real system. It is a September 2026 preprint, so other experts have not checked it yet. In its updated version, the typical wait for a decision fell by about 23 to 65 percent. That is compared with the fastest LLM it tested. The cost per correct decision fell by about 60 to 80 percent. Jev got slightly fewer answers exactly right. So the gain was real, but much smaller than the claim. The network and the rest of the system still take time.

Also, an LLM can be forced to answer only from a list. This is called structured output. Then a decision model's edge is speed and cost, not a valid form. Is it right enough for your question? Test that on your own cases.

Watch out

It can't write or explain. If the right answer is not on the list, it still picks one. And it may look sure.

🧪 Try it free

An unofficial build, Laya in the browser, runs it on your own device. It downloads a few hundred megabytes first. Give it a real message and 4 options. Then remove the right option. What does it pick?