Dossier, 19 September 2026
Jev, examined
TypeSafe's decision model answers in under half a second for a fraction of a cent. Whether its confidence numbers can be trusted to run unattended is the part nobody has settled.
On TypeSafe's own benchmark, Jev beats Claude Opus 5 at customer-service triage, 76.0% to 72.4%. On invoice matching it loses to every model tested except Haiku 4.5. The first run costs a hundredth of a cent per case and the second a tenth of a cent, and both come back in half a second.6
That spread is most of what you need to know. Jev is a hosted, closed-weight model from a San Francisco lab that left stealth on 15 September 2026. It does not write. You hand it some text and a set of typed questions, and it returns a yes/no probability, a pick from a list, or a position on a scale, each with a probability distribution, all in one parallel pass. It is very fast, very cheap, and it cannot return a malformed answer. Outsiders have confirmed all three. What they have not confirmed is the claim the product rests on: that its confidence is calibrated well enough to decide, without a person watching, which decisions software may take alone. The independent evidence on calibration is mixed, and in places it points the wrong way.
So: use it for high-volume, rubric-driven triage where a wrong answer costs about a euro and a person sees the uncertain remainder. Keep it away from sums, dates, multi-document reconciliation, and any personal data you would not send to a single US region under standard contractual clauses. If you have labelled history, test a small encoder first. One of those beat a frontier model at 9 ms for nothing.14
At a glance
The spec sheet
| Maker | TypeSafe AI, San Francisco, founded 2024. $40M seed led by DCVC, announced 15 Sep 2026. Forbes reported a valuation near $200M, citing a person familiar with the deal.1112 |
|---|---|
| Founders | Diogo Almeida (CEO; ex-OpenAI, worked on RLHF, InstructGPT, ChatGPT and GPT-4), Erik Gafni, Sasha Sheng.11 |
| Model | jev-1.13.0. Aliases jev-latest and jev-preview both point to it today and move when a release ships.1 |
| Interface | One endpoint, POST /v1/systemone. Three question types: Noul, Choice, Score.2 |
| Price | $0.042 per million input tokens ($42 per billion). Output tokens are counted and not billed.1 |
| Latency | 70 to 500 ms claimed.5 0.21 to 0.59 s measured by third parties.1317 |
| Context | 64k tokens per request. 32k for state plus the single longest question.1 |
| Rate limits | 250,000 tokens per second, 1,200 requests per minute. TypeSafe says these can change without notice while capacity lands.1 |
| Input | Text only: string, JSON object, or array. English is strongest. Other languages, CJK included, are handled less well and no figures are published.1 |
| Customisation | None at the weight level. No fine-tuning, no LoRA. The same weights serve every account.1 |
| Weights | Closed. No download, no on-premises, no VPC option documented. |
| Hosting | United States, West Coast. No EU region.57 |
| Your data | Not used for training or fine-tuning. Retained "as long as reasonably necessary". Zero data retention is for enterprise customers only.79 |
| Access | Waitlist at typesafe.ai. Also listed on OpenRouter, Vercel AI Gateway and Cloudflare.21 |
| SLA | None published. |
What it is
A function call with a probability attached
A language model produces strings for people to read. When software needs a decision from one, somebody has to coax the string into JSON, parse it, validate it, and retry when it comes back wrong. Jev skips all of that. Its output space is fixed by the request, so an answer outside your schema is not rare. It is impossible.5
TypeSafe calls this a System One model, after Kahneman's fast, intuitive mode of thinking. The model itself is named after William Stanley Jevons: the company expects cheaper machine judgement to create more demand for it, the way efficient steam engines did for coal.5 Its own shorthand is a smart if-statement. The AI is one small component inside ordinary software, and the surrounding code stays in charge.
state. Values in the answer box are illustrative.The contract
Three question types, one endpoint
| Type | Asks | Returns | Limits |
|---|---|---|---|
| Noul | Is this true? | noul, the probability of yes from 0 to 1. No confidence field: certainty is how far the number sits from 0.5. Optional criteria say what true and false mean. | Binary |
| Choice | Which one? | choice (the top option), probabilities for every option summing to 1, and confidence. | Up to 255 options |
| Score | Where on this scale? | score, a probability-weighted position that can land between levels, plus legend, per-level probabilities and confidence. | 2 to 10 ordered levels |
Sources for the table: the API reference and the primitive pages.23
request
POST https://api.typesafe.ai/v1/systemone
{
"model": "jev-1.13.0",
"state": { "tier": "enterprise",
"text": "DB latency over 1200 ms since the migration. Webhooks are dropping." },
"questions": {
"is_outage": { "type": "noul",
"instructions": "Does this describe a production outage?" },
"team": { "type": "choice",
"instructions": "Which team should triage this?",
"criteria": { "database": "Storage, pools, query latency",
"networking": "Ingress, webhooks, TLS",
"application": "Business logic, auth, UI" } },
"severity": { "type": "score",
"instructions": "How severe is the incident?",
"criteria": ["Cosmetic", "Degraded, workaround exists", "Blocking, no workaround"] }
}
}
The keys under questions are yours and never reach the model. instructions and criteria accept strings, objects or arrays, so when two options keep getting confused you can give each one fields such as what, not_for and examples. The model never sees a Score level's number, only its description. Levels written as bare numbers perform badly for that reason.3
Confidence describes the distribution. It does not vouch for the answer.
Confidence is computed from how peaked the returned probabilities are, and the formula is unpublished. TypeSafe's documentation is careful about this. A confidence of 1.0 means all the mass sat on one option. It is a statement about the model's answer and no guarantee that the answer is correct. The docs also warn that if rewording a question raises confidence, you have learned nothing yet about which wording is better.3 Hold on to that. It matters in the independent results.
Ask everything at once
All questions in a request run in parallel against one reading of state. Extra questions cost their own tokens and add almost no latency. TypeSafe's cookbook puts a 13-question regulatory briefing at 12.2 times cheaper and 10.0 times faster when batched than when asked one at a time, with identical answers.22 This inverts the habit language models taught us, which was to save tokens with small sequential calls. Here the recommended pattern is to ask every question your code might need and ignore the answers it doesn't.
Novelty
What is new, and what is only renamed
| Language models | Jev | |
|---|---|---|
| Trained for | Human preference (RLHF) or checkable rewards (RLVR) | Calibrated decisions (RLCD) |
| Output | Strings that need parsing and validation | Typed values. Off-schema output cannot occur. |
| Sampling | Sequential, one token at a time | Parallel, every output in one query |
| Input price | $0.20 to $10 / MTok | $0.042 / MTok |
| Output price | Roughly five times input | Not billed |
| End-to-end time | 3 to 329 s (frontier) | 70 to 500 ms |
| Uncertainty | Verbal or log-prob heuristics, prone to overconfidence | A distribution and a confidence on every answer |
| Reasons given | Yes, in prose | None |
The Jev column and the language-model ranges are as TypeSafe states them.5
The interface is the real contribution. The idea underneath is older. Encoder classifiers such as GLiNER and GLiClass score labels against text in one pass. Cross-encoder rerankers return a relevance scalar for a pair. Grammar-constrained decoding has forced schema conformance out of language models for years. Jev's claim over all of them is breadth (zero-shot judgement against any rubric you write at request time) plus calibration from a training method TypeSafe calls Reinforcement Learning for Calibrated Decisions.
About the architecture, TypeSafe has said three things: it is new, it uses a hardware-aware parallel sampler, and it was trained with RLCD.5 There is no paper and no model card. TechCrunch reports the model is transformer-based, that outside observers suspect an open-weight base model, and that Almeida says it was trained only on synthetic data, which he called his best strategic bet.10 None of that can be checked. What can be checked is that at least seven open reimplementations of the interface appeared within four days, which says something about how much of the design is secret. More on those below.
Vendor evidence
The vendor's numbers
TypeSafe built four workflows: security incident response, review of support-agent traces, invoice processing, and customer service. Each is a fixed decision graph in code. Every model answers the same Noul, Choice and Score questions, and code makes the final call. The reference answers are the average of GPT-6 Astra and Claude Fable 5.1, both at high thinking. TypeSafe says outright that it is not measuring against ground truth, so "accuracy" below means agreement with two large models. Scored models run at their provider's default reasoning setting, and the language models go through TypeSafe's own adapter. The mean weights the four workflows equally.56
Agreement against cost per case
Agreement against time per case
The mean hides the interesting part.
| Workflow | Jev | Sol | Opus 5 | Terra | Sonnet 5 | Luna | DS Flash | DS Pro | Haiku 4.5 |
|---|---|---|---|---|---|---|---|---|---|
| Customer service | 76.0 | 78.3 | 72.4 | 72.7 | 69.3 | 71.4 | 76.8 | 76.1 | 55.4 |
| Agent-trace review | 71.6 | 76.6 | 75.2 | 73.0 | 68.0 | 76.1 | 73.0 | 71.6 | 57.2 |
| Security incidents | 61.7 | 62.5 | 66.2 | 51.2 | 60.8 | 52.1 | 37.9 | 41.7 | 58.8 |
| Invoice processing | 61.8 | 79.1 | 78.4 | 74.7 | 72.9 | 67.8 | 69.8 | 72.7 | 42.9 |
| Mean | 67.8 | 74.1 | 73.1 | 67.9 | 67.8 | 66.8 | 64.4 | 65.5 | 53.6 |
Invoice processing means reconciling a bill against a purchase order and a delivery note, with amounts. That is multi-document arithmetic, and TypeSafe's own documentation lists numbers and indirection among the things Jev does badly. The benchmark and the limitations page agree with each other, which is more than most launches manage.
Where 193.6× and 444.6× come from
TypeSafe's home page says 193.6 times faster and 444.6 times cheaper, and its launch post says these sit at the high end of what it expects in practice.5 It does not say which model each ratio is measured against. The published means allow a guess:
| Against | Speed | Cost |
|---|---|---|
| Claude Sonnet 5 (78.1 s, $0.1174) | ~195× | ~294× |
| Claude Opus 5 (37.8 s, $0.1761) | ~95× | ~440× |
| GPT-5.6 Sol (23.3 s, $0.0836) | ~58× | ~209× |
| GPT-5.6 Terra (10.1 s, $0.0304) | ~25× | ~76× |
| GPT-5.6 Luna (12.9 s, $0.0033) | ~32× | ~8× |
The speed headline fits Sonnet 5 and the cost headline fits Opus 5: the slowest Anthropic model and the dearest one. Against Terra, which TypeSafe itself calls the closest match in intelligence, the figures are 25 and 76. Against Luna, the cheap one, the cost advantage is eight.
The biases TypeSafe discloses
- Its own capabilities team wrote the workflows.
- Reference labels from OpenAI and Anthropic models favour OpenAI and Anthropic models. TypeSafe thinks Jev and DeepSeek are understated as a result.
- The adapter asks language models for probability distributions, which makes them slower and dearer than asking for a bare label.
- Latency was measured from laptops on the US West Coast, where the service runs.
- The 0% type-error figure is a property of the design. Nobody measured it, and nobody needs to.
There is no public benchmark card, and that is policy. TypeSafe says it chose not to publish against public benchmarks and argues against optimising for them. Fair enough, but it leaves third parties as the only route to a comparison you can trust.
The finding TypeSafe buried: decomposition helps everyone
This matters more than the headline ratios. The pattern (narrow typed questions, deterministic code around them) carries much of the benefit, and you can apply it today with any model, including one running on your own hardware.
Independent evidence
What outsiders measured
Four days after launch there is a surprising amount of third-party work, some of it pre-registered with raw outputs committed. Speed and cost hold up. Accuracy is good and depends heavily on the task. Calibration is contested, and that is the one that matters.
Evaluations with artefacts
| Evaluation | Result | What it tells you |
|---|---|---|
| jev-baselines-eval14 pre-registered, Banking77 and CLINC150 | +7.5 points over gpt-5.4-nano on CLINC150 (95% CI +3.0 to +12.5). 4.5 points behind GPT-5.6 Terra. A frozen bge-small encoder with logistic regression on 10,003 labelled examples scored 0.933 at 9 ms on a laptop and beat the frontier model by 5.8 points on Banking77. Jev's confidence ranked its own errors no better than a language model's stated confidence on CLINC150 (AUROC 0.734 against 0.816, interval includes zero). The order reversed on Banking77. | The most useful result so far. Strong zero-shot, beaten by a supervised encoder where labels exist, and no demonstrated edge as an escalation gate. Both pre-registered experiments came back ambiguous, and the author says so. |
| jev-benchmarks15 300 held-out examples, hashed artefacts | 0.910 against GLiNER2.5's 0.700 on AG News. 0.870 against 0.610 on Banking77. Unresolved on DAIR Emotion. | Clear win over an encoder zero-shot baseline on topic and intent. The repository calls its own result deliberately mixed. |
| jev-zeroshot-vs-bert16 seven datasets, contamination control | Beats a clean DeBERTa zero-shot model on all seven (+0.05 to +0.13). Worth about 230 labelled examples on AG News and Banking77, and more than 2,048 on SST-2, TweetEval-emotion and PAWS. | The best answer to "how much labelled data is Jev worth". It also found the popular DeBERTa zero-shot checkpoint was trained on two of the test sets, so many published baselines are flattering. |
| Lindfors17 24 Norwegian tax consultation papers, 11 questions each | Stance 20 of 24, level with DeepSeek reasoning. Substance 19 of 24, best in class. 34 of 35 right where p ≥ 0.9. $0.005 for the lot, 0.32 s median. Expected calibration error 0.040 with short prompts and 0.116 with carefully worded ones. Labels came from a frontier model. | Non-English works better than the docs suggest. And careful wording made calibration nearly three times worse. |
| jev-sec-bench17 blind, 662 prompt-injection messages | 96.5% accuracy, ROC-AUC 0.9927, ECE 0.0588, p50 325 ms. | The strongest published case for the guardrail use. |
| jev-rerank-bench17 8 datasets, 1,617 questions | nDCG@10 of 0.692 against 0.691 for Cohere Rerank 4 Pro, at 422 ms. | Level with a dedicated commercial reranker. |
| Search rerank eval17 9,831 labelled pairs | Jev fused with BM25 and bge-m3 wins. Jev alone does not beat embeddings. | A signal to fuse. Not a retrieval replacement. |
| calibre17 protocol frozen before results | Between Banking77 and Web of Science the best threshold moved, the sign of the accuracy gap flipped, and confidence routing stopped paying for itself. | Thresholds do not travel between datasets. |
Two failure probes worth remembering
A poker test with solver ground truth showed Jev the opponent's exact cards, a made flush, and asked what to do. A solver checks every time. Jev went all-in 16 times out of 16. Relabelling the same hand moved its answers by 15 to 30 points.17 A separate probe found it no better than random at picking a chess move from a board position, while scoring F1 0.96 on working out which game character a line of dialogue was addressed to.17
Both failures are on TypeSafe's own list: formal, numeric state and literal reading. Neither task looks hard, which is the uncomfortable bit.
Practitioner reports
These carry less weight: no artefacts, and some come from people quoted in launch coverage.
- Vercel swapped GPT-5.6 Luna for Jev in a classifier that decides whether an agent's shell command is safe. 5× to 18× faster, and more accurate.10
- Bryo AI classifies incoming business email. Jev was 10× to 20× cheaper than Gemini, and Gemini was slightly more accurate. The CTO wanted the probability more than the last point of accuracy.10
- Near Here, 50 real event-validation records: Jev 48 of 50, with Mistral Small 4 and Gemini Flash-Lite in the mid-80s. $0.043 per thousand decisions against $0.370 and $2.496.17
- Good Start Labs, 6,003 rubric checks: 91.5% agreement with Claude Fable 5.1 at about $160 per million graded answers, against about $260 for DeepSeek V4.1 Flash.18
- Every ran 21 questions over 37 articles: 777 judgements in under 0.7 s for about a quarter of a cent. On 12 passages with planted defects Jev caught six of seven and Claude Fable 5.1 caught all seven, at 25 times the latency and an estimated 580 times the cost. Mike Taylor, who ran it, wanted a fuller accuracy check before production.13
The calibration ledger
Supports the claim
- ECE 0.0588 on 662 prompt-injection messages, blind.
- Lindfors: 34 of 35 correct at p ≥ 0.9, ECE 0.040 with short prompts.
- jev-benchmarks reports a Brier-score advantage on the two datasets Jev won.
- One practitioner's test rig measured Brier 0.117 for Jev against 0.274 for a language-model stand-in.
Cuts against it
- Confidence ranked Jev's own errors no better than a language model's stated confidence on CLINC150, in a pre-registered test.
- Careful prompt wording raised ECE from 0.040 to 0.116.
- Routing thresholds did not transfer between two datasets and sometimes lost money.
- 16 of 16 confident all-ins into a visible flush.
- TypeSafe's own docs: a Noul and the same question as a yes/no Choice returned 0.22 and 0.01. A question and its negation summed to 1.19.4
Calibration looks decent on tasks close to what Jev is good at and unreliable off that path. It is also sensitive to how you phrase the question. A feature that is supposed to tell you when to trust the model should not behave like that, and it means you measure it yourself, on your data, again after every rewrite.
Limits
Where it breaks
TypeSafe publishes a page it calls jaggedness, last reviewed 17 September 2026, listing nine ways jev-1.13 goes wrong.4 It is the most useful page in the docs.
| # | Failure | Do this instead |
|---|---|---|
| 1 | Literal reading. It answers the words you wrote. | State the exact condition. Put boundary cases in the criteria. |
| 2 | Maths and counting. Unreliable tallies, poor on hex, RGB and low-level encodings. Score interpolation is weakly calibrated. | Arithmetic stays in code. To count, ask one Noul per item and sum the answers yourself. |
| 3 | Dates are read as text, with no sense of order. | Extract day, month and year as Choices. Compare in code. |
| 4 | Indirection and double negatives. | Fewer hops. Name the part of state you mean. |
| 5 | Context rot. Irrelevant state lowers accuracy. | Filter first. Send only what the question needs. |
| 6 | Adversarial content. State is not treated as hostile, so injected instructions can move the answer. | Explicit criteria. Test the ugly cases before rollout. |
| 7 | Instructions and criteria that disagree. | Align them. Never map true to "no". |
| 8 | No structural invariants across questions. | Ask each decision one way. Never carry a Noul threshold to a Choice. |
| 9 | Generation. It was not trained to write. | Use a generative model, or turn extraction into a Choice over candidates. |
What follows from the design
- No reasons. You get probabilities and a legend. Where a regulator or an auditor needs a written rationale (credit, health, hiring) Jev cannot be the whole answer.
- 255 options. Larger taxonomies need a hierarchy. TypeSafe's cookbook runs a beam search over Choice probabilities, level by level.22
- Tools. Jev can pick a function and fill arguments drawn from closed sets. Free-form arguments need a language model. In Pydantic AI a hand-off resends the whole step to the fallback model as if Jev had never run, so you pay for a request whose answer is thrown away.20
- The cascade tax. Set thresholds too high and most traffic escalates. Then you pay for Jev and the fallback, and wait for both.
- Simulators only. The Doom demo (ten decisions a second, about $7 an hour) reads structured text state. TypeSafe notes a conventional bot would play better.5
Application
Where it fits
The test TypeSafe suggests is a good one: could a knowledgeable person answer this in about a second? If so, and you need the answer a million times, Jev is a candidate.
| Good fit | Why | Evidence |
|---|---|---|
| Ticket, intent and email routing | Many parallel questions per item, with uncertain ones sent to a person | 76.0% on TypeSafe's customer-service workflow. Bryo, Near Here. |
| LLM guardrails and injection screening | Cheap enough to check every message in and out | 96.5%, AUC 0.9927 on 662 messages |
| Agent gating: continue, retry, ask, stop | Sub-second, so it fits inside an agent loop | Vercel's command-safety classifier |
| Reranking and passage filtering before a costly context window | One question per query-passage pair | Level with Cohere Rerank 4 Pro. Best fused with BM25 and embeddings. |
| Zero-shot labelling where you have a rubric and no labels | Follows a written policy with no training set | Worth about 230 to 2,048 labels depending on task |
| Model routing | Judge difficulty, then choose the cheap model or the capable one | Pattern documented, not independently measured |
| Forcing messy text into strict enums | Type errors cannot occur | By construction |
| Feature extraction feeding a classical model | Jev's probabilities become columns for CatBoost or similar | TypeSafe's AutoResearch cookbook |
Poor fits
- Anything that needs text out: replies, summaries, code, explanations.
- Anything code can compute exactly: counts, sums, date logic, things a regex finds.
- Multi-hop reasoning and reconciliation across several documents. See invoice processing.
- Formal or numeric state, such as board positions, hex values or encodings.
- Decisions about people that need a stated reason. In the EU, CV screening is a high-risk use under the AI Act, and a model that offers no rationale, is weaker outside English and has contested calibration is a poor basis for it.
- Problems where you already have plenty of labelled history. A fine-tuned encoder will usually be cheaper and at least as good.
- Tiny volumes. If you make a hundred decisions a day, the cost of a language model is noise and you keep the rationale.
The pattern you will end up building
TypeSafe documents four more patterns that go with it: speculative fan-out, composite scoring (one Score per dimension, normalised and weighted in your code), intent routing, and a structured-extraction cascade from small model to verifier to reasoning model.22
Practicalities
Getting it running
- Join the waitlist at typesafe.ai. Keys are issued at
console.typesafe.ai, which also has a playground. If you would rather not wait, OpenRouter accounts can reach Jev today, according to developers who have wired it up.21 - Install an SDK. Both read
TYPESAFE_API_KEY, default tojev-latest, and retry429and529with backoff.23 - Pin
jev-1.13.0wherever a threshold has been tuned, and log themodelfield that comes back. Aliases move on release, and your answers move with them.1
terminal
# Python, sync and async clients
$ uv add typesafe-sdk # or: pip install typesafe-sdk
# JavaScript and TypeScript
$ npm install @typesafe-ai/sdk
python
from typesafe_sdk import TypeSafeClient, Noul, Choice
with TypeSafeClient(model="jev-1.13.0") as client:
r = client.system_one(
state=ticket_text,
questions={
"billing": Noul(instructions="Is this ticket about billing?"),
"tone": Choice(instructions="What is the customer's tone?",
criteria={"calm": None, "frustrated": None, "angry": None}),
},
)
if r.choices["tone"].confidence < 0.5:
send_to_person(ticket_text)
| Route | Identifier | Notes |
|---|---|---|
| TypeSafe direct | jev-1.13.0, jev-latest | Native body {model, state, questions}. This is not the OpenAI chat shape, so an OpenAI SDK pointed at a new base URL will not work. |
| OpenRouter | typesafe/jev-latest, typesafe/jev-1.13 | 32k context, same price, listed 18 Sep 2026. Integrators report a separate Decisions endpoint that takes the native body. |
| Vercel AI Gateway | typesafe-ai/jev | Reached nearly 13% of paid gateway teams within 24 hours, by Vercel's count.10 |
| Cloudflare | typesafe/jev | Listed in Cloudflare's AI model docs as a third-party model. |
Errors: 401 bad key, 422 validation failure with the offending field named, 429 rate limit, 529 overloaded.2 Frameworks: Pydantic AI has a TypeSafeModel that maps bool and bounded float to Noul, Literal and Enum to Choice, and documented IntEnum to Score, with a FallbackModel hand-off for what Jev cannot express.20 LangChain ships a classifier wrapper. TypeSafe publishes an agent skill for Claude Code and Codex, and an MIT-licensed adapter that runs the same request contract over OpenAI and Anthropic chat models. That adapter is how you run an A/B test, and how you leave.5
Economics
What it costs, and what the token price hides
Only input is billed: state tokens, plus question tokens, plus a little request overhead, at $0.042 per million. TypeSafe says it cannot prove the price is unsubsidised and expects it to fall.5 Some anchors:
- The smallest examples in TypeSafe's docs use 310 to 590 input tokens. So the floor is about $0.000013 to $0.000025 per request.3
- At 250 tokens a decision, a million decisions cost $10.50. At 2,000 tokens, $84.
- TypeSafe's benchmark workflows average $0.0004 a case, because a case is many questions and sometimes several dependent calls. Invoice processing averages $0.0011.6
- A figure doing the rounds, 50 million rows scored for $20, implies 9.5 tokens per row. It does not survive contact with the docs. Expect hundreds of dollars. Still cheap.
Against hosted language models Jev wins by one to two orders of magnitude. Against an embeddings-plus-logistic-regression stack or a self-hosted encoder it loses by about as much. What you pay the premium for is rubric-following with no training data, plus probabilities out of the box.
The token bill is rarely the number that matters
The formula worth using prices the escape hatch and the mistakes:
total = N × c # tokens
+ N × h × c_review # escalated to a person or a bigger model
+ N × (1 − h) × e × c_fail # wrong answers nobody caught
where h is the share escalated and e is the error rate inside the automatic band. Move the sliders. At almost any realistic setting the purple sliver is invisible.
A five-point cut in the escalation rate, at a dollar per review, is worth $50,000 per million decisions. No change in token price comes close. Optimise the escape curve.
An evaluation you can defend
- At least 1,000 representative decisions, each labelled by two or three people. Their agreement with each other is your ceiling.
- Measure label agreement, expected calibration error over ten bins, Brier score, AUC, p50 and p95 latency, and cost per call.
- Sample at least three thresholds and plot accuracy against coverage. An accuracy figure without coverage hides the size of the review queue.
- Baselines, all with frozen prompts: your current system, a cheap small language model, and a supervised encoder if you have labels.
- Write down the go and no-go criteria before you look. The two public evaluations that did this both came back ambiguous. Be ready for that.
- Break-even is the one-off evaluation and integration cost divided by monthly saving. Swapping out Haiku 4.5 at a million decisions a month saves a few hundred dollars in tokens. The case is made at ten million, or by the escalation rate.
Data protection
Your data goes to California
The Privacy Policy (last updated 19 November 2025) and the Data Processing Addendum (24 April 2026) were both read in full for this dossier.78 What they say:
| Question | Answer in the documents |
|---|---|
| Is my input used for training? | No. No training or fine-tuning on Input, and no disclosure to third parties other than service providers. |
| Is it used for anything else? | Yes. Input is classed as personal data, and personal data may be used to provide, maintain, improve and debug the service, develop new products, generate anonymised or aggregated data, and fight fraud. Input judged objectionable may be disclosed. |
| How long is it kept? | "As long as reasonably necessary." The DPA adds limitation periods to the list of things that may justify keeping it. No number anywhere. |
| Zero retention? | Enterprise customers only, by email to the privacy team. Scope not public. |
| Where is it processed? | United States. EEA and UK users are told they are transferring data to the US. |
| Roles | Customer is controller, TypeSafe is processor. |
| Transfer mechanism | EU SCCs Module 2, and Module 3 where you are yourself a processor. Docking clause on. General sub-processor authorisation with a 15-day objection window. Clause 11(a) redress struck. UK addendum B1.0. No mention of the EU-US Data Privacy Framework. |
| Supervisory authority | Ireland for the EEA, the ICO for the UK, the FDPIC for Switzerland. |
| Breach notice | Within 72 hours. |
| Audit | Once every 12 months, at your cost, on agreed scope. |
| DPIA help | Provided, and may be charged for. |
| Security measures | "Reasonable efforts", no guarantees, in the policy. The DPA points to a trust centre that was not reviewed here. No SOC 2 or ISO claim appears in the policy or the DPA. |
| Special-category data | Schedule I lists sensitive data and its safeguards as N/A. |
Article 9
That last row decides it for health, biometric, union, political or similar data. The standard paperwork covers none of it. You would need negotiated terms, and enterprise ZDR with its scope in writing, before a single request.
For ordinary personal data the scaffolding is conventional and would pass most procurement reviews: SCCs, a DPA, a no-training commitment. It still means inference leaves the EU, retention is open-ended by default, and improvement and debugging are permitted uses. If your client's position is that personal data stays in the EU, Jev is unavailable to you today, and a gateway does not change that.
Risk
Safety and reliability
- Good structural properties. A bad answer can only ever be a wrong branch, since output is limited to your schema. Low confidence can route to a person. For composing AI into larger systems, that is a real improvement over free text.
- No published safety evaluation, red-team result or third-party audit.
- Injection through state is a documented weakness.4 TypeSafe's guardrail cookbooks use Jev to detect injection, and the independent benchmark says it does that well. The detector still shares the weakness it polices. Treat
stateas untrusted, and test with hostile input. - The automation hazard is specific. A confident wrong answer in the automatic band is executed and nobody sees it. Gating on confidence is the designed defence, and confidence is the least verified property of the model.
- Availability. One region, one vendor, no SLA, rate limits that TypeSafe says will change without notice. Under launch demand the company briefly lost the ability to serve its API.10
- Drift.
jev-latestwill change under you. Thresholds tuned on 1.13 mean nothing on 1.14 until re-measured.
Local-first
If the data cannot leave
There are no weights to download. There is, however, a well-evidenced substitute, and it starts from the dumbbell chart above: the workflow pattern lifts every model, so keep the pattern and change the engine.
| Option | When | What is known |
|---|---|---|
| Supervised encoder on your labelled history | You have a few thousand labelled examples | bge-small plus logistic regression: 0.933 at 9 ms on a laptop, ahead of a frontier model on Banking77.14 |
| Zero-shot encoder (GLiNER, GLiClass, clean DeBERTa-NLI) | No labels, fixed label set, CPU-friendly | Behind Jev by 5 to 27 points in the public comparisons.1516 Check the checkpoint was not trained on your test set. |
| jev-local19 | You want the same request contract on your own GPU | Implements POST /v1/systemone on open weights. Qwen3.5-9B by default. The authors report 0.82 at 0.12 s per question on Qwen2.5-3B, and sharpness close to Jev's after fitting a temperature per head. |
| Small typed decision engines (ModernBERT-151M class) | Latency and cost matter most | One reports 0.697 against Jev's 0.727 on its own test set, better calibrated, four times faster, trained on a Colab T4 in 30 minutes.17 |
| Local LLM with constrained single-token decoding | You need rubric-following with no labels at all | mini-jev on Qwen3-4B and open-alternative-jev on Qwen3.6-27B show the interface carries over. |
All of these reproduce the interface and none of them is Jev, as their authors say. You lose TypeSafe's trained calibration and you have to add your own, by temperature or Platt scaling on a held-out labelled set. Given what the independent work says about that calibration, you are giving up less than the launch material suggests.
The moat looks modest for the same reason. Bespoke Labs already ships Nimble, a model described as nearly identical in design: non-autoregressive, reading probabilities over answer tokens, same three primitives, and it publishes its own comparison against Jev. Armin Ronacher told TechCrunch he expected competitors quickly.10 It took about three days.
Recommendation
What to do with it
Trial it, off the critical path, on data that is allowed to leave
Pick one high-volume triage decision with a written rubric and a cheap failure mode. Pin the version. Run the evaluation in the cost section with the encoder baseline included. Adopt if you see an order of magnitude on cost and latency, accuracy inside your tolerance, and calibration holding within about five points per confidence bucket on your data.
Keep side effects in code
An answer from Jev is a candidate. Permissions, approvals and anything irreversible stay behind ordinary checks. Set one threshold per action. Report accuracy with coverage. Watch the escalation rate. Re-run the calibration suite before moving the pin, and after rewording any question.
Build the probe set from its known failures
Numbers, dates, negations, long noisy state, hostile state, board-like formal input, and anything that needs two documents read together. If your workload is mostly those, you have your answer without spending anything.
For regulated or residency-bound data, use the pattern locally
Decomposed workflow, open model or encoder, your own calibration layer. Come back to Jev if TypeSafe ships an EU region, a VPC deployment or weights.
What would change this
| Would raise the estimate | Would lower it |
|---|---|
| A large independent calibration study, with reliability curves, that holds across datasets | A price rise, which the subsidy question makes plausible |
| Results against human-labelled ground truth | Another capacity failure, with no SLA to show for it |
| An EU region, VPC option or open weights | An open reproduction that matches accuracy as well as sharpness |
| A paper or model card | Evidence that prompt wording keeps breaking calibration in later versions |
Jev is a good idea, well executed and honestly documented, sold on the one property that has not been shown to hold. Buy it for the speed and the type safety. Earn the calibration yourself.
Sources
What this leans on
Primary sources first, then reporting, then independent evaluations. Everything was read on 19 September 2026. Claims that rested only on aggregator blogs, forum counts or unattributed figures were left out.
- TypeSafe AI, Models. Version, aliases, price, limits, context, language support, data handling.
- TypeSafe AI, API reference. Request and response shapes, error codes.
- TypeSafe AI, Score and Choice. Level limits, the 255-option cap, the 1.3 worked example, confidence semantics, token usage in examples.
- TypeSafe AI, Jev 1.13 jaggedness, reviewed 17 Sep 2026.
- Diogo Almeida, Introducing System One Models & Jev, TypeSafe AI blog, 15 Sep 2026.
- TypeSafe AI, Workflow evals. All chart data.
- TypeSafe AI, Privacy Policy, last updated 19 Nov 2025.
- TypeSafe AI, Data Processing Addendum, last updated 24 Apr 2026.
- TypeSafe AI, Legal. ZDR for enterprise customers.
- TechCrunch, A new kind of AI model from a ChatGPT inventor is thrilling developers, 18 Sep 2026.
- SiliconANGLE, TypeSafe AI exits stealth with $40M, 16 Sep 2026. Carries the Forbes valuation report.
- Business Wire via Yahoo Finance, TypeSafe AI Emerges From Stealth With $40M, 15 Sep 2026.
- Mike Taylor, Every, Mini-Vibe Check: TypeSafe's Jev.
- ickma2311/jev-baselines-eval. Pre-registered, hash-pinned.
- AbdelStark/jev-benchmarks. Apache-2.0, artefacts with SHA-256 provenance.
- zhuyansen/jev-zeroshot-vs-bert.
- OmniJev/awesome-jev, index of independent evaluations: Lindfors, jev-sec-bench, jev-rerank-bench, the search rerank eval, calibre, the poker and chess probes, Near Here, the research-loop comparison and the open reproductions. Figures taken from the linked repositories' summaries.
- The Cherry Creek News, TypeSafe's Jev claims 193x faster and 444x cheaper. Good Start Labs figures.
- us/jev-local. Open server for the System One contract.
- Pydantic AI, pull requests #8450, #8501, #8542.
- OpenRouter: TypeSafe and Vercel changelog.
- TypeSafe AI, documentation index. Cookbook summaries: parallel questions, reranking, hierarchical classification, patterns.
- TypeSafe AI, Python SDK.
Colophon
In case you were wondering
This dossier was researched and drafted with the assistance of various agents and models, and checked against the sources above. Four earlier research passes were reconciled first, and the claims that failed the check were dropped. The charts are drawn from the numbers on TypeSafe's evals site as they stood on 19 September 2026, which TypeSafe can change. Every figure here is somebody else's measurement, labelled as such. None of it replaces a test on your own data.
The model is four days old at the time of writing. Expect parts of this to date quickly.