jev-latest now gives Jev 1.14; decision leaderboards and four new graded studies (24 Oct 2026)
This dated report records the evidence behind the update of 24 October 2026. TypeSafe moved its jev-latest alias from Jev 1.13 to Jev 1.14 between two daily checks, without a dated announcement; the pages that name a default model now say what an unpinned request gets. The benchmarks page gains a section on the four decision leaderboards that list Jev, with vendor rank claims checked against each leaderboard's own data, and four newly graded studies. No Jev call was made, no route was called, nothing was submitted to a leaderboard and no benchmark was run.
Aliases: since 24 Oct 2026, jev-latest on TypeSafe's API gives jev-1.14.0; jev-1.13.0 is still callable by its ID, with no deprecation date. Opper's typesafe/jev-latest still gave 1.13 that morning.
Leaderboards: four decision leaderboards read on 24 Oct 2026 list Jev. Base Labs' "#1 of 208" claim matches the Jev Decision Index's 20 Oct data (version 0.4) but not its current 22 Oct data (0.4.1).
Ledger: 45 graded rows (A 14, B 14, C 10, D 7) after four additions. Five grade-A comparisons of Jev with OpenAI's Decisions API differ by task; there is no overall direction.
OpenAI's Decisions API now prices cached input and cache writes: since general availability on 22 Oct 2026 its guide says cache hits get discounted input pricing and cache writes are charged; the beta wording of 13 Oct said there were no cache charges.
What jev-latest gave on TypeSafe's API, by check (UTC)
- (post date)
jev-1.13.0TypeSafe's post releasesjev-1.14.0underjev-previewand says "jev-latest will be updated to jev-1.14.0 in a week". jev-1.13.0Last check that still showed 1.13, nine days after the post; no date for the move was published.jev-1.14.0First check that showed 1.14.jev-previewalso gives 1.14: "There is no preview build available right now." The move happened between these two checks; its exact time is unknown.
TypeSafe published no dated statement of the move: its blog lists the same seven posts, and its docs changelog returns HTTP 404 (R23-S08, R23-S21). X could not be searched, so a post there is not ruled out.
What the move means if you do not pin a version
- SDK defaults. TypeSafe's Python and TypeScript SDKs and the Vercel AI SDK provider send
jev-latestunless you name a model, and their versions did not change (typesafe-sdk0.7.5,@typesafe-ai/sdk0.7.0,@ai-sdk/typesafe-ai3.0.26; registry check 24 Oct 2026, 05:18 UTC; R23-S41). On TypeSafe's API those requests now get Jev 1.14 with no change to your code. Details: Python, TypeScript. - Integrations that send
jev-latest. Of the Claude Code and MCP integrations read in source, oh-my-claudecode,jkudish/jev-mcp, claude-model-guard and claude-jev-advisor sendjev-latest, so on TypeSafe's API they now get 1.14; ohmyjev pinsjev-1.13.0and does not move. These pins are as published on Claude Code and MCP; the files were not re-read on 24 Oct. - Thresholds. TypeSafe's models page: "If you have tuned confidence thresholds against one version, send that version's ID instead of the alias, and switch to the new version when you are ready." Each response's
modelfield gives the versioned ID that answered (R23-S05). How to set a cutoff: confidence thresholds. - Jev 1.13.
jev-1.13.0is still listed with its own ID and the same price ($0.042 per million input tokens, output free) and no deprecation date. TypeSafe's 14 Oct post says it "will be available for a while" and that TypeSafe intends to give "60 days warning" before deprecating it (R23-S05, R23-S09). Whether a request by that ID still works was not tested. - Limits. The models page gives Jev 1.14 the same context limits and price as 1.13; its only linked accuracy page is still the one for Jev 1.13 (limitations).
Six routes: what each publishes for jev-latest
| Route | What it publishes | jev-latest as published |
|---|---|---|
| TypeSafe direct | jev-latest and jev-preview point to jev-1.14.0; jev-1.13.0 by its ID (R23-S05) | Moved to 1.14 |
| Opper | typesafe/jev-1.13.0 with the alias typesafe/jev-latest; typesafe/jev-1.14.0 with the alias typesafe/jev-preview (R23-S27) | Still jev-1.13.0 at 05:15 UTC |
| OpenRouter | typesafe/jev-1.13 and typesafe/jev-1.14; ~typesafe/jev-latest "always redirects to the latest model in the Jev family" (R23-S22 to R23-S24) | Target not stated |
| Vercel AI Gateway | typesafe-ai/jev (unversioned), typesafe-ai/jev-1.13.0, typesafe-ai/jev-1.14.0 (R23-S25, R23-S26) | No jev-latest alias; which version typesafe-ai/jev serves is not stated |
| Netlify AI Gateway | jev-1.13.0, jev-1.14.0, jev-latest, jev-preview, jev-router on its overview (R23-S30) | Target not stated |
| Cloudflare | typesafe/jev (unversioned; its example responses show "model": "jev-1.13.0") and typesafe/jev-1.14.0 (R23-S28, R23-S29) | No jev-latest alias; which version typesafe/jev serves now is not stated |
So the same alias name gave a different version on Opper than on TypeSafe's own API that morning. Send a versioned ID if the version matters. Full table: versions and aliases. Documented
Four decision leaderboards that list Jev
Each leaderboard was read at a pinned commit or with its access time, and Jev's position was counted from the operator's own data. Positions are listings at one time, not accuracy results; they sit outside the ledger, carry no grade and are not combined. Reported
- Jev Decision Index (community Hugging Face Space, "not affiliated with TypeSafe AI"; version 0.4.1 at commit
0b5ecaf, 22 Oct): the headline score rests on private tests that are "never published"; per-model scores are public for 37 benchmarks. Jev 1.14: 60.24, 41 of 229 as listed. Its own history shows the "Decision Index 0.2" that an earlier ledger row (B18) cites. - Artificial Analysis Decision Index (version 1.0; read 05:16 UTC): Jev 1.14 57.07, 17 of 32 entries as listed; per-item results not found.
- JevMan (Opper's Pac-Man benchmark; Opper serves the listed models): jev 1.14 mean score 3597, 1 of 12 as listed in the 21 Oct file, next 3416; the page's tie rule was not applied.
- JevBench (Leanmcp; data of 16 Oct, not pinned to a commit): Jev 1.13 76.5, 3 of 18 as listed; no Jev 1.14 row.
Claims checked against the data: Base Labs' "#1 of 208" for mammoth-1 matches at 20 Oct (71.24, first of 209 entries) and not at 22 Oct (68.44, shown "=3"); elephant-1 "beating Jev 1.14" matches by 0.02 points, inside one tie band; Jeffan-31B's "#1" matched as a tie on 21 Oct and not from 21 Oct, 22:37 UTC; Baseten's Artificial Analysis figures (65.9 and 65.2) do not match the 24 Oct listing; the Artificial Analysis article's "Jev 1.13 leads ... with 58" does not match its live data; Eevo's JevMan claim holds against Jev 1.13, not 1.14; Decido's "published" Jev mean is its own average and cannot be checked. Every claim and its evidence: benchmarks.
Four newly graded studies
| Row | Operator and task | Result as reported | Grade |
|---|---|---|---|
| B45 | gbolask24/decision-bench at e5b7202 (an individual; no stake found): five public classification tests, 7,070 items, one with product photos; Jev 1.14 vs OpenAI's Decisions API, with Claude Opus 5.5 on a sample. Run 17 Oct 2026, while the Decisions API was in public beta. | Accuracy: "no detectable difference" on three tests, "Jev ahead" on two; Brier: Jev better on all five. Opus ahead of Jev on two of five sample tests. | A; public-data, small-n for the Opus arm. Per-call logs referenced in the README are not in the repository. |
| B46 | jcarlosrodicio/subq-vs-jev at c037905 (independent): questions over synthetic event logs of 2K–360K tokens; Jev 1.13 vs SubQ Snap; run 13 Oct 2026. | Up to 30K tokens: Jev 94.7%, Snap 93.9% (intervals overlap). At 360K, with the log split into chunks by the operator: Jev 77.1%, Snap 58.8%. | A; single-task |
| B47 | kapa.ai (a RAG vendor, own sealed benchmark; reranking-pipeline study): 1,000 production-derived cases, six rerankers. | Voyage rerank-3 0.535, Jev 1.14 0.532, Voyage rerank-2.5 0.526, Cohere v4.0-pro 0.506; Jev 1.13 0.519. | C; COI, sealed, single-task |
| B48 | Sayora (an AI-receptionist company; relevance-judgment study): 168 generated questions over four sites, LLM-judged labels. | Right page first: Jev 1.13 88%, production embeddings 70%, GPT-6 Luna 86% (a tie by its interval). | C; LLM-labels, small-n, sealed, single-task |
The ledger now has 45 graded rows: A 14, B 14, C 10, D 7. Graded comparisons with OpenAI's Decisions API: 6; with Microsoft-Decision-1: 2; with SubQ Snap: 2. Against small text-generating LLMs the count is unchanged (ahead in 6 of 10 graded studies). egarim/decision-1-vs-jev was read and is not a Jev comparison: it compares Microsoft-Decision-1 with a self-hosted reproduction named open-jev. Nine benchmark-named repositories created on 23–24 Oct are listed as leads, not opened. Pages that quote these grades were updated with the same grades and flags: alternatives, the decision-API comparison and reranking and RAG.
Access and notices
Checked 24 Oct 2026, 05:12 UTC: signups open, no free credit for new users, API operational ("All services are online"; no new incident since 14 Oct); price unchanged at $0.042 per million input tokens for both versions. Home shows three notices: no credit for new users, the jev-latest move (added; it comes off after seven days or sooner if superseded) and lookalike resellers. None was retired. Details: access status. Documented
What the daily scan covered
Window: 23 Oct 2026, 05:18 UTC to 24 Oct 2026, 05:11 UTC (23 h 53 min), with no gap or overlap with the previous window, plus a 72-hour look-back. Found: the alias move; Opper's alias lag; OpenAI's post on general availability (not opened); an opinion piece on Jev's hype cycle (not a catalogue item); a coding-agent review-loop article (lead); nine benchmark-named and about twelve other new repositories (names only). Lead checks: the eu/jev pull request to LiteLLM (#46875) is still open; IntelligenceLab/Jev-Vision models and sdmlai/nano-jev are Jev-named and not published by TypeSafe. Not searchable or not reachable: Reddit (HTTP 403), X, YouTube, TikTok and GitHub code search.
What was not checked
- The exact time of the
jev-latestmove, and whether a post on X announced it. - What any route returns for an alias today: no request was sent to TypeSafe, Opper, OpenRouter, Vercel, Netlify or Cloudflare.
- The Jev Decision Index 0.2 data, its private item counts, Artificial Analysis's display rounding and page history, JevMan's tie display and a JevBench commit.
- B45's per-call logs (referenced but not in the repository), B46's 360K figure line by line and its raw answers, and any materials for B47 and B48 (none are published).
- The Claude Code integrations named above were not re-read on 24 Oct; their published pins are used.
- Amazon Bedrock, Azure AI Foundry and Workers AI catalogs were not re-read on 24 Oct; their last dated lines stand.