When Jev fails (TypeSafe AI)
What do real Jev implementations do when Jev returns an error, a malformed answer or an unsure answer, when no API key is set, or when a code path skips Jev? This page counts the answers across 80 implementations in twelve use cases, already published row by row on their domain pages, and turns them into an eight-question checklist for your own code. The title is an internal label: six failure phrases ("jev fallback", "jev timeout", "jev error handling", "jev fail open", "jev retry", "typesafe api error") got no relevant autocomplete suggestion on Google, YouTube, Bing or DuckDuckGo when the pool checked on .
For all 80 counted implementations, every failure cell (no key, error, malformed answer, below threshold and bypass) is recorded from source at pinned commits (19 Oct 2026).
Of 80 Jev implementations read in source, on a Jev error 40 stop or hold the action, 22 fall back, 10 let it through, 5 return no decision and 3 are advisory. The 10 that let it through are 4 moderation bots, 4 agent hooks, a passage filter and an eval tool.
With no API key, 51 of 80 implementations refuse to start, error or hold; 17 fall back, 9 proceed as if allowed and 3 are advisory (source read at pinned commits; recounted 19 Oct 2026).
Code paths that never ask Jev are recorded for all 80 implementations (source at pinned commits, 19 Oct 2026): 13 "none found" in the files read, 67 with their skip paths listed.
The eval tool is openlayer jevals: its report counts an errored eval as passed and its gate allows by default. Counting 9 fallbacks that can still end in the action as well, the action goes ahead on a Jev error in 19 of 80 (10 fail-open plus 9 fallbacks; details).
"Keep the last action" counts as going ahead: doom-jev and JevPlaysSnakeGame keep acting on a choice Jev did not make for this tick (counting choice, 12 Oct 2026).
The 4 agent hooks are danna-zhou/jev-mcp (PreToolUse hook), claude-model-guard (a model-tier guard, added 18 Oct 2026) and ohmyjev (Bash, Write/Edit and exfiltration gates in lockdown mode without shadow, both off by default; added 19 Oct 2026, re-read at 0.14.0 on 8 Nov 2026) for Claude Code, and jev-judge for Hermes Agent, in enforce mode (its default is shadow).
Implementations were picked per domain page as stated there, not as a survey. The counts describe these 80 implementations at their pinned commits; they are not a rate for Jev integrations in general. "Not recorded" means the domain page and its research note do not record the cell; it is never inferred. n = 80 in every count. The official TypeSafe Claude Code plugin makes no runtime Jev call, so it is excluded from every denominator; the trycua/cua jev-use example calls a mock provider by default and is not counted either. Judge tools count from 7 Oct 2026: a judge whose own code turns Jev's answer into a score, pass/fail or gate is an action (an error that becomes a pass is fail-open; a dropped item is no-decision). The four judge tools on Jev as a judge form the LLM as a judge domain. The Jevals harness on Jev as a judge is not counted: its code is not public, so its failure cells are Reported from its methodology page, not read at a pinned commit. From 8 Oct 2026 a reranker counts when its own code reorders or cuts results, and a document pipeline when its own code acts on Jev's answer: LiteLLM's compaction guardrail, jev-reranker and LanceDB's TypeSafeReranker are counted under Frameworks (see Jev reranker and Jev for RAG), pg-redact under Content moderation and docjev under Email and lead (see Jev inside SQL and document pipelines). These are nearest domains: no new domain reached 3 rows. The three SQL extensions are listed but not counted. From 12 Oct 2026 three game and robot-simulation demos that call Jev by default form the Real-time control (games and simulations) domain; ra2web (calls a local substitute by default) and llm-invaders (a research harness) are listed on Jev plays Doom: what real-time demos do when a Jev call fails and not counted. n8n nodes are counted with Continue On Fail (COF) off, the default; the COF-on result is given beside them. The pool ran nothing for this page: no bot, no browser agent, no eval, no Jev call.
Change, 8 Nov 2026: ohmyjev re-read at 0.14.0 (commit fbc4ea4). Its four failure cells are unchanged. A new shadow setting, off by default, runs the lockdown checks but blocks nothing, and in-repo mkdir, touch, cp and mv now skip Jev. Every total is unchanged (still 80 implementations). Documented (R28-S20 to R28-S23)
Change, 2 Nov 2026: ohmyjev re-read at 0.13.2 (commit d307c39). Its gates now run only with the lockdown setting on, and lockdown is off by default. In lockdown mode its five cells keep the same terms, so every total is unchanged (still 80 implementations). The row now names the mode; its bypass cell records the default skip and the removed auto-approve path.
Change, 23 Oct 2026: the two jev-gateway repository links now point to vinilana/jev-gateway at the same commit 37ff982, the repository named in its npm metadata; the earlier links returned HTTP 404 on 23 Oct 2026, 05:34 UTC (R22-S52, R22-S53). No cell or count changed.
Change, 21 Oct 2026: the ohmyjev row names its pi and omp adapters, read at the same commit with the same five terms (still 80 implementations); one file reference in its bypass cell corrected.
Change, 20 Oct 2026: a self-check compares your own choices in the five failure conditions with the 80 rows (same counts as the map; no count changed). Checklist question 9 added: whether your code logs or shows a fallback or fail-open (not counted across the 80). The summary lines under each domain heading now give the n 80 numbers.
Change, 19 Oct 2026: ohmyjev (Claude Code module) added, read at its pinned commit after its pi and omp adapters were read in full. n 79 → 80; Claude Code / MCP guards 8 → 9. On a Jev error fail-open 9 → 10; action goes ahead 18 of 79 → 19 of 80. No key: fail-open 8 → 9. Malformed: fail-open 12 → 13. Below threshold: acts-anyway 15 → 16. Bypass recorded 79 → 80 ("none found" stays 13; skip lists 66 → 67). No existing cell changed. jkudish/jev-mcp now cites the commit its cells were read at (53fe575, 0.11.0) with the later 0.14.1 check on its own line; the jev-support-desk timeouts are marked as SDK defaults.
Change, 18 Oct 2026: two Claude Code rows added, read at their pinned commits: claude-model-guard (fail-open on a Jev error, a malformed answer and no key; advisory below threshold) and claude-jev-advisor's Windows rm hook (the guard's own ask stands in every failure case). n 77 → 79; Claude Code / MCP guards 6 → 8. On a Jev error fail-closed 39 → 40 and fail-open 8 → 9; action goes ahead 17 of 77 → 18 of 79. No key: fail-closed 50 → 51, fail-open 7 → 8. Malformed: fail-closed 35 → 36, fail-open 11 → 12. Below threshold: held 16 → 17, advisory 4 → 5. Bypass recorded 77 → 79 ("none found" stays 13; skip lists 64 → 66). No existing cell changed.
Change, 16 Oct 2026: the last 11 bypass cells and the last malformed cell were read at their pinned commits; every failure cell is now recorded for all 77. Bypass recorded 66 → 77, not recorded 11 → 0 (judge tools 4, frameworks 3, browser agents 3, email 1). Malformed: competitor-hunter is now no-decision (an unreadable reply leaves the item out of its ranking), so no-decision 3 → 4 and not recorded 1 → 0. JevPlaysSnakeGame's bypass cell now rests on the whole repository (still "none found"; count unchanged). Cell texts corrected with the term unchanged: openlayer jevals and second-look (malformed), did-they-answer, competitor-hunter and the ilyamk Gmail labeler (Jev error), Spring AI JevDocumentFilter (below threshold and no key); a scope note added to DeepEval JevEval (Jev error).
Change, 14 Oct 2026: no-key, bypass and n8n below-threshold cells settled for ticket triage, email and lead sorting, n8n, browser and computer use, and three single rows (jev-trader, hermes-jev-mana, jev-mcp), read at the published pins; n8n's own missing-credential path read at release n8n@2.44.1. No key: not recorded 8 → 0; fail-closed 43 → 50, fallback 16 → 17. Bypass recorded 52 → 66, not recorded 25 → 11 (judge tools 4, frameworks 3, browser agents 3, email 1); a cell counts as recorded only when every entry point was read. Below threshold: no-threshold 20 → 25, not recorded 5 → 0. zammad-jev-dispatcher's malformed cell now separates a held off-list choice from the 502 for a missing probabilities map; jev-for-chrome's below-threshold cell notes a second look for a final 'done' or 'blocked' below 0.5.
Change, 13 Oct 2026: no-key and bypass cells settled for model routing and content moderation (read at the published pins). No key: not recorded 18 → 8; fail-closed 38 → 43, fallback 14 → 16, fail-open 4 → 7. Bypass recorded 44 → 52, not recorded 33 → 25. Model routing and content moderation now have no not recorded no-key or bypass cells. Malformed: agent-router is now fail-closed (exit code 2; it was not recorded), so malformed fail-closed 34 → 35 and not recorded 2 → 1 (counting choice). Qualifiers added without a count change: jev-router below threshold (an upgrade capped at sonnet), autojev on named Jev routes (equal load balancing) and its bypass (10 paths), jev_antispam_bot bypass (3 more skip paths).
Change, 12 Oct 2026: three real-time demo rows added (doom-jev, jev-robotics-demo, JevPlaysSnakeGame) in a new domain, Real-time control (games and simulations). n 74 → 77; on a Jev error fail-closed 38 → 39 and fallback 20 → 22; action goes ahead 15 → 17 (now of 77); malformed fail-closed 33 → 34, fallback 22 → 24; below-threshold no-threshold 18 → 20, no-decision 4 → 5; no-key fail-closed 36 → 38, fallback 13 → 14; bypass recorded 41 → 44; 11 → 12 domain tables.
Change, 11 Oct 2026: three coding-agent rows added (jev-triage, the jev-for-all start launcher and hermes-jev-mana; counting choice), all routing fallbacks. n 71 → 74; on a Jev error fallback 17 → 20 (routing fallbacks 5 → 8); action goes ahead stays 15 (now of 74); malformed fallback 19 → 22; below-threshold fallback 9 → 12; no-key fallback 11 → 13; no-key not recorded 18 → 19 with the new rows, then 19 → 18 and fail-closed 35 → 36 because LanceDB's no-key cell, read on 11 Oct, is now fail-closed (it was not recorded); bypass recorded 38 → 41; Coding agents domain 10 → 13.
What the 80 do, condition by condition
80 implementations per condition: each bar is split by what the code does (default settings)
- Jev error or timeoutHTTP error, rate limit, timeout; n8n with Continue On Fail off · n = 80 · not recorded 0/80
- 40/80 fail-closed
- 22/80 fallback
- 3/80 advisory
- 5/80 no-decision
- 10/80 fail-open
- 0/80 not recorded
action goes ahead 19/80 on a Jev error: the 10 fail-open rows (4 content-moderation bots, the danna-zhou hook, claude-model-guard, added 18 Oct, ohmyjev in lockdown mode, added 19 Oct, jev-judge in enforce mode, the Spring AI passage filter and openlayer jevals, whose report counts an errored eval as passed) plus 9 fallbacks that can still end in the action (QuantDinger after its LLM fallback; btc-hft-jev through rules-only; jev-permission-gate, where Claude Code's built-in classifier can still allow; rh-guard, where its lexical detectors can still allow; opencode-tool-gate, where OpenCode's default rules allow every tool, checked at v1.18.35; jev-approvals, where Hermes core hands the question to the main agent model, which can approve the command, corrected 8 Oct; jev-gateway, where the request passes through, the agent's own model picks the tool and the call runs, added 10 Oct; doom-jev and JevPlaysSnakeGame, which keep applying the last action, added 12 Oct). Not counted here: the 8 routing fallbacks (the 4 model routers; jev-effort-router, which keeps the operator's configured model; jev-triage, which passes the message to the main model; the jev-for-all launcher, which starts the default model; and hermes-jev-mana, which runs the original Hermes branch, added 11 Oct), the LlamaIndex reranker and LiteLLM's compaction guardrail, which return another model, the retriever's order or the uncompacted request by design; osuki, whose fallback routes to the default tier (the same routing-fallback convention; on the coding-agents page its tool call still runs); second-look, which shows a recommendation to a person and takes no action; jev-curator, which holds; DeepEval, which aborts the run; and did-they-answer and competitor-hunter, which drop the item.
- Malformed answerunknown option, missing field, bad probability · n = 80 · not recorded 0/80
- 36/80 fail-closed
- 24/80 fallback
- 3/80 advisory
- 4/80 no-decision
- 13/80 fail-open
- 0/80 not recorded
- Below thresholdJev answers but is unsure; separate terms, never added to the error totals · n = 80 · not recorded 0/80
- 17/80 held
- 12/80 fallback
- 5/80 advisory
- 5/80 no-decision
- 16/80 acts-anyway
- 25/80 no-threshold
- 0/80 not recorded
- No API key configuredn = 80 · not recorded 0/80
- 51/80 fail-closed
- 17/80 fallback
- 3/80 advisory
- 0/80 no-decision
- 9/80 fail-open
- 0/80 not recorded
- Bypassa code path that acts without asking Jev · n = 80 · not recorded 0/80
- 80/80 recorded
- 0/80 not recorded
The same numbers as tables:
| Condition | n | fail-closed | fail-open | advisory | fallback | no-decision | not recorded |
|---|---|---|---|---|---|---|---|
| Jev error or timeout | 80 | 40 | 10 | 3 | 22 | 5 | 0 |
| Malformed answer | 80 | 36 | 13 | 3 | 24 | 4 | 0 |
| No API key configured | 80 | 51 | 9 | 3 | 17 | 0 | 0 |
| Condition | n | held | acts-anyway | fallback | no-decision | advisory | no-threshold | not recorded |
|---|---|---|---|---|---|---|---|---|
| Below threshold | 80 | 17 | 16 | 12 | 5 | 5 | 25 | 0 |
| Condition | n | recorded | not recorded |
|---|---|---|---|
| Bypass | 80 | 80 | 0 |
Counting judgements in the 5, 6, 7, 8, 10, 11, 12, 14, 16 and 18 Oct recounts
- second-look is counted as a browser row although it never acts: it recommends, and a person buys.
- second-look (kaushiksiva/second-look,
0c05d16) is counted here in the browser domain (8 rows); the browser page counts 7 agents, the ones that click, type or tap, and shows second-look separately because it only recommends. - The JS
autoModeMiddleware(@langchain/typesafe0.0.2) is counted under frameworks, separately from the Python AutoModeMiddleware already counted on Claude Code / MCP guards. - Pydantic AI
TypeSafeModelis not a decision row: it raises Jev errors to the agent the builder writes. Its behaviour is on framework integrations. - ironbee-express with no key is counted fail-open (conditional: a cached recording replays unjudged), following the 4 Oct convention for conditional cells.
- 6 Oct: gulbaki/jev-llm-guard is not counted: it returns a verdict; it is not a decision. Its
jev-guardCLI exits 0 whatever the verdict (allow, review or block) and exits 1 only on errors. - 6 Oct: jev-judge (Hermes Agent) is counted although its default is shadow (logs only); its cells describe enforce mode.
- 6 Oct: osuki (OpenCode) is not counted in the "action goes ahead" line: its fallback routes to a default tier, under the same routing-fallback convention as the model routers and LlamaIndex.
- 7 Oct: the four judge tools on Jev as a judge are counted as the "LLM as a judge" domain (4 rows), with the same cells and colours as on that page. DeepEval counts although it is a library: its own test runner in the same repository aborts the run or fails the test case. The Jevals harness is not counted: its code is not public.
- 7 Oct: conditional judge cells follow the 4 Oct convention (the default configuration counts; the condition is in the note). openlayer: a Jev error is fail-open (the report says
passed; the gate allows by default), and its no-key cell is not recorded because neither the page nor its research note says which backend branch is the default. did-they-answer: malformed is fail-closed (missing answer keys stop the run); the missing-usagecase alone gives no-decision. competitor-hunter: a Jev error is no-decision; above 5% errors the run aborts. - 7 Oct: the Hermes plugins jev-approvals and jev-curator are now counted (they were "not settled" on 6 Oct). Hermes core v2026.9.24 runs an APPROVE without a person and sends errors to a person. Both do nothing until switched on: jev-approvals is off after install (core default
manual), and jev-curator observes by default. Their cells describe the switched-on modes. - 7 Oct: settled without a count change: rh-guard's default mode is
enforce; opencode-tool-gate's "action goes ahead" holds under OpenCode's default rules (v1.18.35: every tool allowed); osuki checked at 0.2.8, failure path unchanged. - 8 Oct: five rows added under the 8 Oct rule (a reranker counts when its own code reorders or cuts results; a document pipeline when its own code acts on Jev's answer). LiteLLM's TypeSafe compaction guardrail, jev-reranker and LanceDB's TypeSafeReranker go under Frameworks, where the Spring AI passage filter and the LlamaIndex reranker already sit; pg-redact (PII redaction before storage) under Content moderation; docjev (document splitting) under Email and lead. "Reranking and RAG" and "Data and documents" would each hold 2 rows, so neither domain is formed and no existing row moves.
- 8 Oct, three counting choices: LiteLLM's compaction guardrail is counted although the results it removes are tool outputs, not retrieved passages (without it n would be 68); pg-redact's malformed cell is fail-open (a missing span answer stores the span unredacted; a broken body gives 502); openlayer's no-key cell is fallback-another backend (it fails closed if no other backend is configured).
- 8 Oct, corrected: jev-approvals no longer counts as fail-closed on a Jev error. On a timeout, connection error, 429 or 402, Hermes core v2026.9.24 hands the approval question to the main agent model, which can approve the command; only other HTTP errors still go to a person. It moves to fallback and into the "action goes ahead" line. Also filled on 8 Oct: jev-curator's malformed (fail-closed), below-threshold (held) and no-key (fail-closed) cells, and openlayer's no-key cell. rh-guard's below-threshold text was clarified (0.5 is Jev's choice confidence; REVIEW_THRESHOLD 0.45 is a risk-label floor); its term is unchanged.
- 10 Oct: two coding-agent rows added (counting choice). jev-effort-router is a routing fallback, like osuki: on a Jev error, a wholly malformed answer or no key the request is left untouched and the turn runs on the operator's configured model, so it is not in "action goes ahead". Below its 0.5 cut the code rewrites the request to deepseek-v4.1-flash at medium effort (
fallback-default model). jev-gateway passes the request to the agent's own model on a Jev error, a malformed answer or an unsure answer; that model picks the tool and the call runs, so jev-gateway is one of the 7 fallbacks that can still end in the action. Its below-threshold cell isfallback-agent's own model, notacts-anyway, because Jev's answer is not used. With no key the gateway does not start (fail-closed). jev-triage and hermes-jev-mana were read on 10 Oct but are not settled on coding agents, so they were not counted then; both are counted from 11 Oct (next item). - 11 Oct: three coding-agent rows added (counting choice), all routing fallbacks, so none is in "action goes ahead". jev-triage (OpenClaw) makes the host skip the main model for "thanks" and "spam"; on any failure the message goes to the main model as if the plugin were absent. The jev-for-all
startlauncher is counted on the launcher only; on any failure it starts the default tier at medium effort, and its OpenCode plugin part is not settled. hermes-jev-mana is counted under the 7 Oct rule (a plugin that is off or observe-only after install still counts, with its state next to the row): inert after the documented install, becauseadmit_unlabeleddefaults to false and every Jev call is refused; its cells describe the mode withadmit_unlabeled: true, where an error, a malformed or an unsure answer runs the original Hermes branch. Its no-key cell is not recorded. - 12 Oct: three real-time demos counted (counting choice): doom-jev, jev-robotics-demo and JevPlaysSnakeGame call TypeSafe's Jev by default and their own code applies the move, so they form the Real-time control (games and simulations) domain (3 rows). ra2web is listed on the real-time page as a design contrast and not counted: it calls a local substitute by default. llm-invaders is listed there as a research harness and not counted: no model player is the default, and it reaches Jev through OpenRouter. "Keep the last action" counts as "action goes ahead": the loop keeps acting on a choice Jev did not make for this tick. Cell-level judgements: doom-jev's malformed cell is an inference from the 11 Oct 2026 read (no validation); JevPlaysSnakeGame's no-key cell rests on the SDK raising a catchable error for a missing key (typesafe-sdk 0.7.4, the version the demo locks), and its bypass cell covered
engine.pyL96–151 only until 16 Oct, when the whole repository was read (still none found); jev-robotics-demo's no-key and timeout cells depend on the SDK version, which the demo does not pin (values for 0.7.x). - 14 Oct (editorial decision): a bypass cell counts as recorded only when every entry point was read. Four rows read only in part stay
not recorded: the ilyamk Gmail labeler, jev-android, jev-for-chrome and second-look; the skip paths found in the Gmail labeler and second-look are shown in their cells. Judgement cells settled 14 Oct: jev-trader no key (fail-closed withMODEL=jev; the default model ismock), hermes-jev-mana no key (thejevCLI, which reads the key, was not read), taifoon and zampierid4p no key, DomMonte bypass, and the official and vibe-with-me-tools below-threshold cells (optional outputs; defaults partly read). zammad-jev-dispatcher's malformed cell staysfail-closed: the malformed column has no "held" term, so the held off-list choice is in the note. - 16 Oct (editorial decision): four bypass cells count as recorded with their read scope named in the cell. openlayer jevals: every entry point in full except the documentation helper
integrations/_docs.py, read at its function and return lines (it builds a help text and runs no evaluation). competitor-hunter: all code and web scripts in full; the markup of its two HTML pages checked by script for event handlers (none found), their inline scripts read. ilyamk Gmail labeler: entry functions found by a scripted scan of triggers, menus and web-callable handlers inCODE.gs; helper functions on the path to the Jev call not read in full. LlamaIndex JevRerank: the postprocessor in full; its Cloudflare and Vercel provider clients at their branch, return and raise lines. - 16 Oct (editorial decision): competitor-hunter's malformed cell is
no-decision, with the fail-closed case as a note, as its Jev-error cell is written: an unreadable reply is caught like a Jev error and the item is left out of the ranking (jev.pyL149, caught athunt.pyL565-566); a reply missing its answers stops the ranking stage (hunt.pyL778, L796). second-look's malformed cell staysfallback-heuristic verdict: a verdict outside the four known values is a narrower case, noted in the cell (research.pyL203-204; caught on the voice path,live.pyL123-125). - 18 Oct (editorial decision): claude-model-guard is counted although it is a model-tier gate, not a safety gate: its own code blocks a prompt on Jev's answer. Its bypass cell rests on every entry point at the pin (the git tree, 24 files).
- 18 Oct (editorial decision): claude-jev-advisor's
rmhook is counted withfail-closed(held) cells: its own guard asks before a deletion, and Jev can only lift that ask when every target scores at least 0.8. Only thermhook is a tool-call path; its context, status-line and CLI entry points make no permission decision. It installs on Windows only. - Listed but not counted: the three SQL extensions on Jev inside SQL and document pipelines (pg-jev, sqlite3-jev, sqlite-jev). Their value goes back into your query, which decides what to do with it; a Jev error still aborts the statement, as that page shows.
The same counts by domain
Open a condition to see its counts per domain. Opening one closes the others. Each row sums to its n; "not recorded" is a column of its own. The domain name links to the page with the per-project rows.
Jev error or timeoutfail-closed 40, fail-open 10, advisory 3, fallback 22, no-decision 5 (of 80)
| Domain | n | fail-closed | fail-open | advisory | fallback | no-decision | not recorded |
|---|---|---|---|---|---|---|---|
| Ticket triage | 5 | 4 | 0 | 0 | 1 | 0 | 0 |
| Model routing | 6 | 1 | 0 | 0 | 4 | 1 | 0 |
| Content moderation | 7 | 2 | 4 | 0 | 0 | 1 | 0 |
| Claude Code / MCP guards | 9 | 2 | 3 | 3 | 1 | 0 | 0 |
| Email and lead | 6 | 5 | 0 | 0 | 0 | 1 | 0 |
| n8n nodes (COF off) | 5 | 5 | 0 | 0 | 0 | 0 | 0 |
| Trading and fraud | 7 | 5 | 0 | 0 | 2 | 0 | 0 |
| Browser and computer use | 8 | 7 | 0 | 0 | 1 | 0 | 0 |
| Frameworks | 7 | 4 | 1 | 0 | 2 | 0 | 0 |
| Coding agents | 13 | 3 | 1 | 0 | 9 | 0 | 0 |
| LLM as a judge | 4 | 1 | 1 | 0 | 0 | 2 | 0 |
| Real-time control (games and simulations) | 3 | 1 | 0 | 0 | 2 | 0 | 0 |
| All | 80 | 40 | 10 | 3 | 22 | 5 | 0 |
n8n with COF on: fallback 4, no-decision 1 (of 5). The action goes ahead on a Jev error in 19 of 80: the 10 fail-open rows plus 9 fallbacks (2 trading, jev-permission-gate, rh-guard, opencode-tool-gate, jev-approvals, jev-gateway, and doom-jev and JevPlaysSnakeGame, which keep the last action). osuki's default-tier fallback, jev-effort-router's configured model, jev-triage's main model, jev-for-all's default model, hermes-jev-mana's original Hermes branch and LiteLLM's uncompacted request are not counted there (routing-fallback convention).
Malformed answerfail-closed 36, fail-open 13, advisory 3, fallback 24, no-decision 4, not recorded 0 (of 80)
| Domain | n | fail-closed | fail-open | advisory | fallback | no-decision | not recorded |
|---|---|---|---|---|---|---|---|
| Ticket triage | 5 | 4 | 0 | 0 | 1 | 0 | 0 |
| Model routing | 6 | 1 | 0 | 0 | 4 | 1 | 0 |
| Content moderation | 7 | 0 | 6 | 0 | 0 | 1 | 0 |
| Claude Code / MCP guards | 9 | 2 | 3 | 3 | 1 | 0 | 0 |
| Email and lead | 6 | 4 | 0 | 0 | 1 | 1 | 0 |
| n8n nodes (COF off) | 5 | 5 | 0 | 0 | 0 | 0 | 0 |
| Trading and fraud | 7 | 3 | 2 | 0 | 2 | 0 | 0 |
| Browser and computer use | 8 | 6 | 0 | 0 | 2 | 0 | 0 |
| Frameworks | 7 | 4 | 1 | 0 | 2 | 0 | 0 |
| Coding agents | 13 | 4 | 1 | 0 | 8 | 0 | 0 |
| LLM as a judge | 4 | 2 | 0 | 0 | 1 | 1 | 0 |
| Real-time control (games and simulations) | 3 | 1 | 0 | 0 | 2 | 0 | 0 |
| All | 80 | 36 | 13 | 3 | 24 | 4 | 0 |
The 2 trading fail-open cells (jev-trader, fraud-jev) depend on the shape of the bad answer. jev-agent-browser is counted as a fallback (semantic target resolver), but the target it picks by word overlap is then clicked.
Below thresholdheld 17, acts-anyway 16, fallback 12, no-decision 5, advisory 5, no-threshold 25, not recorded 0 (of 80)
| Domain | n | held | acts-anyway | fallback | no-decision | advisory | no-threshold | not recorded |
|---|---|---|---|---|---|---|---|---|
| Ticket triage | 5 | 4 | 0 | 0 | 0 | 0 | 1 | 0 |
| Model routing | 6 | 1 | 0 | 2 | 1 | 0 | 2 | 0 |
| Content moderation | 7 | 1 | 4 | 0 | 0 | 1 | 1 | 0 |
| Claude Code / MCP guards | 9 | 2 | 2 | 1 | 0 | 4 | 0 | 0 |
| Email and lead | 6 | 1 | 2 | 2 | 1 | 0 | 0 | 0 |
| n8n nodes (COF off) | 5 | 0 | 0 | 0 | 0 | 0 | 5 | 0 |
| Trading and fraud | 7 | 2 | 2 | 1 | 0 | 0 | 2 | 0 |
| Browser and computer use | 8 | 0 | 0 | 0 | 2 | 0 | 6 | 0 |
| Frameworks | 7 | 2 | 2 | 0 | 0 | 0 | 3 | 0 |
| Coding agents | 13 | 4 | 3 | 6 | 0 | 0 | 0 | 0 |
| LLM as a judge | 4 | 0 | 1 | 0 | 0 | 0 | 3 | 0 |
| Real-time control (games and simulations) | 3 | 0 | 0 | 0 | 1 | 0 | 2 | 0 |
| All | 80 | 17 | 16 | 12 | 5 | 5 | 25 | 0 |
Counted with the below-threshold terms and never added to the error totals. n8n: all 5 nodes have no threshold by default; 2 offer an optional low-confidence output (below 0.5) and 1 an optional review route (read at the pinned commits, 14 Oct 2026). jev-for-chrome has no threshold for actions; a final 'done' or 'blocked' below 0.5 gets a second look. jev-android (below 0.65) and computer-use-jev (mutating actions below 0.5) stop with BLOCKED or an error for the caller: no-decision, not held, because no person or review queue receives the item.
No API keyfail-closed 51, fail-open 9, advisory 3, fallback 17, not recorded 0 (of 80)
| Domain | n | fail-closed | fail-open | advisory | fallback | no-decision | not recorded |
|---|---|---|---|---|---|---|---|
| Ticket triage | 5 | 5 | 0 | 0 | 0 | 0 | 0 |
| Model routing | 6 | 3 | 0 | 0 | 3 | 0 | 0 |
| Content moderation | 7 | 3 | 4 | 0 | 0 | 0 | 0 |
| Claude Code / MCP guards | 9 | 2 | 3 | 3 | 1 | 0 | 0 |
| Email and lead | 6 | 6 | 0 | 0 | 0 | 0 | 0 |
| n8n nodes (COF off) | 5 | 5 | 0 | 0 | 0 | 0 | 0 |
| Trading and fraud | 7 | 4 | 0 | 0 | 3 | 0 | 0 |
| Browser and computer use | 8 | 6 | 1 | 0 | 1 | 0 | 0 |
| Frameworks | 7 | 7 | 0 | 0 | 0 | 0 | 0 |
| Coding agents | 13 | 5 | 1 | 0 | 7 | 0 | 0 |
| LLM as a judge | 4 | 3 | 0 | 0 | 1 | 0 | 0 |
| Real-time control (games and simulations) | 3 | 2 | 0 | 0 | 1 | 0 | 0 |
| All | 80 | 51 | 9 | 3 | 17 | 0 | 0 |
Bypassrecorded 80, not recorded 0 (of 80)
| Domain | n | recorded | not recorded |
|---|---|---|---|
| Ticket triage | 5 | 5 | 0 |
| Model routing | 6 | 6 | 0 |
| Content moderation | 7 | 7 | 0 |
| Claude Code / MCP guards | 9 | 9 | 0 |
| Email and lead | 6 | 6 | 0 |
| n8n nodes (COF off) | 5 | 5 | 0 |
| Trading and fraud | 7 | 7 | 0 |
| Browser and computer use | 8 | 8 | 0 |
| Frameworks | 7 | 7 | 0 |
| Coding agents | 13 | 13 | 0 |
| LLM as a judge | 4 | 4 | 0 |
| Real-time control (games and simulations) | 3 | 3 | 0 |
| All | 80 | 80 | 0 |
Not recorded 0 of 80 (19 Oct 2026). A cell counts as recorded only when every entry point was read (rule of 14 Oct 2026). The cell is "none found" in the files read for 13 of 80; the other 67 list their skip paths. Four cells name their read scope: openlayer jevals, competitor-hunter, the ilyamk Gmail labeler and LlamaIndex JevRerank.
Domains with 3 or more implementations: 12 of 12 (3 to 13 each). Claude Code / MCP guards: 9 (8 until 19 Oct 2026; 6 until 18 Oct 2026). How the pages picked their implementations is stated on each domain page.
New domain, 12 Oct 2026: Real-time control (games and simulations)
3 game and robot-simulation demos that call Jev by default, read at pinned commits. Of the 3, on a Jev error 2 keep their last action (doom-jev, JevPlaysSnakeGame) and 1 stops (jev-robotics-demo). Loop ticks, patterns to copy and the 2 harnesses that are listed but not counted are on Jev plays Doom: what real-time demos do when a Jev call fails. The timeout column is a value, not a verdict, so it is not coloured. Documented code at the pins, checked ; the pool ran nothing.
| Implementation (commit) | Jev error or timeout | Malformed | Below threshold | No key | Bypass | Timeout against tick |
|---|---|---|---|---|---|---|
mikespins/doom-jev commit bd4e98f runnable demo | fallback-last actionthe game keeps applying the last action every tick; 2.0 s timeout, no retries action goes ahead | fallback-last actionno validation; the error stays inside the request task (inference from the 11 Oct 2026 read) | no-thresholdthe top of 6 actions is applied | fail-closedexits before the game starts | recordedshoot and stop-at-wall reflexes override Jev; moves forward until the first answer | 2.0 s, no retries, against a 0.12 s tick (about 17 ticks); at most 5 requests in flight; stale answers dropped |
FazalAAli/jev-robotics-demo commit 531de61 runnable demo | fail-closedthe demo stops; no action is taken (no try) | fail-closedthe demo stops | no-decisiongrasp/release below 0.75 does nothing; move and target take the top option | fail-closedraises when the client is built (SDK 0.7.x) | recordeda single legal move is made without a call; a hand reflex; the simulation filters unsafe moves | none in code: SDK default 10 s, 2 retries (SDK version not pinned); no fixed tick, the loop waits for each call |
bileshg/JevPlaysSnakeGame commit b9237bf runnable demo | fallback-last actionthe snake keeps its direction action goes ahead | fallback-last actionthe snake keeps its direction | no-thresholdthe answered direction is applied | fallback-last actionthe client is built inside the try, so the SDK's no-key error is caught | recordedNone found: read at the pinned commit (whole repository: main.py, src/runner.py, src/game/engine.py, src/game/snake.py, src/agents/jev_agent.py); every tick asks Jev; a direct reversal it answers is ignored (snake.py L35-37). | none in code: SDK 0.7.4 default 10 s, 2 retries; at most 10 ticks/s and the call blocks the tick |
Compare your own design with the 80
Pick what your own code does in five failure conditions to see how many of the 80 implementations on this page made the same choice.
The same counts are in the checklist below, which works without JavaScript. The self-check compares choices only: it does not read or test code, and nothing you pick leaves your browser.
Nine questions to ask of your own Jev integration
Apply each question to your own code. The counts show how the 80 answered it; the chips link to example rows on the domain pages. Chip colours: green holds or stops, red acts anyway, blue falls back, amber is advisory.
- When Jev errors or times out, does the action still happen?jev-judge: fail-open in enforce modeWordPress Jev Comment Triage: holds, retries, then a persondanna-zhou/jev-mcp: the command runsohmyjev (lockdown mode): the call goes to Claude Code's normal permission flowclaude-jev-advisor: Claude Code still asks you before the deletionSpring AI JevDocumentFilter: unscreened passages keptopenlayer jevals: errored eval counted as passedjev-ultrafast: "no action executed"doom-jev: keeps the last action
40 of 80 stop or hold it. 10 let it happen unchecked: 4 content-moderation bots, 4 agent hooks (danna-zhou, claude-model-guard and ohmyjev in lockdown mode for Claude Code, jev-judge for Hermes), the Spring AI passage filter and openlayer jevals, whose report counts an errored eval as passed. None of the 7 browser agents clicks or types on a Jev error. 22 of 80 fall back (in 9 of them the action can still happen, including 2 real-time demos that keep the last action), 5 of 80 return no decision, 3 of 80 are advisory; not recorded 0 of 80.
- What is your timeout, and what happens when it fires?btc-hft-jev: 0.40 s, then rules-onlyjkudish/jev-mcp: 60 s, error to the agentdoom-jev: 2.0 s against a 0.12 s tick, stale answers dropped
Timeouts set in code range from 0.40 s (btc-hft-jev) to 180 s per task (DeepEval JevEval). Some set none: jev-for-chrome and Ulka have no request timeout. Coding-agent hooks and providers use 1.0 s per call (hermes-jev-mana, 5.0 s per turn) to 25 s (jev-approvals and jev-curator; Hermes core's own default is 30 s). Real-time demos: doom-jev sets 2.0 s with no retries against a 0.12 s tick; jev-robotics-demo and JevPlaysSnakeGame set none in code (SDK default 10 s, 2 retries) and wait for each call. Timeouts were not tallied across all 80. Status codes and retries: errors and rate limits.
- If Jev answers in the wrong shape, do you treat it as "no" or as "yes"?fraud-jev: a non-numeric probability → allowjev-trader: any answer other than "sell" → buygbesse/zammad-jev-triage: checks model, option and probability
13 of 80 let the action go ahead on a malformed answer (pg-redact stores a span unredacted when its answer is missing). 1 more (jev-agent-browser) guesses a target by word overlap and clicks it. 36 of 80 fail closed; 24 of 80 fall back (openlayer reads a non-numeric answer as 0.5); 3 of 80 are advisory; 4 of 80 return no decision, including competitor-hunter, which leaves an unreadable reply out of its ranking. Validate before acting.
- What happens when Jev is unsure?vynnlee/jev-mail: Review labelgbesse: review groupbackmeupplz/jev_antispam_bot: below 0.81, kept
17 of 80 hold unsure items: 14 send them to a person or a review queue (including claude-jev-advisor, which leaves Claude Code's question to you), jev-curator refuses the change, and 2 (LiteLLM's compaction guardrail and jev-reranker) drop the result or passage below their cut. 16 act anyway below their cut, including ohmyjev in lockdown mode, whose Bash gate denies only above its cuts, and pg-redact, which stores the span unredacted. 25 have no threshold at all, including 5 of the 7 browser agents, 3 of the 4 judge tools, 2 of the 3 real-time demos and all 5 n8n nodes by default (2 offer an optional low-confidence output and 1 an optional review route). 12 of 80 fall back, 5 of 80 are advisory, 5 of 80 return no decision; not recorded 0 of 80. Choosing a cut: confidence thresholds.
- What happens with no API key?WordPress triage: WordPress's own decision standsdanna-zhou hook: proceedsjev-fraud-shield: mockn8n official node: credentials error; Continue On Fail sends the item to the error outputspam-leadgen-pipeline: script ends before classifying
51 of 80 refuse to start, error or hold the call. 9 proceed as if allowed: WordPress triage, the danna-zhou hook, claude-model-guard, ohmyjev (lockdown mode), ironbee-express when it replays a cached recording, jev-judge, and Jev-Moderation-Bot, soter and mastra-jev-moderation, which leave the message up. 17 fall back to another backend or LLM, a mock, a heuristic, the host's own permission rules, the unchanged request (jev-effort-router), the main or default model (jev-triage, jev-for-all), the last action (JevPlaysSnakeGame), the unrouted CLI model (jev-router), local selection (autojev) or the original Hermes branch (hermes-jev-mana). 3 of 80 are advisory. Not recorded 0 of 80. n8n nodes stop with a credentials error when Continue On Fail is off; with it on, the item goes to an error or review output, carries an error field, or (in one node) passes through unchanged. Test it: testing without a key.
- Which code paths never ask Jev?jev-trader: the mock model trades without Jevbackmeupplz: group admins' messages skippedJevmail:
80 of 80 have a recorded bypass cell, including passthrough and replay modes in 4 browser agents, the off header of jev-gateway, read-only or permission-request-only paths in 2 coding-agent gates (opencode-tool-gate, jev-kit), the off or observe modes of the 2 Hermes plugins, empty-input shortcuts that skip the call in the 5 rows added on 8 Oct, and the empty-input or slash-command skips of jev-triage and jev-for-all and the switches and admission rule of hermes-jev-mana (added 11 Oct), and the reflexes and no-call shortcuts of doom-jev and jev-robotics-demo (added 12 Oct), and the demo provider of JevRouter, WordPress trusted users and pingbacks and soter's exempt channels (added 13 Oct), and, added 14 Oct: three dispatch skips that leave a Zammad ticket unrouted (zammad-jev-dispatcher), webhook rejections and non-customer skips (gbesse), cache replay (jev-support-desk), a stored decision reapplied without a new call (jev-mail), and jev-mcp's extract tool skipping fields with no regex match, and, added 16 Oct: judge tools that score some checks locally or with a mock or other backend (jevals), judge only new, recent questions within a budget (did-they-answer) or reuse earlier verdicts (competitor-hunter); framework filters that return an empty passage or node list unasked (Spring AI, LlamaIndex); browser agents that switch to another provider, follow new tabs or stop at step limits (jev-for-chrome, jev-android), and a shopping assistant whose voice and email paths act without Jev (second-look); a Gmail labeler that skips already-marked messages and labels unreadable ones for review (ilyamk), and, added 18 Oct: a Claude Code model-tier guard that skips short, continuation or flagged prompts (claude-model-guard); a Windows deletion guard whose own rules decide before Jev is asked (claude-jev-advisor), and, added 19 Oct: a Bash guard whose gates run only in lockdown mode (off by default), that lets read-only commands and in-repo mkdir, touch, cp and mv through without asking Jev, has a shadow setting (off by default) that only logs what it would block, and switches itself off under the pi bridge (ohmyjev, 0.14.0). For 13 rows the recorded cell is "none found" in the files read. List yours: exits, allow-lists, admin users, kill switches, "mock" modes.
/previewsimulator, no mailbox actioncomputer-use-jev: passthrough mode clicks with no Jev and no keyjev-support-desk: cache replay without a Jev call - Is your fallback cheaper or riskier than failing?0xNatoshi/jev-codex-router: bills the frontier model on every Jev failureQuantDinger: asks an LLM, then allows
22 of 80 fall back to another model, scorer, rule set, default, the unchanged request, the host's original path or the last action on a Jev error. jev-approvals hands the approval to the main agent model, which can approve the command. jev-gateway passes the request to the agent's own model, which picks the tool, and the call runs. second-look shows "Good deal — buy it" from a heuristic when Jev is unavailable. Not recorded 0 of 80.
- Is the failure written down, and does a failed log write block the action?QuantDinger: logs "audit persistence skipped" and continuesjev-trader: writes its log after the order is sentBillionsBobby/JevRouter: attaches
Not counted across the 80: the domain tables have no logging column. Record every failure with its reason.
provider_errorSpring AI JevDocumentFilter: logs a WARN with the number of unscreened passages - Does your code log or show when it falls back or fails open?
Not counted across the 80: the map does not record whether a fallback is visible.
The questions are a design reading of the 80 rows, not a measured result. No count on this page comes from anywhere but the map below.
Checklist to paste
Select the block and copy it into your review.
- [ ] When Jev errors or times out, does the action still happen? (40 of 80 stop or hold it. 10 let it happen unchecked: 4 content-moderation bots, 4 agent hooks (danna-zhou, claude-model-guard and ohmyjev in lockdown mode for Claude Code, jev-judge for Hermes), the Spring AI passage filter and openlayer jevals, whose report counts an errored eval as passed. None of the 7 browser agents clicks or types on a Jev error. 22 of 80 fall back (in 9 of them the action can still happen, including 2 real-time demos that keep the last action), 5 of 80 return no decision, 3 of 80 are advisory; not recorded 0 of 80.) - [ ] What is your timeout, and what happens when it fires? (Timeouts set in code range from 0.40 s (btc-hft-jev) to 180 s per task (DeepEval JevEval). Some set none: jev-for-chrome and Ulka have no request timeout. Coding-agent hooks and providers use 1.0 s per call (hermes-jev-mana, 5.0 s per turn) to 25 s (jev-approvals and jev-curator; Hermes core's own default is 30 s). Real-time demos: doom-jev sets 2.0 s with no retries against a 0.12 s tick; jev-robotics-demo and JevPlaysSnakeGame set none in code (SDK default 10 s, 2 retries) and wait for each call. Timeouts were not tallied across all 80. Status codes and retries: errors and rate limits.) - [ ] If Jev answers in the wrong shape, do you treat it as "no" or as "yes"? (13 of 80 let the action go ahead on a malformed answer (pg-redact stores a span unredacted when its answer is missing). 1 more (jev-agent-browser) guesses a target by word overlap and clicks it. 36 of 80 fail closed; 24 of 80 fall back (openlayer reads a non-numeric answer as 0.5); 3 of 80 are advisory; 4 of 80 return no decision, including competitor-hunter, which leaves an unreadable reply out of its ranking. Validate before acting.) - [ ] What happens when Jev is unsure? (17 of 80 hold unsure items: 14 send them to a person or a review queue (including claude-jev-advisor, which leaves Claude Code's question to you), jev-curator refuses the change, and 2 (LiteLLM's compaction guardrail and jev-reranker) drop the result or passage below their cut. 16 act anyway below their cut, including ohmyjev in lockdown mode, whose Bash gate denies only above its cuts, and pg-redact, which stores the span unredacted. 25 have no threshold at all, including 5 of the 7 browser agents, 3 of the 4 judge tools, 2 of the 3 real-time demos and all 5 n8n nodes by default (2 offer an optional low-confidence output and 1 an optional review route). 12 of 80 fall back, 5 of 80 are advisory, 5 of 80 return no decision; not recorded 0 of 80. Choosing a cut: confidence thresholds.) - [ ] What happens with no API key? (51 of 80 refuse to start, error or hold the call. 9 proceed as if allowed: WordPress triage, the danna-zhou hook, claude-model-guard, ohmyjev (lockdown mode), ironbee-express when it replays a cached recording, jev-judge, and Jev-Moderation-Bot, soter and mastra-jev-moderation, which leave the message up. 17 fall back to another backend or LLM, a mock, a heuristic, the host's own permission rules, the unchanged request (jev-effort-router), the main or default model (jev-triage, jev-for-all), the last action (JevPlaysSnakeGame), the unrouted CLI model (jev-router), local selection (autojev) or the original Hermes branch (hermes-jev-mana). 3 of 80 are advisory. Not recorded 0 of 80. n8n nodes stop with a credentials error when Continue On Fail is off; with it on, the item goes to an error or review output, carries an error field, or (in one node) passes through unchanged. Test it: testing without a key.) - [ ] Which code paths never ask Jev? (80 of 80 have a recorded bypass cell, including passthrough and replay modes in 4 browser agents, the off header of jev-gateway, read-only or permission-request-only paths in 2 coding-agent gates (opencode-tool-gate, jev-kit), the off or observe modes of the 2 Hermes plugins, empty-input shortcuts that skip the call in the 5 rows added on 8 Oct, and the empty-input or slash-command skips of jev-triage and jev-for-all and the switches and admission rule of hermes-jev-mana (added 11 Oct), and the reflexes and no-call shortcuts of doom-jev and jev-robotics-demo (added 12 Oct), and the demo provider of JevRouter, WordPress trusted users and pingbacks and soter's exempt channels (added 13 Oct), and, added 14 Oct: three dispatch skips that leave a Zammad ticket unrouted (zammad-jev-dispatcher), webhook rejections and non-customer skips (gbesse), cache replay (jev-support-desk), a stored decision reapplied without a new call (jev-mail), and jev-mcp's extract tool skipping fields with no regex match, and, added 16 Oct: judge tools that score some checks locally or with a mock or other backend (jevals), judge only new, recent questions within a budget (did-they-answer) or reuse earlier verdicts (competitor-hunter); framework filters that return an empty passage or node list unasked (Spring AI, LlamaIndex); browser agents that switch to another provider, follow new tabs or stop at step limits (jev-for-chrome, jev-android), and a shopping assistant whose voice and email paths act without Jev (second-look); a Gmail labeler that skips already-marked messages and labels unreadable ones for review (ilyamk), and, added 18 Oct: a Claude Code model-tier guard that skips short, continuation or flagged prompts (claude-model-guard); a Windows deletion guard whose own rules decide before Jev is asked (claude-jev-advisor), and, added 19 Oct: a Bash guard whose gates run only in lockdown mode (off by default), that lets read-only commands and in-repo mkdir, touch, cp and mv through without asking Jev, has a shadow setting (off by default) that only logs what it would block, and switches itself off under the pi bridge (ohmyjev, 0.14.0). For 13 rows the recorded cell is "none found" in the files read. List yours: exits, allow-lists, admin users, kill switches, "mock" modes.) - [ ] Is your fallback cheaper or riskier than failing? (22 of 80 fall back to another model, scorer, rule set, default, the unchanged request, the host's original path or the last action on a Jev error. jev-approvals hands the approval to the main agent model, which can approve the command. jev-gateway passes the request to the agent's own model, which picks the tool, and the call runs. second-look shows "Good deal — buy it" from a heuristic when Jev is unavailable. Not recorded 0 of 80.) - [ ] Is the failure written down, and does a failed log write block the action? (Not counted across the 80: the domain tables have no logging column. Record every failure with its reason.) - [ ] Does your code log or show when it falls back or fails open? (Not counted across the 80: the map does not record whether a fallback is visible.) When Jev fails: pool count, 19 Oct 2026 (n = 80 implementations read at pinned commits, 12 domains). Jev error or timeout: 40 stop or hold, 22 fall back, 10 let the action through, 5 return no decision, 3 are advisory. The action goes ahead in 19 of 80 (10 fail-open + 9 fallbacks that can still end in the action; keeping the last action counts as going ahead). Malformed answer: 36 fail closed, 24 fall back, 13 fail open, 4 no decision, 3 advisory. No key: 51 fail closed, 17 fall back, 9 fail open, 3 advisory. Below threshold: 25 no threshold, 17 held, 16 act anyway, 12 fall back, 5 no decision, 5 advisory. Bypass recorded for 80 of 80; 0 not recorded. Source: https://shaduf.ai/p/jev-catalog/build/when-jev-fails/
All 80 rows
Show the full map: 80 implementations × 5 conditions, plus the 5 entries listed but not counted
Each implementation links to its row on the domain page (the older Claude Code / MCP rows link to that page's failure matrix and jev-permission-gate to its own row; browser and framework rows link to their rows on the domain pages published 5 Oct; coding-agent rows link to their rows on coding agents, 6, 7, 10 and 11 Oct; judge rows link to their rows on Jev as a judge, read 4 Oct and counted from 7 Oct; the 5 rows added on 8 Oct link to their rows on Jev reranker and Jev for RAG and Jev inside SQL and document pipelines; the 3 real-time rows, added 12 Oct, link to their rows on Jev plays Doom: what real-time demos do when a Jev call fails). The commit link opens the source tree at the pinned commit; file paths and line ranges for each cell are on the domain page. Documented source at the pinned commit, checked on the date of the domain page (see sources).
| Domain | Implementation (commit) | Jev error or timeout | Malformed | Below threshold | No key | Bypass |
|---|---|---|---|---|---|---|
| Ticket triage | CyrilBaah/jev-triage-desk commit 63913177 | fallback-archive lane | fallback-archive lane | no-thresholdno confidence gate | fail-closedHTTP 500 | recordednone found (only an empty-ticket 400 and the no-key 500, which route nothing) |
| Ticket triage | tuhinmitra888/ai-jev-ticket-triage commit 3e8b83a8 | fail-closed502 | fail-closed500 | held< 0.5 → human triage | fail-closeddoes not start | recordednone found (an empty or too-long ticket gets a 400) |
| Ticket triage | enderkus/zammad-jev-dispatcher commit f999eca7 | fail-closed502; ticket stays Unclassified | fail-closed502 when the probabilities map is missing; an off-list choice is held (note added, ticket stays in Unclassified) | held< 0.55 → Unclassified + note | fail-closedfails at boot | recorded3 skips leave the ticket unrouted: no ticket, no destination groups, already dispatched |
| Ticket triage | gbesse/zammad-jev-triage commit 5d2a0a78 | fail-closed503, retried; 20 s | fail-closedvalidated → 503 | held< 0.9 → review group | fail-closed503 | recordedwebhook rejections (404, 413, 401, 400); non-customer and internal articles skipped |
| Ticket triage | veermshah/jev-support-desk commit aef8fa0c | fail-closedbatch aborts; 10 s / 30 s (SDK defaults, not read in the repository) | fail-closed | held< 0.6 → triage review | fail-closedexit 2 | recordedcache replay reuses stored triages without a Jev call |
| Model routing | LiteLLM complexity router commit 8d28e8d | fallback-configured tier or local scorer3 s | fallback-configured tier or local scorersame path as an error | no-thresholdconfidence logged only | fail-closedstart-up error; deployment re-raised | recordedJev off unless classifier_type: "jev"; session replay; keyword override; plan-mode floor |
| Model routing | gargpratyush/jev-router commit 38da6b8 | fallback-current model3 s deadline | fallback-current model | fallback-current model< 0.3, or an upgrade capped at sonnet | fallback-unrouted CLI modelstarts without Jev; the CLI keeps its own model | recordedprompt phrases ("use opus") override Jev; no key starts without Jev |
| Model routing | BillionsBobby/JevRouter commit e11084c | no-decision15 s / 20 s | no-decision | no-decision< 0.55 | fail-closedexits at start | recordeddemo provider; local answer cache (library callers only) |
| Model routing | 0xNatoshi/jev-codex-router commit 8701ef7 | fallback-frontier model4 s | fallback-frontier model | no-thresholdconfidence logged only | fallback-frontier model | recordedkill-switch file; shadow mode |
| Model routing | nidhi-singh02/agent-router commit fb24d06 | fail-closedexits; nothing launched | fail-closedexit code 2; nothing launched | held< 0.75 and consequential → you pick | fail-closedexit code 2; nothing launched | recordedrouter effort <level>; session continuation reuses the route |
| Model routing | thinkany-ai/autojev commit d5d5731 | fallback-local selection2 s / 8 s; named Jev routes: equal load balancing | fallback-local selectionnamed Jev routes: equal load balancing | fallback-local selection< 0.5; named Jev routes: equal load balancing | fallback-local selectionstarts without Jev; named Jev routes: equal load balancing | recorded10 paths, e.g. explicit model request kept, observe mode, session pin |
| Content moderation | WordPress Jev Comment Triage commit d848a5b | fail-closedcomment held, retried, then left for a person | fail-openread as 0.0; WordPress approval can stand | heldmiddle band | fail-openno provider → WordPress decides | recordedprovider not ready; trusted users; pingbacks and other non-regular comments; WordPress already chose spam or trash; empty content |
| Content moderation | brainstormity/Jev-Moderation-Bot commit 325ea7f | fail-openmessage left up action goes ahead | fail-open→ legitimate | acts-anyway< 0.70 left up | fail-openmessage left up | recordedbot authors; DMs |
| Content moderation | frolleks/soter commit 756579a | fail-open"never blocks chat" action goes ahead | fail-open | advisory0.5–0.8 → mod-log review, no action | fail-openany failure caught; chat not blocked | recordedbots, empty content, non-guild messages, exempt channels |
| Content moderation | backmeupplz/jev_antispam_bot commit 0b07e88 | fail-openmessage kept action goes ahead | fail-open | acts-anyway< 0.81 kept | fail-closedexits at start | recordedgroup admins skipped, plus 3 more skip paths |
| Content moderation | CodeAlive-AI/mastra-jev-moderation commit 8735ea8 | fail-open5 s action goes ahead | fail-open | acts-anyway< 0.7 passed | fail-openlibrary; depends on the integrator | recordedempty text; circuit breaker; last message only; 8000-character cut; moderate override |
| Content moderation | Zafer-Liu/jev-demo-moderator commit cc47b25 | no-decisionerror field; batch 502 | no-decision | no-thresholdJev's Choice decides; code only tightens | fail-closedexits at start | recordednone found in the entry points server.py, moderator.py, web/index.html |
| Content moderation | pg-redact (PII redaction before storage; counted from 8 Oct) commit ee903ef | fail-closedHTTP 502; row not inserted; no timeout set | fail-opena missing span answer stores that span unredacted; a broken body gives 502 | acts-anywayspan below 0.5 stored unredacted | fail-closed502 | recordedno candidate spans: stored without a call |
| Claude Code / MCP guards | danna-zhou/jev-mcp PreToolUse hook commit 436469a | fail-open8,000 ms; the command runs action goes ahead | fail-open | held"dangerous" < 0.6 → ask | fail-openthe hook proceeds Tested offline no Jev call, 29 Sep 2026, as published on the Claude Code page | recordednon-matching commands never sent |
| Claude Code / MCP guards | jev-claude 0.1.0, shadow mode as installed commit 7d7e876 | advisory | advisory | advisory | advisoryflags only | recordedread-only tools with a clean rule check not sent |
| Claude Code / MCP guards | jkudish/jev-mcp commit 53fe575 (0.11.0; cells read 29 Sep, bypass read 14 Oct 2026); checked at 0.14.1 (86eae78): failure path unchanged | advisoryerror to the agent; 60 s | advisory"review" | advisory | advisoryerror to the agent | recordedjev_extract sends no field to Jev when its regex finds nothing (no call at all if no field matches); jev_review and jev_gate input checks return errors without a verdict |
| Claude Code / MCP guards | LangChain AutoModeMiddleware (Python) 0.0.1a3 commit 4af7ab8 | fail-closedrun ends; 30 s | fail-closed | acts-anywayis_risky < 0.5 → tool runs; fixed cut | fail-closedmiddleware cannot be constructed | recordedtools not listed |
| Claude Code / MCP guards | oh-my-claudecode (v5.5.0; checked v5.6.2) commit 9fd35ec | advisoryshadow by default; the heuristic decides; 2,000 ms | advisory | advisoryno gate; shadow | advisorypoint off; heuristic | recordedpoints not listed; cap; open circuit |
| Claude Code / MCP guards | madisonrickert/jev-permission-gate commit 7349bc9 | fallback-built-in classifier1.5 s action goes ahead | fallback-built-in classifier | fallback-built-in classifierdefers | fallback-built-in classifier | recordedengine already decided or not auto mode; tools other than Bash, WebFetch, WebSearch; secrets or too-long input; measure mode; cache |
| Email and lead | Jevmail commit f6f20af | no-decisionemail stays unclassified | fallback-promotional | acts-anywayflagged; lane still assigned | fail-closed | recorded/preview simulator (no Jev call; no mailbox action) |
| Email and lead | ilyamk Gmail labeler commit ade42bf | fail-closedretryable errors (408, 409, 425, 429, 5xx, network) pause the job; other errors (401, 402, 403, other 4xx) end the job with status 'error' | no-decisionskipped | fallback-full-body callthen its label is applied unchecked | fail-closed | recordedRead at the pinned commit (CODE.gs): entry functions found by a scripted scan of triggers, menus and web-callable handlers (eleven web-callable functions; no timed or menu-driven jobs); helper functions on the path to the Jev call not read in full. Messages already marked are not fetched or are skipped (L1593-1600); when the full text cannot be read, the review label is applied without the full-text check (L1687-1704); a dry run writes nothing (L1759); cost and message limits leave the rest unchanged. |
| Email and lead | parth-kp IMAP classifier commit db96194 | fail-closedrun stops; 15 s | fail-closedno range check | no-decisionmarked processed | fail-closed | recordednone found (a per-run cap defers mail) |
| Email and lead | vynnlee/jev-mail commit 61e346f | fail-closedretry later | fail-closed | heldReview label, kept in the inbox | fail-closed | recordeda stored decision from an earlier run is reapplied without a new Jev call; 4 skips |
| Email and lead | spam-leadgen-pipeline commit 78a7592 | fail-closedscript ends | fail-closed | fallback-not qualified | fail-closedthe SDK client is built at load; @typesafe-ai/sdk 0.6.0 throws in its constructor; no row written | recordednone found |
| Email and lead | docjev (document splitting; counted from 8 Oct) commit c7abe27 | fail-closed2 attempts, then ProviderError; 30 | fail-closedincomplete or invalid answer set | acts-anywaypage below 0.5 joins the current document | fail-closedProviderError at construction | recordedblank pages set to "other" without a call |
| n8n nodes | Official node 0.9.0 commit c12537b | fail-closedCOF on: fallback-first route (or Fallback/Uncertain if set) | fail-closedRoute; Evaluate unvalidated | no-thresholdby default; Fallback output optional (< 0.5), judgement | fail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; with it on, each item goes to the error output (Fallback, Uncertain or first) with error | recordednone found |
| n8n nodes | DomMonte 0.1.1 commit ff2afca | fail-closedCOF on: no-decision | fail-closed | no-thresholdone output; no confidence check found in the node | fail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; with it on, the item is passed on with json.error and no decision | recordednone found (judgement: single output, no routing) |
| n8n nodes | vibe-with-me-tools 0.2.3 commit ddbfe85 | fail-closedCOF on: fallback-first route (or Low Confidence) | fail-closed | no-thresholdby default; Low Confidence output optional (< 0.5), judgement | fail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; with it on, the item goes to the Low Confidence output if enabled, else the first output, with error | recordednone found |
| n8n nodes | taifoon 2.0.5 commit cdcc0f3 | fail-closedCOF on: fallback-review output | fail-closed"Fail Closed" on by default | no-thresholdby default; optional minConfidence → Review | fail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; judgement: the default direct connection; with it on, the item goes to Review with a redacted error | recordedno routing configured → everything to pass |
| n8n nodes | zampierid4p 0.3.3 commit 549a545 | fail-closedCOF on: fallback-question 1's branch | fail-closedmissing answer → empty branch | no-thresholdprobabilities passed through | fail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; judgement: the credential is read before the per-item try, so the node's own Continue On Fail branch does not catch it; with the node's On Error set to continue, n8n passes the input through unchanged on output 1, with no Jev answer | recordednone found |
| Trading and fraud | QuantDinger commit a5a9f4c | fallback-LLMthen fail-open; 8 s action goes ahead | fallback-LLMthen fail-open | fallback-LLMthen acts-anyway | fallback-LLMthen fail-open | recordedexits; grid/DCA/martingale; credit denial |
| Trading and fraud | jev-trader commit b587759 | fail-closedno new order; a resting order stays | fail-openany other answer → buy; conditional | no-threshold | fail-closedjudgement: with MODEL=jev the provider loads the key at call time, so each decision fails on the error path (no new order); the default model is mock (the recorded bypass) | recordedmock model trades without Jev |
| Trading and fraud | Jev Trade commit a3f2f83 | fail-closedno new order; 4,000 ms | fallback-hold | no-threshold | fail-closed | recordedmock model trades without Jev |
| Trading and fraud | btc-hft-jev commit 96f3541 | fallback-last judgment / rules-onlycan trade; 0.40 s action goes ahead | fail-closedrun stops | acts-anywayhalf size; < 0.50 | fallback-mockforced dry run | recordedrules-only path |
| Trading and fraud | jev-fraud-shield commit eeb4fc6 | fail-closedstep-up | fail-closed | heldstep-up | fallback-mock | recorded0 or ≥ 3 flags decided without Jev |
| Trading and fraud | fraud-jev commit aa33b97 | fail-closedreview, HTTP 500 | fail-opennon-numeric → allow; conditional | acts-anywayallow below the cuts | fail-closed401 | recordedOFAC destination → review without Jev |
| Trading and fraud | expense-policy gate commit 161c33b | fail-closedbatch aborts; 30 s | fail-closed | heldmanual review | fail-closed | recordeddeterministic rejects skip Jev |
| Browser and computer use | browser-use/jev-ultrafast commit 1231850 | fail-closed25 s; "no action executed" | fail-closed | no-thresholdconfidence recorded only | fail-closed | recordednone found (no action without a fresh Jev decision for the page) |
| Browser and computer use | ironbee-ai/ironbee-express commit 05079b4 | fail-closed25 s, 3 tries | fail-closed | no-threshold | fail-openconditional: a cached recording replays unjudged; fail-closed without one | recordedcached replay; LLM takeover |
| Browser and computer use | forvela/jev-agent-browser commit eb35251 | fail-closed30 s | fallback-semantic target resolverthen the action runs | no-thresholdstop cuts only | fail-closedstart URL opened first | recordedclassify-mode regex overrides |
| Browser and computer use | dougsong/jev-android commit be8364a | fail-closed25 s | fail-closed | no-decision< 0.65 → replan ×2 → BLOCKED | fail-closed | recordedRead at the pinned commit (whole repository): with DeepSeek selected, or the sample's scripted Bilibili policy, Jev is not asked; the scripted policy finishes, waits or blocks on its own; a scenario's first navigation happens before any decision; the step and time limits end the task. |
| Browser and computer use | paulsmith/computer-use-jev commit ff0ad8b | fail-closed60 s | fail-closed | no-decisionmutating < 0.5 → not executed | fail-closed | recordedpassthrough mode (no Jev, no key) |
| Browser and computer use | chy4pro/jev-for-chrome commit d5c24de | fail-closedno timeout; 3 retries | fail-closed | no-thresholdno threshold for actions; a final 'done' or 'blocked' below 0.5 gets a second look | fail-closed | recordedRead at the pinned commit (whole repository): with OpenRouter or Cloudflare selected, those services decide instead of Jev; the agent follows new tabs on its own; typed text is written by a separate text model; step, call-budget, repeat and deadlock limits end the task without asking. |
| Browser and computer use | razaanstha/ulka commit bb04433 | fail-closedno timeout | fail-closed | no-threshold | fail-closed | recordedcached replay; forced first action (both approval-gated) |
| Browser and computer use | KaushikSiva/second-look commit 0c05d16 | fallback-heuristic verdict15 s; recommendation only | fallback-heuristic verdicta missing or broken answer gets the simple 'Wait' or 'Buy now' rule; a verdict outside the four known values shows no verdict card on the web route (the voice assistant catches it) | no-threshold | fallback-heuristic verdict | recordedRead at the pinned commit (whole repository): with no key or on any Jev error a simple 'Wait' or 'Buy now' rule decides (jev.py L18-19, L30-32; research.py L188-191); research cards other than the verdict, cheaper-store savings and price-drop alerts use no Jev call (research.py L166-169, L188; main.py L41-54); the voice assistant speaks its own advice, adds price watches, sends emails and stores notes without asking Jev; forwarded order emails are read and answered by another model. When the backend names no best store, the side panel tags the cheapest offer "Best" without Jev (sidepanel.js L1114-1120). |
| Frameworks | Spring AI TypeSafe JevDocumentFilter 0.4.0 commit 51993bb | fail-openunscreened passages kept; 10 s × 3 attempts, 30 s budget action goes ahead | fail-open | acts-anywaya passage with injection risk at or below 0.70 is kept on that test; it can still be dropped by the filter's other rules (relevance below 0.45, evidence at or below 0.55) | fail-closedfor a blank key: startup exception. With the api-key property absent, no client is created and the application starts; the filter is not auto-created | recordedRead at the pinned commit (the filter class and its auto-configuration): only an empty passage list is returned without asking Jev (JevDocumentFilter.java L147-149); every non-empty list is screened. |
| Frameworks | LlamaIndex JevRerank (community) commit 421afda | fallback-retriever ordertop_n; 2.5 s | fallback-retriever order | no-thresholdoptional flag only, never drops | fail-closedValueError at construction | recordedRead at the pinned commit (the postprocessor package): only an empty node list is returned without asking Jev (read scope: the postprocessor in full; the Cloudflare and Vercel provider clients at their branch, return and raise lines). |
| Frameworks | LangChain ModelRouterMiddleware (Python) 0.0.1a3 commit 4af7ab8 | fail-closedrun ends; 30 s | fail-closed | no-thresholdalways answer.choice | fail-closedconstruction | recordedNone found: read at the pinned commit (libs/partners/typesafe/langchain_typesafe/: the middleware, classifier and client modules); each run asks Jev once before the first model call. |
| Frameworks | LangChain autoModeMiddleware (JS) 0.0.2 commit 417ddcf | fail-closedtool not run; 30 s × 3 attempts | fail-closed | acts-anywayrisk < 0.5 → tool runs; fixed cut | fail-closedconstruction | recordedunlisted tools never sent |
| Frameworks | LiteLLM TypeSafe compaction guardrail 1.104.0 (prompt filter; counted from 8 Oct) commit 7964577 | fallback-uncompacted requestdefault fail_open forwards the request uncompacted; 30 s | fallback-uncompacted request | heldtool results with noul < 0.2 removed from the prompt | fail-closedstart-up error | recordedoff unless configured; small and protected results never sent |
| Frameworks | jev-reranker 0.1.2 (reranker; counted from 8 Oct) commit d58594b | fail-closederror after up to 8 retries; 180 s per request | fail-closedResponseValidationError | heldrelevance_rerank cuts passages below 0.2 | fail-closederror at construction | recordedno call for an empty list; one passage gets 0.5 without a call |
| Frameworks | LanceDB TypeSafeReranker v0.40.0 (reranker; counted from 8 Oct) commit b1b080b | fail-closederrors propagate; timeout is the SDK default (typesafe-sdk 0.7.1 and 0.7.4: 10 s per HTTP operation, 2 retries, 30 s retry budget; which SDK version LanceDB installs was not read) | fail-closedValueError | no-thresholdreorders only | fail-closedTypeSafeError at the first rerank call; no fallback (read 11 Oct) | recordednull documents scored 0 without a call |
| Coding agents | keiffff/jev-kit jev-agent-review commit 3d74b05 | fail-closedheld for the host's prompt; SDK 10 s, no retry; 4 s hook timeout in the examples | fail-closedheld | held | fail-closedheld | recordedsensitive input deferred unsent; only permission requests |
| Coding agents | bloudhood/codex-jev-approval-hook commit b6242c9 | fail-closedheld for Codex's approval; 5 s | fail-closedheld | held | fail-closedheld | recordedBash, apply_patch and mcp__ only; denial cap |
| Coding agents | 24601/rh-guard (default mode enforce, so a default install can block) commit c2e682e | fallback-lexical detectors1.2 s action goes ahead | fallback-lexical detectors | acts-anywaysteer message only when Jev's primary_kind confidence is below 0.5 on a mutating step; the call still runs unless deny-kind labels reach a block threshold (REVIEW_THRESHOLD 0.45 is a risk-label floor, not a confidence threshold) | fallback-lexical detectors | recordedMCP tools not matched on Codex; shadow mode |
| Coding agents | justmytwospence/opencode-tool-gate commit bdf1ef8 | fallback-opencode permission rules3 s; OpenCode v1.18.35 default rules allow every tool ("*": "allow") action goes ahead | fallback-opencode permission rules | acts-anyway | fallback-opencode permission rules | recordedread-only tools; enabled: false |
| Coding agents | @osuki-dev/opencode-osuki-agent 0.2.7, checked at 0.2.8 npm 0.2.7; tag commit c96ce03; 0.2.8 (tag 0ae9e88): failure path unchanged | fallback-default tier10 s; routing fallback, not counted as going ahead | fallback-default tier | fallback-default tier | fallback-default tier | recordedfixed roles; reuse; pruning limits |
| Coding agents | DoGMaTiiC/hermes-jev jev-judge (enforce mode; default shadow) commit 5dddbea | fail-open3 s action goes ahead | fail-open | acts-anyway | fail-open | recordedcache; circuit breaker; unlisted tools |
| Coding agents | anpicasso/hermes-jev-approvals with Hermes Agent core v2026.9.24 (off after install: core default approval mode manual) commit 28be98a; core f97608f | fallback-main agent modelon a timeout, connection error, 429 or 402 (if a main provider is set), and that model can approve (with no main model configured, it asks you); held for a person on other HTTP errors; plugin 25 s, core may retry twice action goes ahead | fail-closedempty or unknown answer escalates to a person | heldAPPROVE below confidence 0.55 becomes ESCALATE | fail-closedplugin raises; core escalates to a person | recordedapprovals off or manual (the default); allowlist; commands not flagged |
| Coding agents | anpicasso/hermes-jev-curator (guard or apply mode; default observe) commit 4e8626c | fail-closedbackground skill delete or patch blocked; 25 s | fail-closedno answers object or invalid answers: no plan; the guard blocks | heldconfidence < 0.85: change not authorised; the guard blocks | fail-closedno credential: no judgment; the guard blocks | recordedoff and observe modes inert; foreground operations; creates |
| Coding agents | AlphaPerseii3000/jev-effort-router 0.2.2 with Hermes Agent (Jev picks the model and reasoning effort for each turn; off until enabled in Hermes; inert until a key is set, and with Hermes defaults, because it acts only when the provider is Ollama:Cloud (R13-S217, R13-S220); added 10 Oct) commit 562dc2a | fallback-configured modeltimeout (2.0 s) or HTTP error: the request is left untouched, so the turn runs on the operator's configured model and effort | fallback-configured modelno usable answer: request untouched; a partial answer with no model choice gives the default model | fallback-default modelconfidence < 0.5: the code rewrites the request to deepseek-v4.1-flash at medium effort | fallback-configured modelno key: the request is left untouched | recordeddisabled; a provider other than Ollama:Cloud; another API mode; no user message; any exception |
| Coding agents | jev-gateway 0.5.1, a local proxy for Codex, OpenCode and 4 other hosts (Jev picks the tool; added 10 Oct) npm 0.5.1; repository named in npm metadata (gitHead 37ff982); code read from the npm 0.5.1 tarball | fallback-agent's own model4,000 ms plus 1 retry on 408, 429 or 5xx; the request passes through, the agent's own model picks the tool and the call runs action goes ahead | fallback-agent's own modelpassthrough to the agent's model | fallback-agent's own modelbelow 0.7, or the two Jev answers disagree: passthrough; Jev's answer is not used | fail-closedthe gateway does not start; with no person at a terminal the launcher exits | recordedheader x-jev-gateway: off; routing off; the Codex auto-reviewer model; no tools or a tool choice already set; hosted tools; an upstream 400 or 422 replays the original request |
| Coding agents | RanyAlbegWein/jev-triage 1.0.3 with OpenClaw (skips the main model for "thanks" and "spam" at a score of 0.9 or more; host path read at OpenClaw aa6008a; added 11 Oct) commit 6360e21 | fallback-main model5,000 ms; a non-ok status, a timeout or a throw is caught (OpenClaw's before_dispatch is fail-open) and the message goes to the main model as if the plugin were absent; routing fallback, not counted as going ahead | fallback-main modela throw is caught by the host; the message goes to the main model | fallback-main modelbelow 0.9 the message goes to the main model untouched | fallback-main modelthe call fails and the message goes to the main model | recordedempty text or a leading /; host inbound handlers off or runtime restricted |
| Coding agents | jev-for-all 0.7.1, the jev-for-all start launcher for Claude Code and OpenCode (Jev picks the tier and effort; counted on the launcher only, its OpenCode plugin part is not settled; added 11 Oct) npm 0.7.1 (gitHead 74f62e7); code read from the npm 0.7.1 tarball | fallback-default model3,000 ms; on an error or timeout the launcher starts the standard tier (Claude Sonnet) at medium effort; routing fallback, not counted as going ahead | fallback-default modelstandard tier, medium effort | fallback-default modelstandard tier unless light is 0.6 or more or heavy is 0.5 or more | fallback-default modelstandard tier, medium effort | recordedempty prompt; the user's models.json overrides |
| Coding agents | abehrman/hermes-jev-mana with Hermes Agent, core patch patches/jev-decisions.patch (picks the model and effort, can answer the user or hand the turn to an executor without a provider call; added 11 Oct) commit 3daf639 Inert after the documented install: every Jev call is refused because admit_unlabeled defaults to false; acts only if the operator sets admit_unlabeled: true. | fallback-original Hermes branch1.0 s per call, 5.0 s per turn, plus 0.25 s host grace; an error, a timeout or a late answer becomes "outage" and the original Hermes branch runs on the configured model; routing fallback, not counted as going ahead | fallback-original Hermes branch"invalid": the original branch runs | fallback-original Hermes branchnear-tie margin 0.15 in code (the example config comment says 0.10): "uncertainty", the original branch runs | fallback-original Hermes branchjudgement: every failure of the jev CLI raises JevError, which goes to the original branch; the CLI, which reads the key, was not read | recordeddecisions off; plugin not enabled; excluded points; admission False; explicit model or effort pins; delegated agents get no executor; fewer than 2 options; more than 8 native steps per turn; unhealthy points |
| LLM as a judge | DeepEval JevEval (deepeval 4.2.8) commit a200ece | fail-closedrun aborts (default ignore_errors=False); with ignore_errors=True the test case is a FAIL; 180 s per task. The 180 s value and ignore_errors were not re-checked under the library scope. | fail-closeda missing answer raises, handled like an error | no-thresholdminimum confidence recorded, not acted on | fail-closed"there is no LLM to fall back to" | recordedNone found: read at the pinned commit (the deepeval/metrics/jev_eval/ directory: jev_eval.py, utils.py, questions.py, __init__.py); every scoring call asks Jev. |
| LLM as a judge | openlayer jevals 0.1.4 commit 0a8f895 | fail-openthe report's passed treats an errored eval as not failed; the runtime gate defaults to on_error="allow". Dataset summary: no score, left out of the denominator (no-decision). 15 s, 4 retries action goes ahead | fallback-0.5a non-numeric Noul is read as 0.5; a missing answer is left out, and for single-question evals the result is then recorded as an error (handled as on a Jev error) | no-thresholddefault; the gate holds only if you set escalate_below or escalate_above and an on_escalate handler | fallback-another backenddefault auto-detect uses Vercel, Kev, Eikos or an OpenRouter/OpenAI LLM if one is configured; fails closed if no other backend is configured; Jev named explicitly: fail-closed | recordedRead at the pinned commit (whole repository). Some built-in evals score with no Jev call: LoopDetection, PII, PHI and SecretsExposure pass (SecretsExposure can also fail) on local checks; TrajectoryMatch and ToolCallF1 are computed locally; evals missing required fields are skipped and the gate allows them; backend='mock' and auto-detected other backends do not ask Jev (also from the MCP tools); in the OpenAI Agents integration non-function tools are not gated; jevals bench --ragas also scores with another model (report only) (read scope: every entry point in full except the documentation helper integrations/_docs.py, read at its function and return lines; it builds a help text and runs no evaluation). |
| LLM as a judge | did-they-answer commit e0ee60c | no-decisionthe item is not written and is retried on the next daily run while the question is inside the 21-day window; 60 s; up to 5 tries for HTTP 429, 5xx and 529 only; a timeout or connection error fails on the first try | fail-closedmissing answer keys stop the run (traced, not executed); a missing usage field alone gives no-decision | no-thresholdtop option stored; "referred" split at 0.5 | fail-closedexits without a key | recordedRead at the pinned commit (whole repository): the daily job judges only questions from the last 21 days that have a reply and were not judged before, and stops once its per-run budget is spent; stored Jev results are reused when rebuilding the published judgments; the labelling tool records labels from another model or a person, not from Jev. |
| LLM as a judge | competitor-hunter (loading claude-x-jev c8662b0) commit 40613ea | no-decisionerrored items are left out of the ranking, but errored Reddit posts are still listed without a verdict; above 5% errors the run aborts (fail-closed); 60 s, 4 retries (4xx not retried) | no-decisionan unreadable reply is handled like a Jev error and the item is left out of the ranking; a reply missing its answers stops the ranking stage (fail-closed) | acts-anywayunsure items flagged but still ranked | fail-closedOpenRouter key required | recordedRead at the pinned commit (whole repository, with the claude-x-jev code it loads): re-runs reuse earlier verdicts; pieces judged 'paid' by engagement rules are dropped before ranking; Reddit posts without a Jev result are still listed; the studio re-scores your own posts without Jev; another model writes post breakdowns and chat answers; the results page ranks competitors by views and engagement (S–E tiers) without Jev (web/app.js L438-485) (read scope: all code and web scripts in full; the two HTML pages' markup checked by script for event handlers (none), their inline scripts read). |
| Real-time control | mikespins/doom-jev commit bd4e98f (domain table) | fallback-last actionthe game keeps applying the last action every tick; 2.0 s timeout, no retries action goes ahead | fallback-last actionno validation; the error stays inside the request task (inference from the 11 Oct 2026 read) | no-thresholdthe top of 6 actions is applied | fail-closedexits before the game starts | recordedshoot and stop-at-wall reflexes override Jev; moves forward until the first answer |
| Real-time control | FazalAAli/jev-robotics-demo commit 531de61 (domain table) | fail-closedthe demo stops; no action is taken (no try) | fail-closedthe demo stops | no-decisiongrasp/release below 0.75 does nothing; move and target take the top option | fail-closedraises when the client is built (SDK 0.7.x) | recordeda single legal move is made without a call; a hand reflex; the simulation filters unsafe moves |
| Real-time control | bileshg/JevPlaysSnakeGame commit b9237bf (domain table) | fallback-last actionthe snake keeps its direction action goes ahead | fallback-last actionthe snake keeps its direction | no-thresholdthe answered direction is applied | fallback-last actionthe client is built inside the try, so the SDK's no-key error is caught | recordedNone found: read at the pinned commit (whole repository: main.py, src/runner.py, src/game/engine.py, src/game/snake.py, src/agents/jev_agent.py); every tick asks Jev; a direct reversal it answers is ignored (snake.py L35-37). |
| Claude Code / MCP guards | mcowdery/claude-model-guard 1.2.0, UserPromptSubmit hook (a model-tier gate, not a safety gate) commit bced870; scripts/promptAdvisor.mjs L25–155, scripts/jev.mjs L124–137, scripts/decision.mjs L6–47. Documented read at the pinned commit, 16 Oct 2026; bypass entry points read 18 Oct 2026; added 18 Oct 2026 | fail-open2,500 ms; the hook exits 0 with no output and the prompt goes on (promptAdvisor.mjs L25, L82, L155; jev.mjs L133–137) action goes ahead | fail-opena missing answer throws and is caught; the prompt goes on (promptAdvisor.mjs L86, L155) | advisorybelow 0.65 (0.9 within 3 prompts of a model switch) a note to Claude, no block (promptAdvisor.mjs L133–152) | fail-openthrows; exits 0 with no output (jev.mjs L124–127; promptAdvisor.mjs L155) | recordedempty prompt; a skip phrase or CLAUDE_SKIP_MODEL_GUARD; continuation words, slash and ! commands; a short prompt with no earlier text (promptAdvisor.mjs L31, L64–65, L70, L77) |
| Claude Code / MCP guards | delt96/claude-jev-advisor 0.5.0, rm hook (PreToolUse, Windows only) commit f2c1791; src/rm/run.ts L29–123, src/rm/judge.ts L75–77, src/jev.ts L4–80. Documented read at the pinned commit, 16 Oct 2026; bypass entry points read 18 Oct 2026; added 18 Oct 2026 | fail-closedheld: the guard's own ask stands; 8,000 ms within a 12,000 ms budget (jev.ts L4, L72, L79–80; run.ts L29–30, L123) | fail-closedheld: a parse error or a missing field leaves the ask (jev.ts L73–79; run.ts L66–67) | heldthe ask is lifted only when every target is ≥ 0.8 (judge.ts L75–77; run.ts L102) | fail-closedheld: the ask stands (run.ts L91–92) | recordedrm off; not Bash or PowerShell, or no command; no deletion found; a deletion denied by code; rm.jev off; no key (run.ts L77–92); none lets an asked deletion through |
| Claude Code / MCP guards | Novacon/ohmyjev, Claude Code module (Bash, Write/Edit and exfiltration gates; enforcing deny), in lockdown mode without shadow (both off by default) 0.14.0, commit fbc4ea4; hooks/ohmyjev.ts, hooks/jev.ts, hooks/policy.ts. Documented read at the pinned commit, 8 Nov 2026 (earlier readings at d307c39, 2 Nov 2026, and 78bb82c, 16–21 Oct 2026; added 19 Oct 2026). The gates run only with the lockdown setting on, and it is off by default (policy.ts L12; gate returns before any Jev call, ohmyjev.ts L292); a new shadow setting, also off by default, runs the lockdown checks but blocks nothing (policy.ts L13, L33–39). The cells describe lockdown mode without shadow. Hosts: Claude Code (this module) and pi and omp through adapters/pi.ts (tool_call from L498) and adapters/omp.ts (tool_call from L524), which share adapters/shared.ts and need lockdown in the same way; same five terms. | fail-open1,500 ms (policy.ts L95; race at ohmyjev.ts L92–101); a Jev error throws, decide returns nothing (L205–215) and the gate returns without blocking (L302, L325, L334), so the call goes to Claude Code's normal permission flow action goes ahead pi and omp: the same 1,500 ms through AbortSignal.timeout; decide returns nothing and the gate returns without blocking, so the host runs the tool (shared.ts lines as read at d307c39: L37, L106). | fail-opennon-JSON or a missing answer throws and the call passes (jev.ts L46–62, L70–81) pi and omp: the same throw and the same return without blocking. | acts-anywayBash denied only when Jev rates it irreversible at ≥ 0.6, irreversible with destructive intent at ≥ 0.7, or exfiltrating at or above the exfil setting; otherwise the call goes on (policy.ts L434–448; L68–69) pi and omp: the same Bash thresholds, plus writes denied only at secret ≥ 0.7 (secrets file ≥ 0.8) and exfiltration only at ≥ 0.7 (policy.ts from L450 and L463). | fail-openaskJev throws; the gate returns without blocking and the call goes to the normal permission flow (ohmyjev.ts L82, L206–208, L302). Keys are taken from the config, $TYPESAFE_API_KEY, a key stored with ohmyjev key, then $OPENROUTER_API_KEY (jev.ts L33–39) pi and omp: askJev throws and the gate returns without blocking; both log "no Jev key: gates and screens let every call through" (lines as read at d307c39: shared.ts L28; pi.ts L449; omp.ts L413). | recordedlockdown off, the default, skips every gate before any Jev call (ohmyjev.ts L292); the shadow setting (off by default) runs the gates and Jev's checks but only logs what they would block, so every call runs (policy.ts L33–39, L424–425; ohmyjev.ts L313–316, L854); with lockdown off or shadow on, a git push or GitHub write is denied once by a code reminder and runs when repeated (L819–822; no Jev call); off switch (L818); read-only Bash and in-repo mkdir, touch, cp and mv skip Jev and return without approval unless policies are set (L298; policy.ts L370, L414); writes outside allowed paths denied by code (L309–320); each gate can be switched off; tools outside HOOKED never seen (L24); its own exceptions pass the call; under the pi bridge (OHMYJEV_PI=1) the module switches itself off (L746) pi and omp: gates need lockdown (pi.ts L508, L522, L538; omp.ts L535, L563, L590); the same GitHub reminder and the same shadow handling (pi.ts L504, L602–606; omp.ts L531, L678–682; shared.ts denyByCode L173–182 logs instead of denying in shadow); writes outside allowed paths denied by code; other tools fall through with no Jev call; their own exceptions pass the call. |
| Claude Code / MCP guards | Official TypeSafe plugin commit 65a39f3. Excluded from every count: no runtime Jev call | n/aexcluded | n/aexcluded | n/aexcluded | n/aexcluded | n/aexcluded |
| LLM as a judge | Jevals harness Excluded from every count: its code is not public, so its cells are Reported from a methodology page, not read at a pinned commit | n/aexcluded | n/aexcluded | n/aexcluded | n/aexcluded | n/aexcluded |
| SQL extensions | pg-jev Listed, not counted (8 Oct rule): its value goes back into your query; cells on the databases page | n/anot counted | n/anot counted | n/anot counted | n/anot counted | n/anot counted |
| SQL extensions | sqlite3-jev Listed, not counted (8 Oct rule): its value goes back into your query; cells on the databases page | n/anot counted | n/anot counted | n/anot counted | n/anot counted | n/anot counted |
| SQL extensions | sqlite-jev Listed, not counted (8 Oct rule): its value goes back into your query; cells on the databases page | n/anot counted | n/anot counted | n/anot counted | n/anot counted | n/anot counted |
- fail-closed or held: the item does not go ahead; a person, the host's prompt or, for two passage filters, the code's own cut decides
- fallback-… (named)
- advisory: Jev never decides
- no-decision
- fail-open or acts-anyway
- no-threshold
- not recorded
Where this map differs from earlier notes and pages
The starting point was a prep map of 3 Oct 2026. Each difference was decided from the published domain page and its research note. None adds a new failure claim.
| Item | Earlier map or page | Used here |
|---|---|---|
| oh-my-claudecode, all cells | Prep map: fallback-heuristic twin | advisory at default settings (shadow; the heuristic always decides). fallback-heuristic only with OMC_JEV=<point>:active. On the 32-row tally: fallback 6 → 5, advisory 2 → 3 |
| No key: jev-claude and jkudish/jev-mcp | Prep map: not mapped | advisory for both, as the Claude Code / MCP page records ("Flags only"). Claude Code / MCP no-key cells: 5 of 5 recorded |
| Below threshold, relabelled to the 4 Oct terms | Prep map: CyrilBaah fail-open; LiteLLM and 0xNatoshi "acts anyway"; Zafer-Liu "Jev's own Choice decides"; agent-router advisory; review-group and review-label rows (tuhinmitra888, enderkus, gbesse, veermshah, vynnlee) fallback; WordPress "held band" | CyrilBaah, LiteLLM, 0xNatoshi and Zafer-Liu → no-threshold; agent-router, the review rows and WordPress → held. Vocabulary only; no fact changes |
| Bypass | Prep map: email re-processing guards (ilyamk, vynnlee, spam-leadgen) and agent-router's secret-pattern refusal listed as bypasses | not recorded: they skip or refuse work, they do not act without Jev. Jevmail's /preview simulator stays a bypassNote, 14 Oct 2026: vynnlee's stored-decision replay (jev-mail) is now recorded as a bypass, because it reapplies an earlier Jev decision without a new call. The other reprocessing guards stay as described above. |
| Jevmail, unsure answer | Email page (3 Oct): advisory | acts-anyway (flagged): the lane is still assigned. Relabel only; applied on the email page on 4 Oct |
| spam-leadgen-pipeline, unsure answer | Email page (3 Oct): fail-closed, which is not a below-threshold term | fallback-not qualified. Relabel only; applied on the email page on 4 Oct |
| vynnlee/jev-mail, unsure answer | Email page (3 Oct): "fallback: Review label" | held (a review label kept in the inbox), under the same relabel rule as the other review rows; applied on the email page on 4 Oct |
| Denominator | Prep map: 32 (+1 n/a) | 32 for the six domains published before 4 Oct; 39 with trading (4 Oct); 51 with browser and computer use and frameworks (5 Oct); 58 with jev-permission-gate and the six coding-agent rows (6 Oct); 64 with the four judge tools and the two Hermes plugins (7 Oct); 69 with LiteLLM's compaction guardrail, jev-reranker, LanceDB's TypeSafeReranker, pg-redact and docjev (8 Oct); 71 with jev-effort-router and jev-gateway (10 Oct); 74 with jev-triage, the jev-for-all launcher and hermes-jev-mana (11 Oct); 77 with doom-jev, jev-robotics-demo and JevPlaysSnakeGame (12 Oct); 79 with claude-model-guard and claude-jev-advisor (18 Oct); 80 with ohmyjev (19 Oct). The official plugin, the trycua/cua mock example, jev-llm-guard, the Jevals harness, the three SQL extensions and the ra2web and llm-invaders real-time harnesses stay out |
| enderkus/zammad-jev-dispatcher, malformed answer | This page and the triage page, to 13 Oct: fail-closed 502 | fail-closed 502 only when the probabilities map is missing; an off-list choice is held (note added, HTTP 200, ticket stays in Unclassified; app.rb L117-138 at f999eca7, read 14 Oct). Count unchanged |
| chy4pro/jev-for-chrome, unsure answer | no-threshold, no note | no-threshold for actions; a final 'done' or 'blocked' below 0.5 gets a second look (src/background/agent.ts L78-79, L465-486 at d5c24de, read 14 Oct). Count unchanged |
| jev-approvals, Jev error | This page and coding agents, 7 Oct: fail-closed (held for a person) | fallback-main agent model on a timeout, connection error, 429 or 402; held on other HTTP errors (Hermes core auxiliary_client.py L7610–7701 at f97608f, read 8 Oct). Counted under fallback from 8 Oct |
No disagreement was found between a published page cell and its note for the error, malformed and no-key cells of triage, routing, moderation, email and n8n (page tables spot-read against the prep map).
What was not verified
- Bypass cells rest on reading the files that start work at each pinned commit; for one large Apps Script file the entry functions were found by a scripted scan, and a few helper functions on the way to the Jev call were not read in full. Nothing was run. For n8n we read the node's credential check and n8n's own missing-credential error; whether the editor blocks activating a workflow without a credential was not read.
- Rows from the six earlier domains were recomputed from their published tables and notes, not re-read from source when this map was built. The trading rows were read from source on 4 Oct; the browser and framework rows on 5 Oct (spot-checked against the raw files at the pins; the Spring AI auto-configuration lines were read once at the pin).
- Browser and framework rows: SDK defaults were not read (for example the @langchain/core retry backoff); whether computer-use-jev sends
[secure]field values and how second-look's card words its fallback verdict are not recorded. - Coding-agent rows (6 and 7 Oct): osuki was read from the npm 0.2.7 tarball and checked at 0.2.8 (tag
0ae9e88); the tarballs and tags were not matched file by file. jev-judge is counted in enforce mode (default shadow), jev-approvals is off after install and jev-curator observes by default; their cells describe the switched-on modes. jev-curator's cache lifetime is not recorded. Hermes's defaultmodel.providerand_BILLING_PATTERNS, which decide when the jev-approvals fallback applies, were not read. How Codex handles jev-kit's exit 2 was not read. - Judge rows (7 Oct): mapped from the published Jev as a judge table and its 4 Oct research note at the 4 Oct pins, not re-read from source; HEADs were not rechecked. openlayer's no-key branch was read on 8 Oct. Their bypass cells were read at the pins on 16 Oct 2026.
- The 2 trading fail-open cells for malformed answers depend on the shape of the bad answer.
- Rows added on 8 Oct: LanceDB's no-key behaviour was read on 11 Oct (fail-closed at the first rerank call); which TypeSafe SDK version LanceDB installs, and so its timeout, was not read; pg-redact sets no timeout on its request; LiteLLM's compaction row comes from the 6 Oct read at
7964577. - Coding-agent rows added 10 Oct: jev-gateway was read from the published npm 0.5.1 tarball (gitHead
37ff982), not from the GitHub tree, and was not run. How Codex and OpenCode run a forced or built tool call, and whether their own approval policy then applies, was not read. Whether Hermes needs a separate plugin-enable step after installing jev-effort-router is not recorded. - Coding-agent rows added 11 Oct: OpenClaw after line 650 of the 2026.10.1 host file, hermes-jev-mana's
jevkit/client.py(read 14 Oct 2026; its no-key cell is now a judgement, because thejevCLI, which reads the key, was not read), the Hermes base commit the patch targets (e97923c3) and the jev-for-all Claude Code hook were not read. jev-for-all was read from the npm 0.7.1 tarball (gitHead74f62e7), not from a GitHub tree. None was installed or run. - Real-time rows added 12 Oct: the cells come from code at the pins, not from runs. jev-robotics-demo does not pin its SDK version. The doom-jev and jev-robotics-demo cells come from the 11 Oct 2026 reads at the same pins (HEADs unchanged on 12 Oct). None was installed or run.
- Claude Code rows added 18 Oct 2026: claude-jev-advisor's CLI, status-line and context files were checked by a scripted scan plus the parts named in its notes, not read line by line (none is a tool-call path); the npm
@delt/claude-jev-advisor0.5.0 tarball was not compared with the pin file by file; claude-model-guard is not on a package registry. Neither was installed or run. - Logging (question 8), timeouts (question 2) and whether a fallback is visible (question 9) were not tallied across all 80.
- How any of the 80 behaves in real use: none was run here (no agent, hook, plugin, eval or MCP server was installed or run; no Jev call), and how many people use them is unknown.
Sources and check times (UTC)
- Recount of 19 Oct 2026: the 79-row map as published here reproduces from this page's cells before the change (no key 51/17/8/3/0, error 40/22/9/5/3/0, malformed 36/24/12/4/3/0, below threshold 25/17/15/12/5/5/0, bypass 79/0 with 13 "none found"); after adding ohmyjev every column sums to 80 with 0 not recorded (script over this page's cells: no key 51/17/9/3/0, error 40/22/10/5/3/0, malformed 36/24/13/4/3/0, below threshold 25/17/16/12/5/5/0, bypass 80/0). Novacon/ohmyjev at
fbc4ea4(0.14.0; R28-S20 to R28-S23, read 8 Nov 2026):hooks/ohmyjev.tsL24, L82, L92–101, L205–215, L292–334, L746, L818–822, L854;hooks/jev.tsL33–39, L46–62, L70–81;hooks/policy.tsL12–13, L33–39, L68–69, L95, L370, L414, L424–448;adapters/pi.tsL498–606;adapters/omp.tsL524–682;adapters/shared.tsL173–182;adapters/codex.tsnot read; the newbin/ohmyjev.mjsis an install and key command (npx ohmyjev install,npx ohmyjev key), read only for its usage and its key check, not a gate path. Earlier, Novacon/ohmyjev atd307c39(0.13.2; R26-S20 to R26-S24, read 2 Nov 2026):hooks/ohmyjev.tsL24, L70, L80–89, L191–201, L272–311, L719, L791–800;hooks/jev.tsL58–64;hooks/policy.tsL12, L57–58, L65, L84, L390–428;.claude-plugin/plugin.jsonL29–34;adapters/pi.tsL497–560;adapters/omp.tsL522–600;adapters/shared.tsL28, L37, L106. Earlier pin78bb82c(read 16–21 Oct 2026):hooks/ohmyjev.tsL24, L70, L80–89, L193–194, L276–298, L309, L724–730, L778–811;hooks/jev.tsL58–64;hooks/policy.tsL18–19, L63, L323–337;adapters/shared.tsL557–568;adapters/pi.tsandadapters/omp.tsread in full; the built Codex hookcodex/ohmyjev.mjschecked at its gate lines, its sourceadapters/codex.tsread in full. - Recount of 18 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 50/17/7/3/0, error 39/22/8/5/3/0, malformed 35/24/11/4/3/0, below threshold 25/16/15/12/5/4/0, bypass 77/0 with 13 "none found"); after adding the two rows every column sums to 79 with 0 not recorded (script over this page's cells: no key 51/17/8/3/0, error 40/22/9/5/3/0, malformed 36/24/12/4/3/0, below threshold 25/17/15/12/5/5/0, bypass 79/0). mcowdery/claude-model-guard at bced870 (package 1.2.0):
scripts/promptAdvisor.mjsL25, L31, L64–65, L70, L77, L82, L86, L133–155;scripts/jev.mjsL124–137;scripts/decision.mjsL6–10, L32, L36–47; read 16 Oct 2026 (R17-S242 to R17-S245) and re-read 18 Oct 2026 (R18-S224 to R18-S226); HEAD = pin, 18 Oct 2026, 05:20 UTC (R18-S202). delt96/claude-jev-advisor at f2c1791 (= npm@delt/claude-jev-advisor0.5.0):src/rm/run.tsL29–30, L66–67, L77–92, L102, L123;src/rm/judge.tsL75–77;src/jev.tsL4, L63, L72–80; read 16 Oct 2026 (R17-S239 to R17-S241); bypass entry points from one listing of the repository at the pin read 18 Oct 2026 (R18-S214 to R18-S223); no-key linerun.tsL91–92 checked again (R18-S66); HEAD = pin, 18 Oct 2026, 05:20 UTC (R18-S201). - Recount of 16 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 50/17/7/3/0, bypass 66/11, below threshold 25/16/15/12/5/4/0, error 39/22/8/5/3/0, malformed 35/24/11/3/3/1); after the change every column sums to 77 with 0 not recorded (script over this page's cells). Bypass cells of the 11 rows read at the published pins, 16 Oct 2026 (R17-S100 to R17-S194, R17-S300 to R17-S313; spot-checks of DeepEval JevEval and Spring AI JevDocumentFilter, R17-S68; openlayer jevals
_bench.pyand_calibrate.py, R17-S72). JevPlaysSnakeGame at b9237bf: whole repository (18 files),main.pyL1-12,src/runner.pyL1-26,src/game/engine.pyL1-151,src/game/snake.pyL1-78,src/agents/jev_agent.pyL1-64, read 16 Oct 2026, 05:38 UTC (R17-S73). competitor-hunter malformed at 40613ea:jev.pyL149 (R17-S159),hunt.pyL565-566, L778, L796 (R17-S155 to R17-S157). Labels: Documented (source at pinned commits). Nothing was run. - Recount of 14 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 43/16/7/3/8, bypass 52/25, below threshold 20/16/15/12/5/4/5, error 39/22/8/5/3, malformed 35/24/11/3/3/1; R16-S69); after the change every domain row and total recomputed by script from the map cells (no key 50/17/7/3/0 = 77, bypass 66/11 = 77, below threshold 25/16/15/12/5/4/0 = 77; error and malformed unchanged). Cells read at the published pins, 14 Oct 2026, 16:47–17:03 UTC: ticket-triage bypass (R16-S100 to R16-S107), zammad-jev-dispatcher malformed (
app.rbL117-138; R16-S103), email bypass and spam-leadgen-pipeline no key (R16-S108 to R16-S114), n8n no key and bypass (R16-S115 to R16-S121) with n8n's own missing-credential path at release n8n@2.44.1 (R16-S122 to R16-S124), n8n below threshold (R16-S314 to R16-S321), hermes-jev-mana no key (R16-S128), jev-trader no key (R16-S129 to R16-S132), jkudish/jev-mcp bypass (R16-S133, R16-S134), browser bypass (R16-S300 to R16-S313) and jev-for-chrome below threshold (R16-S307). Spot-checks of the triage bypass, n8n no-key and second-look cells matched (R16-S70). HEAD moved since the pin (cells read at the pin): gbesse/zammad-jev-triage →f46e5ad, spam-leadgen-pipeline →030bb0a(R16-S126). File paths and line ranges for each cell are on the domain pages. - Recount of 13 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 38/14/4/3/18, bypass 44/33, malformed 34/24/11/3/3/2; R15-S55, read 13 Oct 2026, 05:31 UTC); after the change every domain row and total recomputed by script from the map cells (no key 43/16/7/3/8 = 77, bypass 52/25 = 77, malformed 35/24/11/3/3/1 = 77). No-key and bypass cells for the 6 model-routing and 7 content-moderation rows read at the published pins, 13 Oct 2026, 05:18–05:26 UTC (R15-S100 to R15-S130; spot-check of the jev_antispam_bot no-key cell and the soter bypass cell against the raw files, 05:29 UTC, R15-S55). agent-router malformed:
decision-engine.tsL179, L196, L224 →run.tsL363 (exit code 2). jev-demo-moderator bypass "none found": entry-point files readserver.py,moderator.py,web/index.html(R15-S130). File paths and line ranges for each cell are on the domain pages. - Recount of 12 Oct 2026: the 74-row base as published here reproduces from this page's cells (error: 38/20/8/5/3; R14-S52, read 12 Oct 2026, 05:20 UTC), plus 3 real-time rows; every domain row and total recomputed by script from the map cells after the edit and checked against the totals in the research notes (39/22/8/5/3 = 77). mikespins/doom-jev at bd4e98f (
brain.pyL27–52, L291, L301–302, L331–334, L340–352;game.pyL193, L255–281, L287;jev_doom.pyL33, L41–45, L51; R13-S100 to R13-S120, R13-S68; HEAD unchanged 12 Oct 2026, 05:12 UTC, R14-S100). FazalAAli/jev-robotics-demo at 531de61 (jev_agent.pyL29–30, L198–293; R13-S69; only commit, unchanged 12 Oct 2026, 05:12 UTC, R14-S101). bileshg/JevPlaysSnakeGame at b9237bf (src/agents/jev_agent.pyL11–31, L54–64;src/game/engine.pyL96–151, L113, L127–128;config.yamlL2;main.pyL12;uv.lockL235–236; R14-S114, R14-S49, read 12 Oct 2026, 05:12–05:19 UTC). SDK defaults: typesafe-sdk 0.7.4 (typesafe_sdk/constants.pyL15, L18; R14-S48; timeout, retries and no-key error R13-S300, R13-S301, R13-S304). Labels: Documented (source at pinned commits). Nothing was run. - Recount of 11 Oct 2026: the 71-row base as published here reproduces from this page's cells (error: 38/17/8/5/3), plus 3 coding-agent rows; every domain row and total recomputed by script from the map cells after the edit and checked against the totals in the research notes (38/20/8/5/3 = 74). jev-triage 1.0.3 at 6360e21 (
index.jsL32–49: score cut L45, 5,000 ms L39, failure path L41–44, bypass L34; R13-S200, R13-S201, R13-S202), host OpenClaw at aa6008a, the provenance commit of @openclaw/typesafe 2026.9.8 (src/auto-reply/reply/dispatch-from-config.choose-route.tsL557–692;src/plugins/hooks.tsL789–847;src/plugins/hook-runner-global.tsL22–30;src/plugins/hook-types.tsL478–481; R13-S203 to R13-S207), read 11 Oct 2026, 05:17–05:18; drift check at @openclaw/typesafe 2026.10.1 (9cf7fc2; R13-S208, R13-S209). jev-for-all 0.7.1 from the npm tarball (gitHead74f62e7;bin/pick.tsL55–72,src/models.tsL20–75; R13-S222, R13-S223, R13-S224), read 11 Oct 2026, 05:20. hermes-jev-mana at 3daf639 (patches/jev-decisions.patchL88–93, L428–429, L436–458, L937–941, L1062–1078, L1396–1397;plugin/jev-mana/jevkit/decisions.pyL282–287;plugin/jev-mana/decision_hooks.pyL61–71;tools/jev_mana_install.pyL334–337, L401–402; R13-S210 to R13-S215), read 11 Oct 2026, 05:18–05:20; patch L88–93, L428–429 and L1396–1397 spot-checked against the raw file at the pin at 05:38. Labels: Documented (source at pinned commits); the installer's no-key statement is Reported. LanceDB TypeSafeReranker no-key cell at b1b080b (python/python/lancedb/rerankers/typesafe.pyL45–46, L94, L98–127, L153–157, L181–199; R13-S311, R13-S312), read 11 Oct 2026, 05:22; the SDK's no-key TypeSafeError, default timeout and retries from the typesafe-sdk 0.7.4 wheel (_core/config.pyL25–37,constants.pyL21–22,_core/retry.pyL52–62; R13-S300, R13-S301, R13-S304), read 11 Oct 2026, 05:21. - Recount of 10 Oct 2026: the 69-row base as published here reproduces from this page's cells (error: 38/15/8/5/3), plus 2 coding-agent rows; every domain row and total recomputed by script from the map cells and checked against the totals in the research notes. jev-effort-router 0.2.2 at
562dc2a:client.pyL178–179, L193–208, L210–228, L237–252;config.pyL29–34, L147–152;router.pyL105–137, L182–192, L250–253 (R12-S200–R12-S205); Hermes catalog pin and the one-commit diff (R12-S206, R12-S207); Hermes core sends the rewritten request:hermes_cli/middleware.pyL63–99 andagent/turn_api_request.pyL140–151 atf97608f(R12-S208, R12-S209); read 10 Oct 2026, 05:12–05:13 UTC. jev-gateway npm 0.5.1, repository named in npm metadata (gitHead37ff982); code read from the npm 0.5.1 tarball, read in memory and not run:jev.jsL65–66, L90–101;decide.jsL12–28, L102–110, L122–133, L141–161;config.jsL24, L39, L43–44;app.jsL117–118, L150–153, L205–212;launcher.mjsL112–119 (R12-S241, R12-S257); 10 Oct 2026, 05:13–05:15 UTC. - Recount of 8 Oct 2026: the 64-row base as published here, plus 5 rows and 5 changed cells; the scripted totals in the research notes were recomputed from this page's cells. New rows: LiteLLM TypeSafe compaction guardrail at 7964577 (
litellm/proxy/guardrails/guardrail_hooks/typesafe/typesafe.py; R9-S120); jev-reranker 0.1.2 d58594b (reranker.py,_client.py; R11-S200–R11-S203); LanceDB v0.40.0 b1b080b (rerankers/typesafe.py; R11-S204, R11-S205); pg-redact ee903ef (src/lib/jev.ts,src/app/api/classify/route.ts; R11-S220, R11-S221); docjev c7abe27 (src/jev_docs/engines/jev.py; R11-S222). Changed cells: jev-approvals with Hermes coreagent/auxiliary_client.pyL7610–7701, L7672–7675 at f97608f (R11-S110–R11-S112); jev-curatorplugin/transport.pyL118–131,plugin/graph.pyL21–24, L165–176 (R11-S108, R11-S109); openlayerbackends/__init__.pyL30–55 (R11-S107); rh-guardscore.tsL98–116,kinds.tsL36 (R11-S106); oh-my-claudecode v5.6.2454bae0(R11-S100–R11-S102) and jkudish/jev-mcp 0.14.186eae78(R11-S103, R11-S104): failure paths unchanged. - Recount of 7 Oct 2026, 05:23–05:30 UTC: the 58-row base as published here (R10-S30), plus 4 judge rows mapped from Jev as a judge (R10-S31) and its 4 Oct note (R10-S32) at DeepEval a200ece, openlayer jevals 0a8f895, did-they-answer e0ee60c and competitor-hunter 40613ea; plus 2 Hermes rows. Every condition row and every domain sums to its n (script). No existing row changed a cell.
- Hermes rows, 7 Oct 2026, 05:19–05:26 UTC (read at the pinned commits; spot-checks against the raw files at 05:24–05:25 matched): jev-approvals 28be98a (
plugin/jev_policy.pyL13, L54–59; R10-S41) with Hermes Agent core v2026.9.24 f97608f (tools/approval.pyL774–790,tools/approval_smart.pyL115–131; R10-S101–R10-S105, R9-S61); jev-curator 4e8626c (plugin/engine.pyL91–94,plugin/guard.pyL57–74, L143–160,plugin.yamlL50–53; R10-S106–R10-S111). Settled without a count change: rh-guard default mode (src/lib/risk/kinds.tsL176–189 at c2e682e; R10-S117, R10-S118); OpenCode v1.18.35 default rules (packages/opencode/src/agent/agent.tsL119–136 at 53d1eab; R10-S114–R10-S116); osuki 0.2.8, tag0ae9e884a97a5539fef3f0772318a628c1f75e00(R10-S112, R10-S113). - Recount of 6 Oct 2026, 05:22–05:29 UTC: the 51-row base as published here, read 05:25:44, plus 7 new rows; every domain row and total sums to its n (script). No existing row changed.
- jev-permission-gate: madisonrickert/jev-permission-gate 7349bc9 (
hooks/policy.ts,hooks/register.ts,hooks/typesafe.ts), read 4 Oct 2026; HEAD = that pin bygit ls-remote, 6 Oct 2026, 05:20:19 (R9-S70). Not counted: gulbaki/jev-llm-guard 7c7b1b5 (src/cli.js,src/web-server.js; R9-S70, R9-S71). - Coding agents: six rows read at pinned commits, 6 Oct 2026, 05:14–05:25 (read at the pinned commits; spot-checked against the raw files at 05:22): jev-kit 3d74b05 (
packages/hook-adapters/src/index.ts,packages/agent-review/src/index.ts,packages/decision-contract/src/index.ts,packages/cli/src/cli.ts; R9-S72, R9-S73); codex-jev-approval-hook b6242c9 (hook.ps1; R9-S81); rh-guard c2e682e (src/lib/risk/score.ts,jev.ts,hooks.ts,hosts.ts,hooks/run.ts; R9-S82); opencode-tool-gate bdf1ef8 (src/index.ts,src/jev.ts,src/judge.ts; R9-S74);@osuki-dev/opencode-osuki-agent0.2.7, tag commitc96ce03c1c7dfc5c6fdf9d966691549101c68080(dist/index.js; R9-S80); hermes-jev jev-judge 5dddbea (plugins/jev-judge/__init__.py,jev.py,gate.py,plugin.yaml; R9-S63). - Recount of 5 Oct 2026, 05:29 UTC: the 39-row base as published here, read 05:26, plus 12 new rows; every domain row and total sums to its n. No existing row changed.
- Browser and computer use: eight projects read at pinned commits, 5 Oct 2026, 05:12–05:24 (spot-check of 15 key lines against the raw files): jev-ultrafast 1231850 (
jev_ultrafast/model.py,agent.py); ironbee-express 05079b4 (src/engine/systemone.ts,src/agent/policy.ts,agent.ts,run/runner.ts); jev-agent-browser eb35251 (src/decision.js,src/loop.js,src/classifier.js,cli.js); jev-android be8364a (JevProvider.kt,ProviderTransport.kt,JevAgent.kt,Models.kt); computer-use-jev ff0ad8b (decide/decide.go,typesafe/client.go,cmd/computer-use-jev/main.go); jev-for-chrome d5c24de (src/background/agent.ts,src/shared/providers/http.ts,typesafe.ts); Ulka bb04433 (apps/extension/src/agent/vercel-jev.ts,agent-runner.ts,approvals.ts,background.ts); second-look 0c05d16 (backend/app/jev.py,backend/app/research.py). Not counted: trycua/cua jev-use ba0033a (run.py: mock provider by default). - Framework integrations: four decision rows read at pinned tags or commits, 5 Oct 2026, 05:12–05:27 (spot-check of 26 key lines against the raw files, plus a second read of the three decision paths): Spring AI TypeSafe 51993bb (
JevDocumentFilter.java,RetryPolicy.java,TypeSafeConstants.java); LlamaIndex JevRerank 421afda (base.py,utils.py); LangChain ModelRouterMiddleware 4af7ab8 (model_router.py,classifier.py); LangChain autoModeMiddleware 417ddcf (src/middleware/autoMode.ts,classifier.ts). - Domain tables re-read on 4 Oct 2026 at 05:19; counts recomputed 05:19–05:30. Each cell's file path and line range is on its domain page.
- Support-ticket triage: five projects read at pinned commits, 1 Oct 2026, 05:32–05:36; bypass and the zammad-jev-dispatcher malformed path read at the same pins, 14 Oct 2026 (R16-S100 to R16-S107).
- Model routing: six routers read at pinned commits, 2 Oct 2026, 05:16–05:21; no-key and bypass paths read at the same pins, 13 Oct 2026, 05:18–05:26 (R15-S100 to R15-S130).
- Content moderation: six projects read at pinned commits, 2 Oct 2026, 05:23–05:27; no-key and bypass paths read at the same pins, 13 Oct 2026, 05:18–05:26 (R15-S100 to R15-S130).
- Claude Code and MCP guards: integrations read in pinned source, 29 Sep 2026, 07:09–07:14; versions rechecked 3 Oct 2026, 05:21 (oh-my-claudecode at v5.6.0, jkudish/jev-mcp at 0.13.0) and 8 Oct 2026 (v5.6.2 and 0.14.1: failure paths unchanged). The danna-zhou no-key cell was also Tested offline there (no Jev call), 29 Sep 2026. claude-model-guard and claude-jev-advisor read at their pins 16 Oct 2026; bypass entry points read 18 Oct 2026. ohmyjev read at its pin 16 Oct 2026; every entry-point file read for its Jev paths 18–19 Oct 2026 (R19-S200 to R19-S206); re-read at 0.13.2 (commit d307c39), 2 Nov 2026: gates now need lockdown (off by default); same five terms in lockdown mode (R26-S20 to R26-S24); re-read at 0.14.0 (commit fbc4ea4), 8 Nov 2026: failure cells unchanged; bypass cell adds the shadow setting and the in-repo move skip (R28-S20 to R28-S23).
- Email and lead sorting: five projects read at pinned commits, 3 Oct 2026, 05:19–05:27; bypass and the spam-leadgen-pipeline no-key path read at the same pins, 14 Oct 2026 (R16-S108 to R16-S114).
- Jev in n8n: five nodes read at pinned commits, 3 Oct 2026, 05:20–05:27; no-key, bypass and below-threshold paths read at the same pins and n8n's missing-credential path at release n8n@2.44.1, 14 Oct 2026 (R16-S115 to R16-S124, R16-S314 to R16-S321).
- Trading and fraud gates: seven projects read at pinned commits, 4 Oct 2026, 05:14–05:21: QuantDinger a5a9f4c (
backend_api_python/app/services/ai_decision_filter.py,services/strategy_v2/live_execution.py,routes/quick_trade.py,routes/quick_trade_ai.py,routes/alpaca.py,services/trading_executor.py,services/pending_order_worker.py,tests/test_ai_decision_filter.py); jev-trader b587759 (src/config.ts,model.ts,trader.ts,market.ts,server.ts); Jev Trade a3f2f83 (src/config.ts,model.ts,plan.ts,trader.ts,index.ts,market.ts,sleeves.ts,server.ts); btc-hft-jev 96f3541 (jevloop/client.py,loop.py,policy.py,battery.py,ladder.py,state.py,strategy.py,limits.py,execution/alpaca.py); jev-fraud-shield eeb4fc6 (jev_client.py,decision_engine.py,demo.py); fraud-jev aa33b97 (src/lib/fraud.ts,src/app/api/analyze/jev/route.ts); expense-policy gate 161c33b (src/jev_expense_gate/cli.py,jev_client.py,policy.py,pipeline.py,config.py,config/expense-policy.json). - Query wording: Google suggest (
client=firefox), YouTube (ds=yt), Bing (osjson) and DuckDuckGo (ac), 4 Oct 2026, 05:21:29, for "jev fallback", "jev timeout", "jev error handling", "jev fail open", "jev retry" and "typesafe api error": no relevant suggestion (the same result as 3 Oct). A suggestion is a demand signal, never a volume.