Shaduf.Research preview
Build80 implementations in 12 domains, recomputed

When Jev fails (TypeSafe AI)

What do real Jev implementations do when Jev returns an error, a malformed answer or an unsure answer, when no API key is set, or when a code path skips Jev? This page counts the answers across 80 implementations in twelve use cases, already published row by row on their domain pages, and turns them into an eight-question checklist for your own code. The title is an internal label: six failure phrases ("jev fallback", "jev timeout", "jev error handling", "jev fail open", "jev retry", "typesafe api error") got no relevant autocomplete suggestion on Google, YouTube, Bing or DuckDuckGo when the pool checked on .

Key finding

For all 80 counted implementations, every failure cell (no key, error, malformed answer, below threshold and bypass) is recorded from source at pinned commits (19 Oct 2026).

Documentedeach of the five columns sums to 80 with 0 not recorded (script count over the map below), checked

Of 80 Jev implementations read in source, on a Jev error 40 stop or hold the action, 22 fall back, 10 let it through, 5 return no decision and 3 are advisory. The 10 that let it through are 4 moderation bots, 4 agent hooks, a passage filter and an eval tool.

Documentedrecomputed from 12 domain tables (script count over the map below), checked

With no API key, 51 of 80 implementations refuse to start, error or hold; 17 fall back, 9 proceed as if allowed and 3 are advisory (source read at pinned commits; recounted 19 Oct 2026).

Code paths that never ask Jev are recorded for all 80 implementations (source at pinned commits, 19 Oct 2026): 13 "none found" in the files read, 67 with their skip paths listed.

Documentedfrom source at the pinned commits; some cells are judgements (listed), checked

The eval tool is openlayer jevals: its report counts an errored eval as passed and its gate allows by default. Counting 9 fallbacks that can still end in the action as well, the action goes ahead on a Jev error in 19 of 80 (10 fail-open plus 9 fallbacks; details).

"Keep the last action" counts as going ahead: doom-jev and JevPlaysSnakeGame keep acting on a choice Jev did not make for this tick (counting choice, 12 Oct 2026).

The 4 agent hooks are danna-zhou/jev-mcp (PreToolUse hook), claude-model-guard (a model-tier guard, added 18 Oct 2026) and ohmyjev (Bash, Write/Edit and exfiltration gates in lockdown mode without shadow, both off by default; added 19 Oct 2026, re-read at 0.14.0 on 8 Nov 2026) for Claude Code, and jev-judge for Hermes Agent, in enforce mode (its default is shadow).

Implementations were picked per domain page as stated there, not as a survey. The counts describe these 80 implementations at their pinned commits; they are not a rate for Jev integrations in general. "Not recorded" means the domain page and its research note do not record the cell; it is never inferred. n = 80 in every count. The official TypeSafe Claude Code plugin makes no runtime Jev call, so it is excluded from every denominator; the trycua/cua jev-use example calls a mock provider by default and is not counted either. Judge tools count from 7 Oct 2026: a judge whose own code turns Jev's answer into a score, pass/fail or gate is an action (an error that becomes a pass is fail-open; a dropped item is no-decision). The four judge tools on Jev as a judge form the LLM as a judge domain. The Jevals harness on Jev as a judge is not counted: its code is not public, so its failure cells are Reported from its methodology page, not read at a pinned commit. From 8 Oct 2026 a reranker counts when its own code reorders or cuts results, and a document pipeline when its own code acts on Jev's answer: LiteLLM's compaction guardrail, jev-reranker and LanceDB's TypeSafeReranker are counted under Frameworks (see Jev reranker and Jev for RAG), pg-redact under Content moderation and docjev under Email and lead (see Jev inside SQL and document pipelines). These are nearest domains: no new domain reached 3 rows. The three SQL extensions are listed but not counted. From 12 Oct 2026 three game and robot-simulation demos that call Jev by default form the Real-time control (games and simulations) domain; ra2web (calls a local substitute by default) and llm-invaders (a research harness) are listed on Jev plays Doom: what real-time demos do when a Jev call fails and not counted. n8n nodes are counted with Continue On Fail (COF) off, the default; the COF-on result is given beside them. The pool ran nothing for this page: no bot, no browser agent, no eval, no Jev call.

Change, 8 Nov 2026: ohmyjev re-read at 0.14.0 (commit fbc4ea4). Its four failure cells are unchanged. A new shadow setting, off by default, runs the lockdown checks but blocks nothing, and in-repo mkdir, touch, cp and mv now skip Jev. Every total is unchanged (still 80 implementations). Documented (R28-S20 to R28-S23)

Change, 2 Nov 2026: ohmyjev re-read at 0.13.2 (commit d307c39). Its gates now run only with the lockdown setting on, and lockdown is off by default. In lockdown mode its five cells keep the same terms, so every total is unchanged (still 80 implementations). The row now names the mode; its bypass cell records the default skip and the removed auto-approve path.

Change, 23 Oct 2026: the two jev-gateway repository links now point to vinilana/jev-gateway at the same commit 37ff982, the repository named in its npm metadata; the earlier links returned HTTP 404 on 23 Oct 2026, 05:34 UTC (R22-S52, R22-S53). No cell or count changed.

Change, 21 Oct 2026: the ohmyjev row names its pi and omp adapters, read at the same commit with the same five terms (still 80 implementations); one file reference in its bypass cell corrected.

Change, 20 Oct 2026: a self-check compares your own choices in the five failure conditions with the 80 rows (same counts as the map; no count changed). Checklist question 9 added: whether your code logs or shows a fallback or fail-open (not counted across the 80). The summary lines under each domain heading now give the n 80 numbers.

Change, 19 Oct 2026: ohmyjev (Claude Code module) added, read at its pinned commit after its pi and omp adapters were read in full. n 79 → 80; Claude Code / MCP guards 8 → 9. On a Jev error fail-open 9 → 10; action goes ahead 18 of 79 → 19 of 80. No key: fail-open 8 → 9. Malformed: fail-open 12 → 13. Below threshold: acts-anyway 15 → 16. Bypass recorded 79 → 80 ("none found" stays 13; skip lists 66 → 67). No existing cell changed. jkudish/jev-mcp now cites the commit its cells were read at (53fe575, 0.11.0) with the later 0.14.1 check on its own line; the jev-support-desk timeouts are marked as SDK defaults.

Change, 18 Oct 2026: two Claude Code rows added, read at their pinned commits: claude-model-guard (fail-open on a Jev error, a malformed answer and no key; advisory below threshold) and claude-jev-advisor's Windows rm hook (the guard's own ask stands in every failure case). n 77 → 79; Claude Code / MCP guards 6 → 8. On a Jev error fail-closed 39 → 40 and fail-open 8 → 9; action goes ahead 17 of 77 → 18 of 79. No key: fail-closed 50 → 51, fail-open 7 → 8. Malformed: fail-closed 35 → 36, fail-open 11 → 12. Below threshold: held 16 → 17, advisory 4 → 5. Bypass recorded 77 → 79 ("none found" stays 13; skip lists 64 → 66). No existing cell changed.

Change, 16 Oct 2026: the last 11 bypass cells and the last malformed cell were read at their pinned commits; every failure cell is now recorded for all 77. Bypass recorded 66 → 77, not recorded 11 → 0 (judge tools 4, frameworks 3, browser agents 3, email 1). Malformed: competitor-hunter is now no-decision (an unreadable reply leaves the item out of its ranking), so no-decision 3 → 4 and not recorded 1 → 0. JevPlaysSnakeGame's bypass cell now rests on the whole repository (still "none found"; count unchanged). Cell texts corrected with the term unchanged: openlayer jevals and second-look (malformed), did-they-answer, competitor-hunter and the ilyamk Gmail labeler (Jev error), Spring AI JevDocumentFilter (below threshold and no key); a scope note added to DeepEval JevEval (Jev error).

Change, 14 Oct 2026: no-key, bypass and n8n below-threshold cells settled for ticket triage, email and lead sorting, n8n, browser and computer use, and three single rows (jev-trader, hermes-jev-mana, jev-mcp), read at the published pins; n8n's own missing-credential path read at release n8n@2.44.1. No key: not recorded 8 → 0; fail-closed 43 → 50, fallback 16 → 17. Bypass recorded 52 → 66, not recorded 25 → 11 (judge tools 4, frameworks 3, browser agents 3, email 1); a cell counts as recorded only when every entry point was read. Below threshold: no-threshold 20 → 25, not recorded 5 → 0. zammad-jev-dispatcher's malformed cell now separates a held off-list choice from the 502 for a missing probabilities map; jev-for-chrome's below-threshold cell notes a second look for a final 'done' or 'blocked' below 0.5.

Change, 13 Oct 2026: no-key and bypass cells settled for model routing and content moderation (read at the published pins). No key: not recorded 18 → 8; fail-closed 38 → 43, fallback 14 → 16, fail-open 4 → 7. Bypass recorded 44 → 52, not recorded 33 → 25. Model routing and content moderation now have no not recorded no-key or bypass cells. Malformed: agent-router is now fail-closed (exit code 2; it was not recorded), so malformed fail-closed 34 → 35 and not recorded 2 → 1 (counting choice). Qualifiers added without a count change: jev-router below threshold (an upgrade capped at sonnet), autojev on named Jev routes (equal load balancing) and its bypass (10 paths), jev_antispam_bot bypass (3 more skip paths).

Change, 12 Oct 2026: three real-time demo rows added (doom-jev, jev-robotics-demo, JevPlaysSnakeGame) in a new domain, Real-time control (games and simulations). n 74 → 77; on a Jev error fail-closed 38 → 39 and fallback 20 → 22; action goes ahead 15 → 17 (now of 77); malformed fail-closed 33 → 34, fallback 22 → 24; below-threshold no-threshold 18 → 20, no-decision 4 → 5; no-key fail-closed 36 → 38, fallback 13 → 14; bypass recorded 41 → 44; 11 → 12 domain tables.

Change, 11 Oct 2026: three coding-agent rows added (jev-triage, the jev-for-all start launcher and hermes-jev-mana; counting choice), all routing fallbacks. n 71 → 74; on a Jev error fallback 17 → 20 (routing fallbacks 5 → 8); action goes ahead stays 15 (now of 74); malformed fallback 19 → 22; below-threshold fallback 9 → 12; no-key fallback 11 → 13; no-key not recorded 18 → 19 with the new rows, then 19 → 18 and fail-closed 35 → 36 because LanceDB's no-key cell, read on 11 Oct, is now fail-closed (it was not recorded); bypass recorded 38 → 41; Coding agents domain 10 → 13.

What the 80 do, condition by condition

80 implementations per condition: each bar is split by what the code does (default settings)

  • Jev error or timeoutHTTP error, rate limit, timeout; n8n with Continue On Fail off · n = 80 · not recorded 0/80
    • 40/80 fail-closed
    • 22/80 fallback
    • 3/80 advisory
    • 5/80 no-decision
    • 10/80 fail-open
    • 0/80 not recorded

    action goes ahead 19/80 on a Jev error: the 10 fail-open rows (4 content-moderation bots, the danna-zhou hook, claude-model-guard, added 18 Oct, ohmyjev in lockdown mode, added 19 Oct, jev-judge in enforce mode, the Spring AI passage filter and openlayer jevals, whose report counts an errored eval as passed) plus 9 fallbacks that can still end in the action (QuantDinger after its LLM fallback; btc-hft-jev through rules-only; jev-permission-gate, where Claude Code's built-in classifier can still allow; rh-guard, where its lexical detectors can still allow; opencode-tool-gate, where OpenCode's default rules allow every tool, checked at v1.18.35; jev-approvals, where Hermes core hands the question to the main agent model, which can approve the command, corrected 8 Oct; jev-gateway, where the request passes through, the agent's own model picks the tool and the call runs, added 10 Oct; doom-jev and JevPlaysSnakeGame, which keep applying the last action, added 12 Oct). Not counted here: the 8 routing fallbacks (the 4 model routers; jev-effort-router, which keeps the operator's configured model; jev-triage, which passes the message to the main model; the jev-for-all launcher, which starts the default model; and hermes-jev-mana, which runs the original Hermes branch, added 11 Oct), the LlamaIndex reranker and LiteLLM's compaction guardrail, which return another model, the retriever's order or the uncompacted request by design; osuki, whose fallback routes to the default tier (the same routing-fallback convention; on the coding-agents page its tool call still runs); second-look, which shows a recommendation to a person and takes no action; jev-curator, which holds; DeepEval, which aborts the run; and did-they-answer and competitor-hunter, which drop the item.

  • Malformed answerunknown option, missing field, bad probability · n = 80 · not recorded 0/80
    • 36/80 fail-closed
    • 24/80 fallback
    • 3/80 advisory
    • 4/80 no-decision
    • 13/80 fail-open
    • 0/80 not recorded
  • Below thresholdJev answers but is unsure; separate terms, never added to the error totals · n = 80 · not recorded 0/80
    • 17/80 held
    • 12/80 fallback
    • 5/80 advisory
    • 5/80 no-decision
    • 16/80 acts-anyway
    • 25/80 no-threshold
    • 0/80 not recorded
  • No API key configuredn = 80 · not recorded 0/80
    • 51/80 fail-closed
    • 17/80 fallback
    • 3/80 advisory
    • 0/80 no-decision
    • 9/80 fail-open
    • 0/80 not recorded
  • Bypassa code path that acts without asking Jev · n = 80 · not recorded 0/80
    • 80/80 recorded
    • 0/80 not recorded
Every number is in the text beside its bar; the bars only show the same numbers as lengths. Colours: green stops, refuses or holds (fail-closed, held: a person, the host's prompt or, for two passage filters, the code's own cut decides); blue is a named substitute (fallback-…); amber means Jev never decides (advisory); gray returns nothing and leaves it to the caller (no-decision); red acts anyway (fail-open, acts-anyway); dashed is no-threshold (no confidence cut in the code); white is not recorded. Documented recomputed from the domain tables, 19 Oct 2026.

The same numbers as tables:

Error-type conditions: each row sums to 80
Conditionnfail-closedfail-openadvisoryfallbackno-decisionnot recorded
Jev error or timeout80401032250
Malformed answer80361332440
No API key configured8051931700
Below threshold: its own terms, counted separately; sums to 80
Conditionnheldacts-anywayfallbackno-decisionadvisoryno-thresholdnot recorded
Below threshold8017161255250
Bypass: sums to 80. "Not recorded" means not every entry point was read (from 14 Oct 2026 a cell counts as recorded only when every entry point was read); it does not mean "none"
Conditionnrecordednot recorded
Bypass80800

Counting judgements in the 5, 6, 7, 8, 10, 11, 12, 14, 16 and 18 Oct recounts

  • second-look is counted as a browser row although it never acts: it recommends, and a person buys.
  • second-look (kaushiksiva/second-look, 0c05d16) is counted here in the browser domain (8 rows); the browser page counts 7 agents, the ones that click, type or tap, and shows second-look separately because it only recommends.
  • The JS autoModeMiddleware (@langchain/typesafe 0.0.2) is counted under frameworks, separately from the Python AutoModeMiddleware already counted on Claude Code / MCP guards.
  • Pydantic AI TypeSafeModel is not a decision row: it raises Jev errors to the agent the builder writes. Its behaviour is on framework integrations.
  • ironbee-express with no key is counted fail-open (conditional: a cached recording replays unjudged), following the 4 Oct convention for conditional cells.
  • 6 Oct: gulbaki/jev-llm-guard is not counted: it returns a verdict; it is not a decision. Its jev-guard CLI exits 0 whatever the verdict (allow, review or block) and exits 1 only on errors.
  • 6 Oct: jev-judge (Hermes Agent) is counted although its default is shadow (logs only); its cells describe enforce mode.
  • 6 Oct: osuki (OpenCode) is not counted in the "action goes ahead" line: its fallback routes to a default tier, under the same routing-fallback convention as the model routers and LlamaIndex.
  • 7 Oct: the four judge tools on Jev as a judge are counted as the "LLM as a judge" domain (4 rows), with the same cells and colours as on that page. DeepEval counts although it is a library: its own test runner in the same repository aborts the run or fails the test case. The Jevals harness is not counted: its code is not public.
  • 7 Oct: conditional judge cells follow the 4 Oct convention (the default configuration counts; the condition is in the note). openlayer: a Jev error is fail-open (the report says passed; the gate allows by default), and its no-key cell is not recorded because neither the page nor its research note says which backend branch is the default. did-they-answer: malformed is fail-closed (missing answer keys stop the run); the missing-usage case alone gives no-decision. competitor-hunter: a Jev error is no-decision; above 5% errors the run aborts.
  • 7 Oct: the Hermes plugins jev-approvals and jev-curator are now counted (they were "not settled" on 6 Oct). Hermes core v2026.9.24 runs an APPROVE without a person and sends errors to a person. Both do nothing until switched on: jev-approvals is off after install (core default manual), and jev-curator observes by default. Their cells describe the switched-on modes.
  • 7 Oct: settled without a count change: rh-guard's default mode is enforce; opencode-tool-gate's "action goes ahead" holds under OpenCode's default rules (v1.18.35: every tool allowed); osuki checked at 0.2.8, failure path unchanged.
  • 8 Oct: five rows added under the 8 Oct rule (a reranker counts when its own code reorders or cuts results; a document pipeline when its own code acts on Jev's answer). LiteLLM's TypeSafe compaction guardrail, jev-reranker and LanceDB's TypeSafeReranker go under Frameworks, where the Spring AI passage filter and the LlamaIndex reranker already sit; pg-redact (PII redaction before storage) under Content moderation; docjev (document splitting) under Email and lead. "Reranking and RAG" and "Data and documents" would each hold 2 rows, so neither domain is formed and no existing row moves.
  • 8 Oct, three counting choices: LiteLLM's compaction guardrail is counted although the results it removes are tool outputs, not retrieved passages (without it n would be 68); pg-redact's malformed cell is fail-open (a missing span answer stores the span unredacted; a broken body gives 502); openlayer's no-key cell is fallback-another backend (it fails closed if no other backend is configured).
  • 8 Oct, corrected: jev-approvals no longer counts as fail-closed on a Jev error. On a timeout, connection error, 429 or 402, Hermes core v2026.9.24 hands the approval question to the main agent model, which can approve the command; only other HTTP errors still go to a person. It moves to fallback and into the "action goes ahead" line. Also filled on 8 Oct: jev-curator's malformed (fail-closed), below-threshold (held) and no-key (fail-closed) cells, and openlayer's no-key cell. rh-guard's below-threshold text was clarified (0.5 is Jev's choice confidence; REVIEW_THRESHOLD 0.45 is a risk-label floor); its term is unchanged.
  • 10 Oct: two coding-agent rows added (counting choice). jev-effort-router is a routing fallback, like osuki: on a Jev error, a wholly malformed answer or no key the request is left untouched and the turn runs on the operator's configured model, so it is not in "action goes ahead". Below its 0.5 cut the code rewrites the request to deepseek-v4.1-flash at medium effort (fallback-default model). jev-gateway passes the request to the agent's own model on a Jev error, a malformed answer or an unsure answer; that model picks the tool and the call runs, so jev-gateway is one of the 7 fallbacks that can still end in the action. Its below-threshold cell is fallback-agent's own model, not acts-anyway, because Jev's answer is not used. With no key the gateway does not start (fail-closed). jev-triage and hermes-jev-mana were read on 10 Oct but are not settled on coding agents, so they were not counted then; both are counted from 11 Oct (next item).
  • 11 Oct: three coding-agent rows added (counting choice), all routing fallbacks, so none is in "action goes ahead". jev-triage (OpenClaw) makes the host skip the main model for "thanks" and "spam"; on any failure the message goes to the main model as if the plugin were absent. The jev-for-all start launcher is counted on the launcher only; on any failure it starts the default tier at medium effort, and its OpenCode plugin part is not settled. hermes-jev-mana is counted under the 7 Oct rule (a plugin that is off or observe-only after install still counts, with its state next to the row): inert after the documented install, because admit_unlabeled defaults to false and every Jev call is refused; its cells describe the mode with admit_unlabeled: true, where an error, a malformed or an unsure answer runs the original Hermes branch. Its no-key cell is not recorded.
  • 12 Oct: three real-time demos counted (counting choice): doom-jev, jev-robotics-demo and JevPlaysSnakeGame call TypeSafe's Jev by default and their own code applies the move, so they form the Real-time control (games and simulations) domain (3 rows). ra2web is listed on the real-time page as a design contrast and not counted: it calls a local substitute by default. llm-invaders is listed there as a research harness and not counted: no model player is the default, and it reaches Jev through OpenRouter. "Keep the last action" counts as "action goes ahead": the loop keeps acting on a choice Jev did not make for this tick. Cell-level judgements: doom-jev's malformed cell is an inference from the 11 Oct 2026 read (no validation); JevPlaysSnakeGame's no-key cell rests on the SDK raising a catchable error for a missing key (typesafe-sdk 0.7.4, the version the demo locks), and its bypass cell covered engine.py L96–151 only until 16 Oct, when the whole repository was read (still none found); jev-robotics-demo's no-key and timeout cells depend on the SDK version, which the demo does not pin (values for 0.7.x).
  • 14 Oct (editorial decision): a bypass cell counts as recorded only when every entry point was read. Four rows read only in part stay not recorded: the ilyamk Gmail labeler, jev-android, jev-for-chrome and second-look; the skip paths found in the Gmail labeler and second-look are shown in their cells. Judgement cells settled 14 Oct: jev-trader no key (fail-closed with MODEL=jev; the default model is mock), hermes-jev-mana no key (the jev CLI, which reads the key, was not read), taifoon and zampierid4p no key, DomMonte bypass, and the official and vibe-with-me-tools below-threshold cells (optional outputs; defaults partly read). zammad-jev-dispatcher's malformed cell stays fail-closed: the malformed column has no "held" term, so the held off-list choice is in the note.
  • 16 Oct (editorial decision): four bypass cells count as recorded with their read scope named in the cell. openlayer jevals: every entry point in full except the documentation helper integrations/_docs.py, read at its function and return lines (it builds a help text and runs no evaluation). competitor-hunter: all code and web scripts in full; the markup of its two HTML pages checked by script for event handlers (none found), their inline scripts read. ilyamk Gmail labeler: entry functions found by a scripted scan of triggers, menus and web-callable handlers in CODE.gs; helper functions on the path to the Jev call not read in full. LlamaIndex JevRerank: the postprocessor in full; its Cloudflare and Vercel provider clients at their branch, return and raise lines.
  • 16 Oct (editorial decision): competitor-hunter's malformed cell is no-decision, with the fail-closed case as a note, as its Jev-error cell is written: an unreadable reply is caught like a Jev error and the item is left out of the ranking (jev.py L149, caught at hunt.py L565-566); a reply missing its answers stops the ranking stage (hunt.py L778, L796). second-look's malformed cell stays fallback-heuristic verdict: a verdict outside the four known values is a narrower case, noted in the cell (research.py L203-204; caught on the voice path, live.py L123-125).
  • 18 Oct (editorial decision): claude-model-guard is counted although it is a model-tier gate, not a safety gate: its own code blocks a prompt on Jev's answer. Its bypass cell rests on every entry point at the pin (the git tree, 24 files).
  • 18 Oct (editorial decision): claude-jev-advisor's rm hook is counted with fail-closed (held) cells: its own guard asks before a deletion, and Jev can only lift that ask when every target scores at least 0.8. Only the rm hook is a tool-call path; its context, status-line and CLI entry points make no permission decision. It installs on Windows only.
  • Listed but not counted: the three SQL extensions on Jev inside SQL and document pipelines (pg-jev, sqlite3-jev, sqlite-jev). Their value goes back into your query, which decides what to do with it; a Jev error still aborts the statement, as that page shows.

The same counts by domain

Open a condition to see its counts per domain. Opening one closes the others. Each row sums to its n; "not recorded" is a column of its own. The domain name links to the page with the per-project rows.

Jev error or timeoutfail-closed 40, fail-open 10, advisory 3, fallback 22, no-decision 5 (of 80)
Domainnfail-closedfail-openadvisoryfallbackno-decisionnot recorded
Ticket triage5400100
Model routing6100410
Content moderation7240010
Claude Code / MCP guards9233100
Email and lead6500010
n8n nodes (COF off)5500000
Trading and fraud7500200
Browser and computer use8700100
Frameworks7410200
Coding agents13310900
LLM as a judge4110020
Real-time control (games and simulations)3100200
All80401032250

n8n with COF on: fallback 4, no-decision 1 (of 5). The action goes ahead on a Jev error in 19 of 80: the 10 fail-open rows plus 9 fallbacks (2 trading, jev-permission-gate, rh-guard, opencode-tool-gate, jev-approvals, jev-gateway, and doom-jev and JevPlaysSnakeGame, which keep the last action). osuki's default-tier fallback, jev-effort-router's configured model, jev-triage's main model, jev-for-all's default model, hermes-jev-mana's original Hermes branch and LiteLLM's uncompacted request are not counted there (routing-fallback convention).

Malformed answerfail-closed 36, fail-open 13, advisory 3, fallback 24, no-decision 4, not recorded 0 (of 80)
Domainnfail-closedfail-openadvisoryfallbackno-decisionnot recorded
Ticket triage5400100
Model routing6100410
Content moderation7060010
Claude Code / MCP guards9233100
Email and lead6400110
n8n nodes (COF off)5500000
Trading and fraud7320200
Browser and computer use8600200
Frameworks7410200
Coding agents13410800
LLM as a judge4200110
Real-time control (games and simulations)3100200
All80361332440

The 2 trading fail-open cells (jev-trader, fraud-jev) depend on the shape of the bad answer. jev-agent-browser is counted as a fallback (semantic target resolver), but the target it picks by word overlap is then clicked.

Below thresholdheld 17, acts-anyway 16, fallback 12, no-decision 5, advisory 5, no-threshold 25, not recorded 0 (of 80)
Domainnheldacts-anywayfallbackno-decisionadvisoryno-thresholdnot recorded
Ticket triage54000010
Model routing61021020
Content moderation71400110
Claude Code / MCP guards92210400
Email and lead61221000
n8n nodes (COF off)50000050
Trading and fraud72210020
Browser and computer use80002060
Frameworks72200030
Coding agents134360000
LLM as a judge40100030
Real-time control (games and simulations)30001020
All8017161255250

Counted with the below-threshold terms and never added to the error totals. n8n: all 5 nodes have no threshold by default; 2 offer an optional low-confidence output (below 0.5) and 1 an optional review route (read at the pinned commits, 14 Oct 2026). jev-for-chrome has no threshold for actions; a final 'done' or 'blocked' below 0.5 gets a second look. jev-android (below 0.65) and computer-use-jev (mutating actions below 0.5) stop with BLOCKED or an error for the caller: no-decision, not held, because no person or review queue receives the item.

No API keyfail-closed 51, fail-open 9, advisory 3, fallback 17, not recorded 0 (of 80)
Domainnfail-closedfail-openadvisoryfallbackno-decisionnot recorded
Ticket triage5500000
Model routing6300300
Content moderation7340000
Claude Code / MCP guards9233100
Email and lead6600000
n8n nodes (COF off)5500000
Trading and fraud7400300
Browser and computer use8610100
Frameworks7700000
Coding agents13510700
LLM as a judge4300100
Real-time control (games and simulations)3200100
All8051931700
Bypassrecorded 80, not recorded 0 (of 80)

Not recorded 0 of 80 (19 Oct 2026). A cell counts as recorded only when every entry point was read (rule of 14 Oct 2026). The cell is "none found" in the files read for 13 of 80; the other 67 list their skip paths. Four cells name their read scope: openlayer jevals, competitor-hunter, the ilyamk Gmail labeler and LlamaIndex JevRerank.

Domains with 3 or more implementations: 12 of 12 (3 to 13 each). Claude Code / MCP guards: 9 (8 until 19 Oct 2026; 6 until 18 Oct 2026). How the pages picked their implementations is stated on each domain page.

New domain, 12 Oct 2026: Real-time control (games and simulations)

3 game and robot-simulation demos that call Jev by default, read at pinned commits. Of the 3, on a Jev error 2 keep their last action (doom-jev, JevPlaysSnakeGame) and 1 stops (jev-robotics-demo). Loop ticks, patterns to copy and the 2 harnesses that are listed but not counted are on Jev plays Doom: what real-time demos do when a Jev call fails. The timeout column is a value, not a verdict, so it is not coloured. Documented code at the pins, checked ; the pool ran nothing.

Real-time control (games and simulations): 3 rows, the same cells as in the map below
Implementation (commit)Jev error or timeoutMalformedBelow thresholdNo keyBypassTimeout against tick
mikespins/doom-jev commit bd4e98f runnable demofallback-last actionthe game keeps applying the last action every tick; 2.0 s timeout, no retries action goes aheadfallback-last actionno validation; the error stays inside the request task (inference from the 11 Oct 2026 read)no-thresholdthe top of 6 actions is appliedfail-closedexits before the game startsrecordedshoot and stop-at-wall reflexes override Jev; moves forward until the first answer2.0 s, no retries, against a 0.12 s tick (about 17 ticks); at most 5 requests in flight; stale answers dropped
FazalAAli/jev-robotics-demo commit 531de61 runnable demofail-closedthe demo stops; no action is taken (no try)fail-closedthe demo stopsno-decisiongrasp/release below 0.75 does nothing; move and target take the top optionfail-closedraises when the client is built (SDK 0.7.x)recordeda single legal move is made without a call; a hand reflex; the simulation filters unsafe movesnone in code: SDK default 10 s, 2 retries (SDK version not pinned); no fixed tick, the loop waits for each call
bileshg/JevPlaysSnakeGame commit b9237bf runnable demofallback-last actionthe snake keeps its direction action goes aheadfallback-last actionthe snake keeps its directionno-thresholdthe answered direction is appliedfallback-last actionthe client is built inside the try, so the SDK's no-key error is caughtrecordedNone found: read at the pinned commit (whole repository: main.py, src/runner.py, src/game/engine.py, src/game/snake.py, src/agents/jev_agent.py); every tick asks Jev; a direct reversal it answers is ignored (snake.py L35-37).none in code: SDK 0.7.4 default 10 s, 2 retries; at most 10 ticks/s and the call blocks the tick

Compare your own design with the 80

Pick what your own code does in five failure conditions to see how many of the 80 implementations on this page made the same choice.

The same counts are in the checklist below, which works without JavaScript. The self-check compares choices only: it does not read or test code, and nothing you pick leaves your browser.

Nine questions to ask of your own Jev integration

Apply each question to your own code. The counts show how the 80 answered it; the chips link to example rows on the domain pages. Chip colours: green holds or stops, red acts anyway, blue falls back, amber is advisory.

  1. When Jev errors or times out, does the action still happen?

    40 of 80 stop or hold it. 10 let it happen unchecked: 4 content-moderation bots, 4 agent hooks (danna-zhou, claude-model-guard and ohmyjev in lockdown mode for Claude Code, jev-judge for Hermes), the Spring AI passage filter and openlayer jevals, whose report counts an errored eval as passed. None of the 7 browser agents clicks or types on a Jev error. 22 of 80 fall back (in 9 of them the action can still happen, including 2 real-time demos that keep the last action), 5 of 80 return no decision, 3 of 80 are advisory; not recorded 0 of 80.

    jev-judge: fail-open in enforce modeWordPress Jev Comment Triage: holds, retries, then a persondanna-zhou/jev-mcp: the command runsohmyjev (lockdown mode): the call goes to Claude Code's normal permission flowclaude-jev-advisor: Claude Code still asks you before the deletionSpring AI JevDocumentFilter: unscreened passages keptopenlayer jevals: errored eval counted as passedjev-ultrafast: "no action executed"doom-jev: keeps the last action
  2. What is your timeout, and what happens when it fires?

    Timeouts set in code range from 0.40 s (btc-hft-jev) to 180 s per task (DeepEval JevEval). Some set none: jev-for-chrome and Ulka have no request timeout. Coding-agent hooks and providers use 1.0 s per call (hermes-jev-mana, 5.0 s per turn) to 25 s (jev-approvals and jev-curator; Hermes core's own default is 30 s). Real-time demos: doom-jev sets 2.0 s with no retries against a 0.12 s tick; jev-robotics-demo and JevPlaysSnakeGame set none in code (SDK default 10 s, 2 retries) and wait for each call. Timeouts were not tallied across all 80. Status codes and retries: errors and rate limits.

    btc-hft-jev: 0.40 s, then rules-onlyjkudish/jev-mcp: 60 s, error to the agentdoom-jev: 2.0 s against a 0.12 s tick, stale answers dropped
  3. If Jev answers in the wrong shape, do you treat it as "no" or as "yes"?

    13 of 80 let the action go ahead on a malformed answer (pg-redact stores a span unredacted when its answer is missing). 1 more (jev-agent-browser) guesses a target by word overlap and clicks it. 36 of 80 fail closed; 24 of 80 fall back (openlayer reads a non-numeric answer as 0.5); 3 of 80 are advisory; 4 of 80 return no decision, including competitor-hunter, which leaves an unreadable reply out of its ranking. Validate before acting.

    fraud-jev: a non-numeric probability → allowjev-trader: any answer other than "sell" → buygbesse/zammad-jev-triage: checks model, option and probability
  4. What happens when Jev is unsure?

    17 of 80 hold unsure items: 14 send them to a person or a review queue (including claude-jev-advisor, which leaves Claude Code's question to you), jev-curator refuses the change, and 2 (LiteLLM's compaction guardrail and jev-reranker) drop the result or passage below their cut. 16 act anyway below their cut, including ohmyjev in lockdown mode, whose Bash gate denies only above its cuts, and pg-redact, which stores the span unredacted. 25 have no threshold at all, including 5 of the 7 browser agents, 3 of the 4 judge tools, 2 of the 3 real-time demos and all 5 n8n nodes by default (2 offer an optional low-confidence output and 1 an optional review route). 12 of 80 fall back, 5 of 80 are advisory, 5 of 80 return no decision; not recorded 0 of 80. Choosing a cut: confidence thresholds.

    vynnlee/jev-mail: Review labelgbesse: review groupbackmeupplz/jev_antispam_bot: below 0.81, kept
  5. What happens with no API key?

    51 of 80 refuse to start, error or hold the call. 9 proceed as if allowed: WordPress triage, the danna-zhou hook, claude-model-guard, ohmyjev (lockdown mode), ironbee-express when it replays a cached recording, jev-judge, and Jev-Moderation-Bot, soter and mastra-jev-moderation, which leave the message up. 17 fall back to another backend or LLM, a mock, a heuristic, the host's own permission rules, the unchanged request (jev-effort-router), the main or default model (jev-triage, jev-for-all), the last action (JevPlaysSnakeGame), the unrouted CLI model (jev-router), local selection (autojev) or the original Hermes branch (hermes-jev-mana). 3 of 80 are advisory. Not recorded 0 of 80. n8n nodes stop with a credentials error when Continue On Fail is off; with it on, the item goes to an error or review output, carries an error field, or (in one node) passes through unchanged. Test it: testing without a key.

    WordPress triage: WordPress's own decision standsdanna-zhou hook: proceedsjev-fraud-shield: mockn8n official node: credentials error; Continue On Fail sends the item to the error outputspam-leadgen-pipeline: script ends before classifying
  6. Which code paths never ask Jev?

    80 of 80 have a recorded bypass cell, including passthrough and replay modes in 4 browser agents, the off header of jev-gateway, read-only or permission-request-only paths in 2 coding-agent gates (opencode-tool-gate, jev-kit), the off or observe modes of the 2 Hermes plugins, empty-input shortcuts that skip the call in the 5 rows added on 8 Oct, and the empty-input or slash-command skips of jev-triage and jev-for-all and the switches and admission rule of hermes-jev-mana (added 11 Oct), and the reflexes and no-call shortcuts of doom-jev and jev-robotics-demo (added 12 Oct), and the demo provider of JevRouter, WordPress trusted users and pingbacks and soter's exempt channels (added 13 Oct), and, added 14 Oct: three dispatch skips that leave a Zammad ticket unrouted (zammad-jev-dispatcher), webhook rejections and non-customer skips (gbesse), cache replay (jev-support-desk), a stored decision reapplied without a new call (jev-mail), and jev-mcp's extract tool skipping fields with no regex match, and, added 16 Oct: judge tools that score some checks locally or with a mock or other backend (jevals), judge only new, recent questions within a budget (did-they-answer) or reuse earlier verdicts (competitor-hunter); framework filters that return an empty passage or node list unasked (Spring AI, LlamaIndex); browser agents that switch to another provider, follow new tabs or stop at step limits (jev-for-chrome, jev-android), and a shopping assistant whose voice and email paths act without Jev (second-look); a Gmail labeler that skips already-marked messages and labels unreadable ones for review (ilyamk), and, added 18 Oct: a Claude Code model-tier guard that skips short, continuation or flagged prompts (claude-model-guard); a Windows deletion guard whose own rules decide before Jev is asked (claude-jev-advisor), and, added 19 Oct: a Bash guard whose gates run only in lockdown mode (off by default), that lets read-only commands and in-repo mkdir, touch, cp and mv through without asking Jev, has a shadow setting (off by default) that only logs what it would block, and switches itself off under the pi bridge (ohmyjev, 0.14.0). For 13 rows the recorded cell is "none found" in the files read. List yours: exits, allow-lists, admin users, kill switches, "mock" modes.

    jev-trader: the mock model trades without Jevbackmeupplz: group admins' messages skippedJevmail: /preview simulator, no mailbox actioncomputer-use-jev: passthrough mode clicks with no Jev and no keyjev-support-desk: cache replay without a Jev call
  7. Is your fallback cheaper or riskier than failing?

    22 of 80 fall back to another model, scorer, rule set, default, the unchanged request, the host's original path or the last action on a Jev error. jev-approvals hands the approval to the main agent model, which can approve the command. jev-gateway passes the request to the agent's own model, which picks the tool, and the call runs. second-look shows "Good deal — buy it" from a heuristic when Jev is unavailable. Not recorded 0 of 80.

    0xNatoshi/jev-codex-router: bills the frontier model on every Jev failureQuantDinger: asks an LLM, then allows
  8. Is the failure written down, and does a failed log write block the action?

    Not counted across the 80: the domain tables have no logging column. Record every failure with its reason.

    QuantDinger: logs "audit persistence skipped" and continuesjev-trader: writes its log after the order is sentBillionsBobby/JevRouter: attaches provider_errorSpring AI JevDocumentFilter: logs a WARN with the number of unscreened passages
  9. Does your code log or show when it falls back or fails open?

    Not counted across the 80: the map does not record whether a fallback is visible.

The questions are a design reading of the 80 rows, not a measured result. No count on this page comes from anywhere but the map below.

Checklist to paste

Select the block and copy it into your review.

- [ ] When Jev errors or times out, does the action still happen? (40 of 80 stop or hold it. 10 let it happen unchecked: 4 content-moderation bots, 4 agent hooks (danna-zhou, claude-model-guard and ohmyjev in lockdown mode for Claude Code, jev-judge for Hermes), the Spring AI passage filter and openlayer jevals, whose report counts an errored eval as passed. None of the 7 browser agents clicks or types on a Jev error. 22 of 80 fall back (in 9 of them the action can still happen, including 2 real-time demos that keep the last action), 5 of 80 return no decision, 3 of 80 are advisory; not recorded 0 of 80.)
- [ ] What is your timeout, and what happens when it fires? (Timeouts set in code range from 0.40 s (btc-hft-jev) to 180 s per task (DeepEval JevEval). Some set none: jev-for-chrome and Ulka have no request timeout. Coding-agent hooks and providers use 1.0 s per call (hermes-jev-mana, 5.0 s per turn) to 25 s (jev-approvals and jev-curator; Hermes core's own default is 30 s). Real-time demos: doom-jev sets 2.0 s with no retries against a 0.12 s tick; jev-robotics-demo and JevPlaysSnakeGame set none in code (SDK default 10 s, 2 retries) and wait for each call. Timeouts were not tallied across all 80. Status codes and retries: errors and rate limits.)
- [ ] If Jev answers in the wrong shape, do you treat it as "no" or as "yes"? (13 of 80 let the action go ahead on a malformed answer (pg-redact stores a span unredacted when its answer is missing). 1 more (jev-agent-browser) guesses a target by word overlap and clicks it. 36 of 80 fail closed; 24 of 80 fall back (openlayer reads a non-numeric answer as 0.5); 3 of 80 are advisory; 4 of 80 return no decision, including competitor-hunter, which leaves an unreadable reply out of its ranking. Validate before acting.)
- [ ] What happens when Jev is unsure? (17 of 80 hold unsure items: 14 send them to a person or a review queue (including claude-jev-advisor, which leaves Claude Code's question to you), jev-curator refuses the change, and 2 (LiteLLM's compaction guardrail and jev-reranker) drop the result or passage below their cut. 16 act anyway below their cut, including ohmyjev in lockdown mode, whose Bash gate denies only above its cuts, and pg-redact, which stores the span unredacted. 25 have no threshold at all, including 5 of the 7 browser agents, 3 of the 4 judge tools, 2 of the 3 real-time demos and all 5 n8n nodes by default (2 offer an optional low-confidence output and 1 an optional review route). 12 of 80 fall back, 5 of 80 are advisory, 5 of 80 return no decision; not recorded 0 of 80. Choosing a cut: confidence thresholds.)
- [ ] What happens with no API key? (51 of 80 refuse to start, error or hold the call. 9 proceed as if allowed: WordPress triage, the danna-zhou hook, claude-model-guard, ohmyjev (lockdown mode), ironbee-express when it replays a cached recording, jev-judge, and Jev-Moderation-Bot, soter and mastra-jev-moderation, which leave the message up. 17 fall back to another backend or LLM, a mock, a heuristic, the host's own permission rules, the unchanged request (jev-effort-router), the main or default model (jev-triage, jev-for-all), the last action (JevPlaysSnakeGame), the unrouted CLI model (jev-router), local selection (autojev) or the original Hermes branch (hermes-jev-mana). 3 of 80 are advisory. Not recorded 0 of 80. n8n nodes stop with a credentials error when Continue On Fail is off; with it on, the item goes to an error or review output, carries an error field, or (in one node) passes through unchanged. Test it: testing without a key.)
- [ ] Which code paths never ask Jev? (80 of 80 have a recorded bypass cell, including passthrough and replay modes in 4 browser agents, the off header of jev-gateway, read-only or permission-request-only paths in 2 coding-agent gates (opencode-tool-gate, jev-kit), the off or observe modes of the 2 Hermes plugins, empty-input shortcuts that skip the call in the 5 rows added on 8 Oct, and the empty-input or slash-command skips of jev-triage and jev-for-all and the switches and admission rule of hermes-jev-mana (added 11 Oct), and the reflexes and no-call shortcuts of doom-jev and jev-robotics-demo (added 12 Oct), and the demo provider of JevRouter, WordPress trusted users and pingbacks and soter's exempt channels (added 13 Oct), and, added 14 Oct: three dispatch skips that leave a Zammad ticket unrouted (zammad-jev-dispatcher), webhook rejections and non-customer skips (gbesse), cache replay (jev-support-desk), a stored decision reapplied without a new call (jev-mail), and jev-mcp's extract tool skipping fields with no regex match, and, added 16 Oct: judge tools that score some checks locally or with a mock or other backend (jevals), judge only new, recent questions within a budget (did-they-answer) or reuse earlier verdicts (competitor-hunter); framework filters that return an empty passage or node list unasked (Spring AI, LlamaIndex); browser agents that switch to another provider, follow new tabs or stop at step limits (jev-for-chrome, jev-android), and a shopping assistant whose voice and email paths act without Jev (second-look); a Gmail labeler that skips already-marked messages and labels unreadable ones for review (ilyamk), and, added 18 Oct: a Claude Code model-tier guard that skips short, continuation or flagged prompts (claude-model-guard); a Windows deletion guard whose own rules decide before Jev is asked (claude-jev-advisor), and, added 19 Oct: a Bash guard whose gates run only in lockdown mode (off by default), that lets read-only commands and in-repo mkdir, touch, cp and mv through without asking Jev, has a shadow setting (off by default) that only logs what it would block, and switches itself off under the pi bridge (ohmyjev, 0.14.0). For 13 rows the recorded cell is "none found" in the files read. List yours: exits, allow-lists, admin users, kill switches, "mock" modes.)
- [ ] Is your fallback cheaper or riskier than failing? (22 of 80 fall back to another model, scorer, rule set, default, the unchanged request, the host's original path or the last action on a Jev error. jev-approvals hands the approval to the main agent model, which can approve the command. jev-gateway passes the request to the agent's own model, which picks the tool, and the call runs. second-look shows "Good deal — buy it" from a heuristic when Jev is unavailable. Not recorded 0 of 80.)
- [ ] Is the failure written down, and does a failed log write block the action? (Not counted across the 80: the domain tables have no logging column. Record every failure with its reason.)
- [ ] Does your code log or show when it falls back or fails open? (Not counted across the 80: the map does not record whether a fallback is visible.)
When Jev fails: pool count, 19 Oct 2026 (n = 80 implementations read at pinned commits, 12 domains).
Jev error or timeout: 40 stop or hold, 22 fall back, 10 let the action through, 5 return no decision, 3 are advisory.
The action goes ahead in 19 of 80 (10 fail-open + 9 fallbacks that can still end in the action; keeping the last action counts as going ahead).
Malformed answer: 36 fail closed, 24 fall back, 13 fail open, 4 no decision, 3 advisory.
No key: 51 fail closed, 17 fall back, 9 fail open, 3 advisory.
Below threshold: 25 no threshold, 17 held, 16 act anyway, 12 fall back, 5 no decision, 5 advisory.
Bypass recorded for 80 of 80; 0 not recorded.
Source: https://shaduf.ai/p/jev-catalog/build/when-jev-fails/

All 80 rows

Show the full map: 80 implementations × 5 conditions, plus the 5 entries listed but not counted

Each implementation links to its row on the domain page (the older Claude Code / MCP rows link to that page's failure matrix and jev-permission-gate to its own row; browser and framework rows link to their rows on the domain pages published 5 Oct; coding-agent rows link to their rows on coding agents, 6, 7, 10 and 11 Oct; judge rows link to their rows on Jev as a judge, read 4 Oct and counted from 7 Oct; the 5 rows added on 8 Oct link to their rows on Jev reranker and Jev for RAG and Jev inside SQL and document pipelines; the 3 real-time rows, added 12 Oct, link to their rows on Jev plays Doom: what real-time demos do when a Jev call fails). The commit link opens the source tree at the pinned commit; file paths and line ranges for each cell are on the domain page. Documented source at the pinned commit, checked on the date of the domain page (see sources).

DomainImplementation (commit)Jev error or timeoutMalformedBelow thresholdNo keyBypass
Ticket triageCyrilBaah/jev-triage-desk commit 63913177fallback-archive lanefallback-archive laneno-thresholdno confidence gatefail-closedHTTP 500recordednone found (only an empty-ticket 400 and the no-key 500, which route nothing)
Ticket triagetuhinmitra888/ai-jev-ticket-triage commit 3e8b83a8fail-closed502fail-closed500held< 0.5 → human triagefail-closeddoes not startrecordednone found (an empty or too-long ticket gets a 400)
Ticket triageenderkus/zammad-jev-dispatcher commit f999eca7fail-closed502; ticket stays Unclassifiedfail-closed502 when the probabilities map is missing; an off-list choice is held (note added, ticket stays in Unclassified)held< 0.55 → Unclassified + notefail-closedfails at bootrecorded3 skips leave the ticket unrouted: no ticket, no destination groups, already dispatched
Ticket triagegbesse/zammad-jev-triage commit 5d2a0a78fail-closed503, retried; 20 sfail-closedvalidated → 503held< 0.9 → review groupfail-closed503recordedwebhook rejections (404, 413, 401, 400); non-customer and internal articles skipped
Ticket triageveermshah/jev-support-desk commit aef8fa0cfail-closedbatch aborts; 10 s / 30 s (SDK defaults, not read in the repository)fail-closedheld< 0.6 → triage reviewfail-closedexit 2recordedcache replay reuses stored triages without a Jev call
Model routingLiteLLM complexity router commit 8d28e8dfallback-configured tier or local scorer3 sfallback-configured tier or local scorersame path as an errorno-thresholdconfidence logged onlyfail-closedstart-up error; deployment re-raisedrecordedJev off unless classifier_type: "jev"; session replay; keyword override; plan-mode floor
Model routinggargpratyush/jev-router commit 38da6b8fallback-current model3 s deadlinefallback-current modelfallback-current model< 0.3, or an upgrade capped at sonnetfallback-unrouted CLI modelstarts without Jev; the CLI keeps its own modelrecordedprompt phrases ("use opus") override Jev; no key starts without Jev
Model routingBillionsBobby/JevRouter commit e11084cno-decision15 s / 20 sno-decisionno-decision< 0.55fail-closedexits at startrecordeddemo provider; local answer cache (library callers only)
Model routing0xNatoshi/jev-codex-router commit 8701ef7fallback-frontier model4 sfallback-frontier modelno-thresholdconfidence logged onlyfallback-frontier modelrecordedkill-switch file; shadow mode
Model routingnidhi-singh02/agent-router commit fb24d06fail-closedexits; nothing launchedfail-closedexit code 2; nothing launchedheld< 0.75 and consequential → you pickfail-closedexit code 2; nothing launchedrecordedrouter effort <level>; session continuation reuses the route
Model routingthinkany-ai/autojev commit d5d5731fallback-local selection2 s / 8 s; named Jev routes: equal load balancingfallback-local selectionnamed Jev routes: equal load balancingfallback-local selection< 0.5; named Jev routes: equal load balancingfallback-local selectionstarts without Jev; named Jev routes: equal load balancingrecorded10 paths, e.g. explicit model request kept, observe mode, session pin
Content moderationWordPress Jev Comment Triage commit d848a5bfail-closedcomment held, retried, then left for a personfail-openread as 0.0; WordPress approval can standheldmiddle bandfail-openno provider → WordPress decidesrecordedprovider not ready; trusted users; pingbacks and other non-regular comments; WordPress already chose spam or trash; empty content
Content moderationbrainstormity/Jev-Moderation-Bot commit 325ea7ffail-openmessage left up action goes aheadfail-open→ legitimateacts-anyway< 0.70 left upfail-openmessage left uprecordedbot authors; DMs
Content moderationfrolleks/soter commit 756579afail-open"never blocks chat" action goes aheadfail-openadvisory0.5–0.8 → mod-log review, no actionfail-openany failure caught; chat not blockedrecordedbots, empty content, non-guild messages, exempt channels
Content moderationbackmeupplz/jev_antispam_bot commit 0b07e88fail-openmessage kept action goes aheadfail-openacts-anyway< 0.81 keptfail-closedexits at startrecordedgroup admins skipped, plus 3 more skip paths
Content moderationCodeAlive-AI/mastra-jev-moderation commit 8735ea8fail-open5 s action goes aheadfail-openacts-anyway< 0.7 passedfail-openlibrary; depends on the integratorrecordedempty text; circuit breaker; last message only; 8000-character cut; moderate override
Content moderationZafer-Liu/jev-demo-moderator commit cc47b25no-decisionerror field; batch 502no-decisionno-thresholdJev's Choice decides; code only tightensfail-closedexits at startrecordednone found in the entry points server.py, moderator.py, web/index.html
Content moderationpg-redact (PII redaction before storage; counted from 8 Oct) commit ee903effail-closedHTTP 502; row not inserted; no timeout setfail-opena missing span answer stores that span unredacted; a broken body gives 502acts-anywayspan below 0.5 stored unredactedfail-closed502recordedno candidate spans: stored without a call
Claude Code / MCP guardsdanna-zhou/jev-mcp PreToolUse hook commit 436469afail-open8,000 ms; the command runs action goes aheadfail-openheld"dangerous" < 0.6 → askfail-openthe hook proceeds Tested offline no Jev call, 29 Sep 2026, as published on the Claude Code pagerecordednon-matching commands never sent
Claude Code / MCP guardsjev-claude 0.1.0, shadow mode as installed commit 7d7e876advisoryadvisoryadvisoryadvisoryflags onlyrecordedread-only tools with a clean rule check not sent
Claude Code / MCP guardsjkudish/jev-mcp commit 53fe575 (0.11.0; cells read 29 Sep, bypass read 14 Oct 2026); checked at 0.14.1 (86eae78): failure path unchangedadvisoryerror to the agent; 60 sadvisory"review"advisoryadvisoryerror to the agentrecordedjev_extract sends no field to Jev when its regex finds nothing (no call at all if no field matches); jev_review and jev_gate input checks return errors without a verdict
Claude Code / MCP guardsLangChain AutoModeMiddleware (Python) 0.0.1a3 commit 4af7ab8fail-closedrun ends; 30 sfail-closedacts-anywayis_risky < 0.5 → tool runs; fixed cutfail-closedmiddleware cannot be constructedrecordedtools not listed
Claude Code / MCP guardsoh-my-claudecode (v5.5.0; checked v5.6.2) commit 9fd35ecadvisoryshadow by default; the heuristic decides; 2,000 msadvisoryadvisoryno gate; shadowadvisorypoint off; heuristicrecordedpoints not listed; cap; open circuit
Claude Code / MCP guardsmadisonrickert/jev-permission-gate commit 7349bc9fallback-built-in classifier1.5 s action goes aheadfallback-built-in classifierfallback-built-in classifierdefersfallback-built-in classifierrecordedengine already decided or not auto mode; tools other than Bash, WebFetch, WebSearch; secrets or too-long input; measure mode; cache
Email and leadJevmail commit f6f20afno-decisionemail stays unclassifiedfallback-promotionalacts-anywayflagged; lane still assignedfail-closedrecorded/preview simulator (no Jev call; no mailbox action)
Email and leadilyamk Gmail labeler commit ade42bffail-closedretryable errors (408, 409, 425, 429, 5xx, network) pause the job; other errors (401, 402, 403, other 4xx) end the job with status 'error'no-decisionskippedfallback-full-body callthen its label is applied uncheckedfail-closedrecordedRead at the pinned commit (CODE.gs): entry functions found by a scripted scan of triggers, menus and web-callable handlers (eleven web-callable functions; no timed or menu-driven jobs); helper functions on the path to the Jev call not read in full. Messages already marked are not fetched or are skipped (L1593-1600); when the full text cannot be read, the review label is applied without the full-text check (L1687-1704); a dry run writes nothing (L1759); cost and message limits leave the rest unchanged.
Email and leadparth-kp IMAP classifier commit db96194fail-closedrun stops; 15 sfail-closedno range checkno-decisionmarked processedfail-closedrecordednone found (a per-run cap defers mail)
Email and leadvynnlee/jev-mail commit 61e346ffail-closedretry laterfail-closedheldReview label, kept in the inboxfail-closedrecordeda stored decision from an earlier run is reapplied without a new Jev call; 4 skips
Email and leadspam-leadgen-pipeline commit 78a7592fail-closedscript endsfail-closedfallback-not qualifiedfail-closedthe SDK client is built at load; @typesafe-ai/sdk 0.6.0 throws in its constructor; no row writtenrecordednone found
Email and leaddocjev (document splitting; counted from 8 Oct) commit c7abe27fail-closed2 attempts, then ProviderError; 30fail-closedincomplete or invalid answer setacts-anywaypage below 0.5 joins the current documentfail-closedProviderError at constructionrecordedblank pages set to "other" without a call
n8n nodesOfficial node 0.9.0 commit c12537bfail-closedCOF on: fallback-first route (or Fallback/Uncertain if set)fail-closedRoute; Evaluate unvalidatedno-thresholdby default; Fallback output optional (< 0.5), judgementfail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; with it on, each item goes to the error output (Fallback, Uncertain or first) with errorrecordednone found
n8n nodesDomMonte 0.1.1 commit ff2afcafail-closedCOF on: no-decisionfail-closedno-thresholdone output; no confidence check found in the nodefail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; with it on, the item is passed on with json.error and no decisionrecordednone found (judgement: single output, no routing)
n8n nodesvibe-with-me-tools 0.2.3 commit ddbfe85fail-closedCOF on: fallback-first route (or Low Confidence)fail-closedno-thresholdby default; Low Confidence output optional (< 0.5), judgementfail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; with it on, the item goes to the Low Confidence output if enabled, else the first output, with errorrecordednone found
n8n nodestaifoon 2.0.5 commit cdcc0f3fail-closedCOF on: fallback-review outputfail-closed"Fail Closed" on by defaultno-thresholdby default; optional minConfidence → Reviewfail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; judgement: the default direct connection; with it on, the item goes to Review with a redacted errorrecordedno routing configured → everything to pass
n8n nodeszampierid4p 0.3.3 commit 549a545fail-closedCOF on: fallback-question 1's branchfail-closedmissing answer → empty branchno-thresholdprobabilities passed throughfail-closedn8n's "Node does not have any credentials set" error with Continue On Fail off; judgement: the credential is read before the per-item try, so the node's own Continue On Fail branch does not catch it; with the node's On Error set to continue, n8n passes the input through unchanged on output 1, with no Jev answerrecordednone found
Trading and fraudQuantDinger commit a5a9f4cfallback-LLMthen fail-open; 8 s action goes aheadfallback-LLMthen fail-openfallback-LLMthen acts-anywayfallback-LLMthen fail-openrecordedexits; grid/DCA/martingale; credit denial
Trading and fraudjev-trader commit b587759fail-closedno new order; a resting order staysfail-openany other answer → buy; conditionalno-thresholdfail-closedjudgement: with MODEL=jev the provider loads the key at call time, so each decision fails on the error path (no new order); the default model is mock (the recorded bypass)recordedmock model trades without Jev
Trading and fraudJev Trade commit a3f2f83fail-closedno new order; 4,000 msfallback-holdno-thresholdfail-closedrecordedmock model trades without Jev
Trading and fraudbtc-hft-jev commit 96f3541fallback-last judgment / rules-onlycan trade; 0.40 s action goes aheadfail-closedrun stopsacts-anywayhalf size; < 0.50fallback-mockforced dry runrecordedrules-only path
Trading and fraudjev-fraud-shield commit eeb4fc6fail-closedstep-upfail-closedheldstep-upfallback-mockrecorded0 or ≥ 3 flags decided without Jev
Trading and fraudfraud-jev commit aa33b97fail-closedreview, HTTP 500fail-opennon-numeric → allow; conditionalacts-anywayallow below the cutsfail-closed401recordedOFAC destination → review without Jev
Trading and fraudexpense-policy gate commit 161c33bfail-closedbatch aborts; 30 sfail-closedheldmanual reviewfail-closedrecordeddeterministic rejects skip Jev
Browser and computer usebrowser-use/jev-ultrafast commit 1231850fail-closed25 s; "no action executed"fail-closedno-thresholdconfidence recorded onlyfail-closedrecordednone found (no action without a fresh Jev decision for the page)
Browser and computer useironbee-ai/ironbee-express commit 05079b4fail-closed25 s, 3 triesfail-closedno-thresholdfail-openconditional: a cached recording replays unjudged; fail-closed without onerecordedcached replay; LLM takeover
Browser and computer useforvela/jev-agent-browser commit eb35251fail-closed30 sfallback-semantic target resolverthen the action runsno-thresholdstop cuts onlyfail-closedstart URL opened firstrecordedclassify-mode regex overrides
Browser and computer usedougsong/jev-android commit be8364afail-closed25 sfail-closedno-decision< 0.65 → replan ×2 → BLOCKEDfail-closedrecordedRead at the pinned commit (whole repository): with DeepSeek selected, or the sample's scripted Bilibili policy, Jev is not asked; the scripted policy finishes, waits or blocks on its own; a scenario's first navigation happens before any decision; the step and time limits end the task.
Browser and computer usepaulsmith/computer-use-jev commit ff0ad8bfail-closed60 sfail-closedno-decisionmutating < 0.5 → not executedfail-closedrecordedpassthrough mode (no Jev, no key)
Browser and computer usechy4pro/jev-for-chrome commit d5c24defail-closedno timeout; 3 retriesfail-closedno-thresholdno threshold for actions; a final 'done' or 'blocked' below 0.5 gets a second lookfail-closedrecordedRead at the pinned commit (whole repository): with OpenRouter or Cloudflare selected, those services decide instead of Jev; the agent follows new tabs on its own; typed text is written by a separate text model; step, call-budget, repeat and deadlock limits end the task without asking.
Browser and computer userazaanstha/ulka commit bb04433fail-closedno timeoutfail-closedno-thresholdfail-closedrecordedcached replay; forced first action (both approval-gated)
Browser and computer useKaushikSiva/second-look commit 0c05d16fallback-heuristic verdict15 s; recommendation onlyfallback-heuristic verdicta missing or broken answer gets the simple 'Wait' or 'Buy now' rule; a verdict outside the four known values shows no verdict card on the web route (the voice assistant catches it)no-thresholdfallback-heuristic verdictrecordedRead at the pinned commit (whole repository): with no key or on any Jev error a simple 'Wait' or 'Buy now' rule decides (jev.py L18-19, L30-32; research.py L188-191); research cards other than the verdict, cheaper-store savings and price-drop alerts use no Jev call (research.py L166-169, L188; main.py L41-54); the voice assistant speaks its own advice, adds price watches, sends emails and stores notes without asking Jev; forwarded order emails are read and answered by another model. When the backend names no best store, the side panel tags the cheapest offer "Best" without Jev (sidepanel.js L1114-1120).
FrameworksSpring AI TypeSafe JevDocumentFilter 0.4.0 commit 51993bbfail-openunscreened passages kept; 10 s × 3 attempts, 30 s budget action goes aheadfail-openacts-anywaya passage with injection risk at or below 0.70 is kept on that test; it can still be dropped by the filter's other rules (relevance below 0.45, evidence at or below 0.55)fail-closedfor a blank key: startup exception. With the api-key property absent, no client is created and the application starts; the filter is not auto-createdrecordedRead at the pinned commit (the filter class and its auto-configuration): only an empty passage list is returned without asking Jev (JevDocumentFilter.java L147-149); every non-empty list is screened.
FrameworksLlamaIndex JevRerank (community) commit 421afdafallback-retriever ordertop_n; 2.5 sfallback-retriever orderno-thresholdoptional flag only, never dropsfail-closedValueError at constructionrecordedRead at the pinned commit (the postprocessor package): only an empty node list is returned without asking Jev (read scope: the postprocessor in full; the Cloudflare and Vercel provider clients at their branch, return and raise lines).
FrameworksLangChain ModelRouterMiddleware (Python) 0.0.1a3 commit 4af7ab8fail-closedrun ends; 30 sfail-closedno-thresholdalways answer.choicefail-closedconstructionrecordedNone found: read at the pinned commit (libs/partners/typesafe/langchain_typesafe/: the middleware, classifier and client modules); each run asks Jev once before the first model call.
FrameworksLangChain autoModeMiddleware (JS) 0.0.2 commit 417ddcffail-closedtool not run; 30 s × 3 attemptsfail-closedacts-anywayrisk < 0.5 → tool runs; fixed cutfail-closedconstructionrecordedunlisted tools never sent
FrameworksLiteLLM TypeSafe compaction guardrail 1.104.0 (prompt filter; counted from 8 Oct) commit 7964577fallback-uncompacted requestdefault fail_open forwards the request uncompacted; 30 sfallback-uncompacted requestheldtool results with noul < 0.2 removed from the promptfail-closedstart-up errorrecordedoff unless configured; small and protected results never sent
Frameworksjev-reranker 0.1.2 (reranker; counted from 8 Oct) commit d58594bfail-closederror after up to 8 retries; 180 s per requestfail-closedResponseValidationErrorheldrelevance_rerank cuts passages below 0.2fail-closederror at constructionrecordedno call for an empty list; one passage gets 0.5 without a call
FrameworksLanceDB TypeSafeReranker v0.40.0 (reranker; counted from 8 Oct) commit b1b080bfail-closederrors propagate; timeout is the SDK default (typesafe-sdk 0.7.1 and 0.7.4: 10 s per HTTP operation, 2 retries, 30 s retry budget; which SDK version LanceDB installs was not read)fail-closedValueErrorno-thresholdreorders onlyfail-closedTypeSafeError at the first rerank call; no fallback (read 11 Oct)recordednull documents scored 0 without a call
Coding agentskeiffff/jev-kit jev-agent-review commit 3d74b05fail-closedheld for the host's prompt; SDK 10 s, no retry; 4 s hook timeout in the examplesfail-closedheldheldfail-closedheldrecordedsensitive input deferred unsent; only permission requests
Coding agentsbloudhood/codex-jev-approval-hook commit b6242c9fail-closedheld for Codex's approval; 5 sfail-closedheldheldfail-closedheldrecordedBash, apply_patch and mcp__ only; denial cap
Coding agents24601/rh-guard (default mode enforce, so a default install can block) commit c2e682efallback-lexical detectors1.2 s action goes aheadfallback-lexical detectorsacts-anywaysteer message only when Jev's primary_kind confidence is below 0.5 on a mutating step; the call still runs unless deny-kind labels reach a block threshold (REVIEW_THRESHOLD 0.45 is a risk-label floor, not a confidence threshold)fallback-lexical detectorsrecordedMCP tools not matched on Codex; shadow mode
Coding agentsjustmytwospence/opencode-tool-gate commit bdf1ef8fallback-opencode permission rules3 s; OpenCode v1.18.35 default rules allow every tool ("*": "allow") action goes aheadfallback-opencode permission rulesacts-anywayfallback-opencode permission rulesrecordedread-only tools; enabled: false
Coding agents@osuki-dev/opencode-osuki-agent 0.2.7, checked at 0.2.8 npm 0.2.7; tag commit c96ce03; 0.2.8 (tag 0ae9e88): failure path unchangedfallback-default tier10 s; routing fallback, not counted as going aheadfallback-default tierfallback-default tierfallback-default tierrecordedfixed roles; reuse; pruning limits
Coding agentsDoGMaTiiC/hermes-jev jev-judge (enforce mode; default shadow) commit 5dddbeafail-open3 s action goes aheadfail-openacts-anywayfail-openrecordedcache; circuit breaker; unlisted tools
Coding agentsanpicasso/hermes-jev-approvals with Hermes Agent core v2026.9.24 (off after install: core default approval mode manual) commit 28be98a; core f97608ffallback-main agent modelon a timeout, connection error, 429 or 402 (if a main provider is set), and that model can approve (with no main model configured, it asks you); held for a person on other HTTP errors; plugin 25 s, core may retry twice action goes aheadfail-closedempty or unknown answer escalates to a personheldAPPROVE below confidence 0.55 becomes ESCALATEfail-closedplugin raises; core escalates to a personrecordedapprovals off or manual (the default); allowlist; commands not flagged
Coding agentsanpicasso/hermes-jev-curator (guard or apply mode; default observe) commit 4e8626cfail-closedbackground skill delete or patch blocked; 25 sfail-closedno answers object or invalid answers: no plan; the guard blocksheldconfidence < 0.85: change not authorised; the guard blocksfail-closedno credential: no judgment; the guard blocksrecordedoff and observe modes inert; foreground operations; creates
Coding agentsAlphaPerseii3000/jev-effort-router 0.2.2 with Hermes Agent (Jev picks the model and reasoning effort for each turn; off until enabled in Hermes; inert until a key is set, and with Hermes defaults, because it acts only when the provider is Ollama:Cloud (R13-S217, R13-S220); added 10 Oct) commit 562dc2afallback-configured modeltimeout (2.0 s) or HTTP error: the request is left untouched, so the turn runs on the operator's configured model and effortfallback-configured modelno usable answer: request untouched; a partial answer with no model choice gives the default modelfallback-default modelconfidence < 0.5: the code rewrites the request to deepseek-v4.1-flash at medium effortfallback-configured modelno key: the request is left untouchedrecordeddisabled; a provider other than Ollama:Cloud; another API mode; no user message; any exception
Coding agentsjev-gateway 0.5.1, a local proxy for Codex, OpenCode and 4 other hosts (Jev picks the tool; added 10 Oct) npm 0.5.1; repository named in npm metadata (gitHead 37ff982); code read from the npm 0.5.1 tarballfallback-agent's own model4,000 ms plus 1 retry on 408, 429 or 5xx; the request passes through, the agent's own model picks the tool and the call runs action goes aheadfallback-agent's own modelpassthrough to the agent's modelfallback-agent's own modelbelow 0.7, or the two Jev answers disagree: passthrough; Jev's answer is not usedfail-closedthe gateway does not start; with no person at a terminal the launcher exitsrecordedheader x-jev-gateway: off; routing off; the Codex auto-reviewer model; no tools or a tool choice already set; hosted tools; an upstream 400 or 422 replays the original request
Coding agentsRanyAlbegWein/jev-triage 1.0.3 with OpenClaw (skips the main model for "thanks" and "spam" at a score of 0.9 or more; host path read at OpenClaw aa6008a; added 11 Oct) commit 6360e21fallback-main model5,000 ms; a non-ok status, a timeout or a throw is caught (OpenClaw's before_dispatch is fail-open) and the message goes to the main model as if the plugin were absent; routing fallback, not counted as going aheadfallback-main modela throw is caught by the host; the message goes to the main modelfallback-main modelbelow 0.9 the message goes to the main model untouchedfallback-main modelthe call fails and the message goes to the main modelrecordedempty text or a leading /; host inbound handlers off or runtime restricted
Coding agentsjev-for-all 0.7.1, the jev-for-all start launcher for Claude Code and OpenCode (Jev picks the tier and effort; counted on the launcher only, its OpenCode plugin part is not settled; added 11 Oct) npm 0.7.1 (gitHead 74f62e7); code read from the npm 0.7.1 tarballfallback-default model3,000 ms; on an error or timeout the launcher starts the standard tier (Claude Sonnet) at medium effort; routing fallback, not counted as going aheadfallback-default modelstandard tier, medium effortfallback-default modelstandard tier unless light is 0.6 or more or heavy is 0.5 or morefallback-default modelstandard tier, medium effortrecordedempty prompt; the user's models.json overrides
Coding agentsabehrman/hermes-jev-mana with Hermes Agent, core patch patches/jev-decisions.patch (picks the model and effort, can answer the user or hand the turn to an executor without a provider call; added 11 Oct) commit 3daf639 Inert after the documented install: every Jev call is refused because admit_unlabeled defaults to false; acts only if the operator sets admit_unlabeled: true.fallback-original Hermes branch1.0 s per call, 5.0 s per turn, plus 0.25 s host grace; an error, a timeout or a late answer becomes "outage" and the original Hermes branch runs on the configured model; routing fallback, not counted as going aheadfallback-original Hermes branch"invalid": the original branch runsfallback-original Hermes branchnear-tie margin 0.15 in code (the example config comment says 0.10): "uncertainty", the original branch runsfallback-original Hermes branchjudgement: every failure of the jev CLI raises JevError, which goes to the original branch; the CLI, which reads the key, was not readrecordeddecisions off; plugin not enabled; excluded points; admission False; explicit model or effort pins; delegated agents get no executor; fewer than 2 options; more than 8 native steps per turn; unhealthy points
LLM as a judgeDeepEval JevEval (deepeval 4.2.8) commit a200ecefail-closedrun aborts (default ignore_errors=False); with ignore_errors=True the test case is a FAIL; 180 s per task. The 180 s value and ignore_errors were not re-checked under the library scope.fail-closeda missing answer raises, handled like an errorno-thresholdminimum confidence recorded, not acted onfail-closed"there is no LLM to fall back to"recordedNone found: read at the pinned commit (the deepeval/metrics/jev_eval/ directory: jev_eval.py, utils.py, questions.py, __init__.py); every scoring call asks Jev.
LLM as a judgeopenlayer jevals 0.1.4 commit 0a8f895fail-openthe report's passed treats an errored eval as not failed; the runtime gate defaults to on_error="allow". Dataset summary: no score, left out of the denominator (no-decision). 15 s, 4 retries action goes aheadfallback-0.5a non-numeric Noul is read as 0.5; a missing answer is left out, and for single-question evals the result is then recorded as an error (handled as on a Jev error)no-thresholddefault; the gate holds only if you set escalate_below or escalate_above and an on_escalate handlerfallback-another backenddefault auto-detect uses Vercel, Kev, Eikos or an OpenRouter/OpenAI LLM if one is configured; fails closed if no other backend is configured; Jev named explicitly: fail-closedrecordedRead at the pinned commit (whole repository). Some built-in evals score with no Jev call: LoopDetection, PII, PHI and SecretsExposure pass (SecretsExposure can also fail) on local checks; TrajectoryMatch and ToolCallF1 are computed locally; evals missing required fields are skipped and the gate allows them; backend='mock' and auto-detected other backends do not ask Jev (also from the MCP tools); in the OpenAI Agents integration non-function tools are not gated; jevals bench --ragas also scores with another model (report only) (read scope: every entry point in full except the documentation helper integrations/_docs.py, read at its function and return lines; it builds a help text and runs no evaluation).
LLM as a judgedid-they-answer commit e0ee60cno-decisionthe item is not written and is retried on the next daily run while the question is inside the 21-day window; 60 s; up to 5 tries for HTTP 429, 5xx and 529 only; a timeout or connection error fails on the first tryfail-closedmissing answer keys stop the run (traced, not executed); a missing usage field alone gives no-decisionno-thresholdtop option stored; "referred" split at 0.5fail-closedexits without a keyrecordedRead at the pinned commit (whole repository): the daily job judges only questions from the last 21 days that have a reply and were not judged before, and stops once its per-run budget is spent; stored Jev results are reused when rebuilding the published judgments; the labelling tool records labels from another model or a person, not from Jev.
LLM as a judgecompetitor-hunter (loading claude-x-jev c8662b0) commit 40613eano-decisionerrored items are left out of the ranking, but errored Reddit posts are still listed without a verdict; above 5% errors the run aborts (fail-closed); 60 s, 4 retries (4xx not retried)no-decisionan unreadable reply is handled like a Jev error and the item is left out of the ranking; a reply missing its answers stops the ranking stage (fail-closed)acts-anywayunsure items flagged but still rankedfail-closedOpenRouter key requiredrecordedRead at the pinned commit (whole repository, with the claude-x-jev code it loads): re-runs reuse earlier verdicts; pieces judged 'paid' by engagement rules are dropped before ranking; Reddit posts without a Jev result are still listed; the studio re-scores your own posts without Jev; another model writes post breakdowns and chat answers; the results page ranks competitors by views and engagement (S–E tiers) without Jev (web/app.js L438-485) (read scope: all code and web scripts in full; the two HTML pages' markup checked by script for event handlers (none), their inline scripts read).
Real-time controlmikespins/doom-jev commit bd4e98f (domain table)fallback-last actionthe game keeps applying the last action every tick; 2.0 s timeout, no retries action goes aheadfallback-last actionno validation; the error stays inside the request task (inference from the 11 Oct 2026 read)no-thresholdthe top of 6 actions is appliedfail-closedexits before the game startsrecordedshoot and stop-at-wall reflexes override Jev; moves forward until the first answer
Real-time controlFazalAAli/jev-robotics-demo commit 531de61 (domain table)fail-closedthe demo stops; no action is taken (no try)fail-closedthe demo stopsno-decisiongrasp/release below 0.75 does nothing; move and target take the top optionfail-closedraises when the client is built (SDK 0.7.x)recordeda single legal move is made without a call; a hand reflex; the simulation filters unsafe moves
Real-time controlbileshg/JevPlaysSnakeGame commit b9237bf (domain table)fallback-last actionthe snake keeps its direction action goes aheadfallback-last actionthe snake keeps its directionno-thresholdthe answered direction is appliedfallback-last actionthe client is built inside the try, so the SDK's no-key error is caughtrecordedNone found: read at the pinned commit (whole repository: main.py, src/runner.py, src/game/engine.py, src/game/snake.py, src/agents/jev_agent.py); every tick asks Jev; a direct reversal it answers is ignored (snake.py L35-37).
Claude Code / MCP guardsmcowdery/claude-model-guard 1.2.0, UserPromptSubmit hook (a model-tier gate, not a safety gate) commit bced870; scripts/promptAdvisor.mjs L25–155, scripts/jev.mjs L124–137, scripts/decision.mjs L6–47. Documented read at the pinned commit, 16 Oct 2026; bypass entry points read 18 Oct 2026; added 18 Oct 2026fail-open2,500 ms; the hook exits 0 with no output and the prompt goes on (promptAdvisor.mjs L25, L82, L155; jev.mjs L133–137) action goes aheadfail-opena missing answer throws and is caught; the prompt goes on (promptAdvisor.mjs L86, L155)advisorybelow 0.65 (0.9 within 3 prompts of a model switch) a note to Claude, no block (promptAdvisor.mjs L133–152)fail-openthrows; exits 0 with no output (jev.mjs L124–127; promptAdvisor.mjs L155)recordedempty prompt; a skip phrase or CLAUDE_SKIP_MODEL_GUARD; continuation words, slash and ! commands; a short prompt with no earlier text (promptAdvisor.mjs L31, L64–65, L70, L77)
Claude Code / MCP guardsdelt96/claude-jev-advisor 0.5.0, rm hook (PreToolUse, Windows only) commit f2c1791; src/rm/run.ts L29–123, src/rm/judge.ts L75–77, src/jev.ts L4–80. Documented read at the pinned commit, 16 Oct 2026; bypass entry points read 18 Oct 2026; added 18 Oct 2026fail-closedheld: the guard's own ask stands; 8,000 ms within a 12,000 ms budget (jev.ts L4, L72, L79–80; run.ts L29–30, L123)fail-closedheld: a parse error or a missing field leaves the ask (jev.ts L73–79; run.ts L66–67)heldthe ask is lifted only when every target is ≥ 0.8 (judge.ts L75–77; run.ts L102)fail-closedheld: the ask stands (run.ts L91–92)recordedrm off; not Bash or PowerShell, or no command; no deletion found; a deletion denied by code; rm.jev off; no key (run.ts L77–92); none lets an asked deletion through
Claude Code / MCP guardsNovacon/ohmyjev, Claude Code module (Bash, Write/Edit and exfiltration gates; enforcing deny), in lockdown mode without shadow (both off by default) 0.14.0, commit fbc4ea4; hooks/ohmyjev.ts, hooks/jev.ts, hooks/policy.ts. Documented read at the pinned commit, 8 Nov 2026 (earlier readings at d307c39, 2 Nov 2026, and 78bb82c, 16–21 Oct 2026; added 19 Oct 2026). The gates run only with the lockdown setting on, and it is off by default (policy.ts L12; gate returns before any Jev call, ohmyjev.ts L292); a new shadow setting, also off by default, runs the lockdown checks but blocks nothing (policy.ts L13, L33–39). The cells describe lockdown mode without shadow. Hosts: Claude Code (this module) and pi and omp through adapters/pi.ts (tool_call from L498) and adapters/omp.ts (tool_call from L524), which share adapters/shared.ts and need lockdown in the same way; same five terms.fail-open1,500 ms (policy.ts L95; race at ohmyjev.ts L92–101); a Jev error throws, decide returns nothing (L205–215) and the gate returns without blocking (L302, L325, L334), so the call goes to Claude Code's normal permission flow action goes ahead pi and omp: the same 1,500 ms through AbortSignal.timeout; decide returns nothing and the gate returns without blocking, so the host runs the tool (shared.ts lines as read at d307c39: L37, L106).fail-opennon-JSON or a missing answer throws and the call passes (jev.ts L46–62, L70–81) pi and omp: the same throw and the same return without blocking.acts-anywayBash denied only when Jev rates it irreversible at ≥ 0.6, irreversible with destructive intent at ≥ 0.7, or exfiltrating at or above the exfil setting; otherwise the call goes on (policy.ts L434–448; L68–69) pi and omp: the same Bash thresholds, plus writes denied only at secret ≥ 0.7 (secrets file ≥ 0.8) and exfiltration only at ≥ 0.7 (policy.ts from L450 and L463).fail-openaskJev throws; the gate returns without blocking and the call goes to the normal permission flow (ohmyjev.ts L82, L206–208, L302). Keys are taken from the config, $TYPESAFE_API_KEY, a key stored with ohmyjev key, then $OPENROUTER_API_KEY (jev.ts L33–39) pi and omp: askJev throws and the gate returns without blocking; both log "no Jev key: gates and screens let every call through" (lines as read at d307c39: shared.ts L28; pi.ts L449; omp.ts L413).recordedlockdown off, the default, skips every gate before any Jev call (ohmyjev.ts L292); the shadow setting (off by default) runs the gates and Jev's checks but only logs what they would block, so every call runs (policy.ts L33–39, L424–425; ohmyjev.ts L313–316, L854); with lockdown off or shadow on, a git push or GitHub write is denied once by a code reminder and runs when repeated (L819–822; no Jev call); off switch (L818); read-only Bash and in-repo mkdir, touch, cp and mv skip Jev and return without approval unless policies are set (L298; policy.ts L370, L414); writes outside allowed paths denied by code (L309–320); each gate can be switched off; tools outside HOOKED never seen (L24); its own exceptions pass the call; under the pi bridge (OHMYJEV_PI=1) the module switches itself off (L746) pi and omp: gates need lockdown (pi.ts L508, L522, L538; omp.ts L535, L563, L590); the same GitHub reminder and the same shadow handling (pi.ts L504, L602–606; omp.ts L531, L678–682; shared.ts denyByCode L173–182 logs instead of denying in shadow); writes outside allowed paths denied by code; other tools fall through with no Jev call; their own exceptions pass the call.
Claude Code / MCP guardsOfficial TypeSafe plugin commit 65a39f3. Excluded from every count: no runtime Jev calln/aexcludedn/aexcludedn/aexcludedn/aexcludedn/aexcluded
LLM as a judgeJevals harness Excluded from every count: its code is not public, so its cells are Reported from a methodology page, not read at a pinned commitn/aexcludedn/aexcludedn/aexcludedn/aexcludedn/aexcluded
SQL extensionspg-jev Listed, not counted (8 Oct rule): its value goes back into your query; cells on the databases pagen/anot countedn/anot countedn/anot countedn/anot countedn/anot counted
SQL extensionssqlite3-jev Listed, not counted (8 Oct rule): its value goes back into your query; cells on the databases pagen/anot countedn/anot countedn/anot countedn/anot countedn/anot counted
SQL extensionssqlite-jev Listed, not counted (8 Oct rule): its value goes back into your query; cells on the databases pagen/anot countedn/anot countedn/anot countedn/anot countedn/anot counted
  • fail-closed or held: the item does not go ahead; a person, the host's prompt or, for two passage filters, the code's own cut decides
  • fallback-… (named)
  • advisory: Jev never decides
  • no-decision
  • fail-open or acts-anyway
  • no-threshold
  • not recorded

Where this map differs from earlier notes and pages

The starting point was a prep map of 3 Oct 2026. Each difference was decided from the published domain page and its research note. None adds a new failure claim.

ItemEarlier map or pageUsed here
oh-my-claudecode, all cellsPrep map: fallback-heuristic twinadvisory at default settings (shadow; the heuristic always decides). fallback-heuristic only with OMC_JEV=<point>:active. On the 32-row tally: fallback 6 → 5, advisory 2 → 3
No key: jev-claude and jkudish/jev-mcpPrep map: not mappedadvisory for both, as the Claude Code / MCP page records ("Flags only"). Claude Code / MCP no-key cells: 5 of 5 recorded
Below threshold, relabelled to the 4 Oct termsPrep map: CyrilBaah fail-open; LiteLLM and 0xNatoshi "acts anyway"; Zafer-Liu "Jev's own Choice decides"; agent-router advisory; review-group and review-label rows (tuhinmitra888, enderkus, gbesse, veermshah, vynnlee) fallback; WordPress "held band"CyrilBaah, LiteLLM, 0xNatoshi and Zafer-Liu → no-threshold; agent-router, the review rows and WordPress → held. Vocabulary only; no fact changes
BypassPrep map: email re-processing guards (ilyamk, vynnlee, spam-leadgen) and agent-router's secret-pattern refusal listed as bypassesnot recorded: they skip or refuse work, they do not act without Jev. Jevmail's /preview simulator stays a bypass
Note, 14 Oct 2026: vynnlee's stored-decision replay (jev-mail) is now recorded as a bypass, because it reapplies an earlier Jev decision without a new call. The other reprocessing guards stay as described above.
Jevmail, unsure answerEmail page (3 Oct): advisoryacts-anyway (flagged): the lane is still assigned. Relabel only; applied on the email page on 4 Oct
spam-leadgen-pipeline, unsure answerEmail page (3 Oct): fail-closed, which is not a below-threshold termfallback-not qualified. Relabel only; applied on the email page on 4 Oct
vynnlee/jev-mail, unsure answerEmail page (3 Oct): "fallback: Review label"held (a review label kept in the inbox), under the same relabel rule as the other review rows; applied on the email page on 4 Oct
DenominatorPrep map: 32 (+1 n/a)32 for the six domains published before 4 Oct; 39 with trading (4 Oct); 51 with browser and computer use and frameworks (5 Oct); 58 with jev-permission-gate and the six coding-agent rows (6 Oct); 64 with the four judge tools and the two Hermes plugins (7 Oct); 69 with LiteLLM's compaction guardrail, jev-reranker, LanceDB's TypeSafeReranker, pg-redact and docjev (8 Oct); 71 with jev-effort-router and jev-gateway (10 Oct); 74 with jev-triage, the jev-for-all launcher and hermes-jev-mana (11 Oct); 77 with doom-jev, jev-robotics-demo and JevPlaysSnakeGame (12 Oct); 79 with claude-model-guard and claude-jev-advisor (18 Oct); 80 with ohmyjev (19 Oct). The official plugin, the trycua/cua mock example, jev-llm-guard, the Jevals harness, the three SQL extensions and the ra2web and llm-invaders real-time harnesses stay out
enderkus/zammad-jev-dispatcher, malformed answerThis page and the triage page, to 13 Oct: fail-closed 502fail-closed 502 only when the probabilities map is missing; an off-list choice is held (note added, HTTP 200, ticket stays in Unclassified; app.rb L117-138 at f999eca7, read 14 Oct). Count unchanged
chy4pro/jev-for-chrome, unsure answerno-threshold, no noteno-threshold for actions; a final 'done' or 'blocked' below 0.5 gets a second look (src/background/agent.ts L78-79, L465-486 at d5c24de, read 14 Oct). Count unchanged
jev-approvals, Jev errorThis page and coding agents, 7 Oct: fail-closed (held for a person)fallback-main agent model on a timeout, connection error, 429 or 402; held on other HTTP errors (Hermes core auxiliary_client.py L7610–7701 at f97608f, read 8 Oct). Counted under fallback from 8 Oct

No disagreement was found between a published page cell and its note for the error, malformed and no-key cells of triage, routing, moderation, email and n8n (page tables spot-read against the prep map).

What was not verified

  • Bypass cells rest on reading the files that start work at each pinned commit; for one large Apps Script file the entry functions were found by a scripted scan, and a few helper functions on the way to the Jev call were not read in full. Nothing was run. For n8n we read the node's credential check and n8n's own missing-credential error; whether the editor blocks activating a workflow without a credential was not read.
  • Rows from the six earlier domains were recomputed from their published tables and notes, not re-read from source when this map was built. The trading rows were read from source on 4 Oct; the browser and framework rows on 5 Oct (spot-checked against the raw files at the pins; the Spring AI auto-configuration lines were read once at the pin).
  • Browser and framework rows: SDK defaults were not read (for example the @langchain/core retry backoff); whether computer-use-jev sends [secure] field values and how second-look's card words its fallback verdict are not recorded.
  • Coding-agent rows (6 and 7 Oct): osuki was read from the npm 0.2.7 tarball and checked at 0.2.8 (tag 0ae9e88); the tarballs and tags were not matched file by file. jev-judge is counted in enforce mode (default shadow), jev-approvals is off after install and jev-curator observes by default; their cells describe the switched-on modes. jev-curator's cache lifetime is not recorded. Hermes's default model.provider and _BILLING_PATTERNS, which decide when the jev-approvals fallback applies, were not read. How Codex handles jev-kit's exit 2 was not read.
  • Judge rows (7 Oct): mapped from the published Jev as a judge table and its 4 Oct research note at the 4 Oct pins, not re-read from source; HEADs were not rechecked. openlayer's no-key branch was read on 8 Oct. Their bypass cells were read at the pins on 16 Oct 2026.
  • The 2 trading fail-open cells for malformed answers depend on the shape of the bad answer.
  • Rows added on 8 Oct: LanceDB's no-key behaviour was read on 11 Oct (fail-closed at the first rerank call); which TypeSafe SDK version LanceDB installs, and so its timeout, was not read; pg-redact sets no timeout on its request; LiteLLM's compaction row comes from the 6 Oct read at 7964577.
  • Coding-agent rows added 10 Oct: jev-gateway was read from the published npm 0.5.1 tarball (gitHead 37ff982), not from the GitHub tree, and was not run. How Codex and OpenCode run a forced or built tool call, and whether their own approval policy then applies, was not read. Whether Hermes needs a separate plugin-enable step after installing jev-effort-router is not recorded.
  • Coding-agent rows added 11 Oct: OpenClaw after line 650 of the 2026.10.1 host file, hermes-jev-mana's jevkit/client.py (read 14 Oct 2026; its no-key cell is now a judgement, because the jev CLI, which reads the key, was not read), the Hermes base commit the patch targets (e97923c3) and the jev-for-all Claude Code hook were not read. jev-for-all was read from the npm 0.7.1 tarball (gitHead 74f62e7), not from a GitHub tree. None was installed or run.
  • Real-time rows added 12 Oct: the cells come from code at the pins, not from runs. jev-robotics-demo does not pin its SDK version. The doom-jev and jev-robotics-demo cells come from the 11 Oct 2026 reads at the same pins (HEADs unchanged on 12 Oct). None was installed or run.
  • Claude Code rows added 18 Oct 2026: claude-jev-advisor's CLI, status-line and context files were checked by a scripted scan plus the parts named in its notes, not read line by line (none is a tool-call path); the npm @delt/claude-jev-advisor 0.5.0 tarball was not compared with the pin file by file; claude-model-guard is not on a package registry. Neither was installed or run.
  • Logging (question 8), timeouts (question 2) and whether a fallback is visible (question 9) were not tallied across all 80.
  • How any of the 80 behaves in real use: none was run here (no agent, hook, plugin, eval or MCP server was installed or run; no Jev call), and how many people use them is unknown.

Sources and check times (UTC)

  • Recount of 19 Oct 2026: the 79-row map as published here reproduces from this page's cells before the change (no key 51/17/8/3/0, error 40/22/9/5/3/0, malformed 36/24/12/4/3/0, below threshold 25/17/15/12/5/5/0, bypass 79/0 with 13 "none found"); after adding ohmyjev every column sums to 80 with 0 not recorded (script over this page's cells: no key 51/17/9/3/0, error 40/22/10/5/3/0, malformed 36/24/13/4/3/0, below threshold 25/17/16/12/5/5/0, bypass 80/0). Novacon/ohmyjev at fbc4ea4 (0.14.0; R28-S20 to R28-S23, read 8 Nov 2026): hooks/ohmyjev.ts L24, L82, L92–101, L205–215, L292–334, L746, L818–822, L854; hooks/jev.ts L33–39, L46–62, L70–81; hooks/policy.ts L12–13, L33–39, L68–69, L95, L370, L414, L424–448; adapters/pi.ts L498–606; adapters/omp.ts L524–682; adapters/shared.ts L173–182; adapters/codex.ts not read; the new bin/ohmyjev.mjs is an install and key command (npx ohmyjev install, npx ohmyjev key), read only for its usage and its key check, not a gate path. Earlier, Novacon/ohmyjev at d307c39 (0.13.2; R26-S20 to R26-S24, read 2 Nov 2026): hooks/ohmyjev.ts L24, L70, L80–89, L191–201, L272–311, L719, L791–800; hooks/jev.ts L58–64; hooks/policy.ts L12, L57–58, L65, L84, L390–428; .claude-plugin/plugin.json L29–34; adapters/pi.ts L497–560; adapters/omp.ts L522–600; adapters/shared.ts L28, L37, L106. Earlier pin 78bb82c (read 16–21 Oct 2026): hooks/ohmyjev.ts L24, L70, L80–89, L193–194, L276–298, L309, L724–730, L778–811; hooks/jev.ts L58–64; hooks/policy.ts L18–19, L63, L323–337; adapters/shared.ts L557–568; adapters/pi.ts and adapters/omp.ts read in full; the built Codex hook codex/ohmyjev.mjs checked at its gate lines, its source adapters/codex.ts read in full.
  • Recount of 18 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 50/17/7/3/0, error 39/22/8/5/3/0, malformed 35/24/11/4/3/0, below threshold 25/16/15/12/5/4/0, bypass 77/0 with 13 "none found"); after adding the two rows every column sums to 79 with 0 not recorded (script over this page's cells: no key 51/17/8/3/0, error 40/22/9/5/3/0, malformed 36/24/12/4/3/0, below threshold 25/17/15/12/5/5/0, bypass 79/0). mcowdery/claude-model-guard at bced870 (package 1.2.0): scripts/promptAdvisor.mjs L25, L31, L64–65, L70, L77, L82, L86, L133–155; scripts/jev.mjs L124–137; scripts/decision.mjs L6–10, L32, L36–47; read 16 Oct 2026 (R17-S242 to R17-S245) and re-read 18 Oct 2026 (R18-S224 to R18-S226); HEAD = pin, 18 Oct 2026, 05:20 UTC (R18-S202). delt96/claude-jev-advisor at f2c1791 (= npm @delt/claude-jev-advisor 0.5.0): src/rm/run.ts L29–30, L66–67, L77–92, L102, L123; src/rm/judge.ts L75–77; src/jev.ts L4, L63, L72–80; read 16 Oct 2026 (R17-S239 to R17-S241); bypass entry points from one listing of the repository at the pin read 18 Oct 2026 (R18-S214 to R18-S223); no-key line run.ts L91–92 checked again (R18-S66); HEAD = pin, 18 Oct 2026, 05:20 UTC (R18-S201).
  • Recount of 16 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 50/17/7/3/0, bypass 66/11, below threshold 25/16/15/12/5/4/0, error 39/22/8/5/3/0, malformed 35/24/11/3/3/1); after the change every column sums to 77 with 0 not recorded (script over this page's cells). Bypass cells of the 11 rows read at the published pins, 16 Oct 2026 (R17-S100 to R17-S194, R17-S300 to R17-S313; spot-checks of DeepEval JevEval and Spring AI JevDocumentFilter, R17-S68; openlayer jevals _bench.py and _calibrate.py, R17-S72). JevPlaysSnakeGame at b9237bf: whole repository (18 files), main.py L1-12, src/runner.py L1-26, src/game/engine.py L1-151, src/game/snake.py L1-78, src/agents/jev_agent.py L1-64, read 16 Oct 2026, 05:38 UTC (R17-S73). competitor-hunter malformed at 40613ea: jev.py L149 (R17-S159), hunt.py L565-566, L778, L796 (R17-S155 to R17-S157). Labels: Documented (source at pinned commits). Nothing was run.
  • Recount of 14 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 43/16/7/3/8, bypass 52/25, below threshold 20/16/15/12/5/4/5, error 39/22/8/5/3, malformed 35/24/11/3/3/1; R16-S69); after the change every domain row and total recomputed by script from the map cells (no key 50/17/7/3/0 = 77, bypass 66/11 = 77, below threshold 25/16/15/12/5/4/0 = 77; error and malformed unchanged). Cells read at the published pins, 14 Oct 2026, 16:47–17:03 UTC: ticket-triage bypass (R16-S100 to R16-S107), zammad-jev-dispatcher malformed (app.rb L117-138; R16-S103), email bypass and spam-leadgen-pipeline no key (R16-S108 to R16-S114), n8n no key and bypass (R16-S115 to R16-S121) with n8n's own missing-credential path at release n8n@2.44.1 (R16-S122 to R16-S124), n8n below threshold (R16-S314 to R16-S321), hermes-jev-mana no key (R16-S128), jev-trader no key (R16-S129 to R16-S132), jkudish/jev-mcp bypass (R16-S133, R16-S134), browser bypass (R16-S300 to R16-S313) and jev-for-chrome below threshold (R16-S307). Spot-checks of the triage bypass, n8n no-key and second-look cells matched (R16-S70). HEAD moved since the pin (cells read at the pin): gbesse/zammad-jev-triage → f46e5ad, spam-leadgen-pipeline → 030bb0a (R16-S126). File paths and line ranges for each cell are on the domain pages.
  • Recount of 13 Oct 2026: the 77-row map as published here reproduces from this page's cells before the change (no key 38/14/4/3/18, bypass 44/33, malformed 34/24/11/3/3/2; R15-S55, read 13 Oct 2026, 05:31 UTC); after the change every domain row and total recomputed by script from the map cells (no key 43/16/7/3/8 = 77, bypass 52/25 = 77, malformed 35/24/11/3/3/1 = 77). No-key and bypass cells for the 6 model-routing and 7 content-moderation rows read at the published pins, 13 Oct 2026, 05:18–05:26 UTC (R15-S100 to R15-S130; spot-check of the jev_antispam_bot no-key cell and the soter bypass cell against the raw files, 05:29 UTC, R15-S55). agent-router malformed: decision-engine.ts L179, L196, L224 → run.ts L363 (exit code 2). jev-demo-moderator bypass "none found": entry-point files read server.py, moderator.py, web/index.html (R15-S130). File paths and line ranges for each cell are on the domain pages.
  • Recount of 12 Oct 2026: the 74-row base as published here reproduces from this page's cells (error: 38/20/8/5/3; R14-S52, read 12 Oct 2026, 05:20 UTC), plus 3 real-time rows; every domain row and total recomputed by script from the map cells after the edit and checked against the totals in the research notes (39/22/8/5/3 = 77). mikespins/doom-jev at bd4e98f (brain.py L27–52, L291, L301–302, L331–334, L340–352; game.py L193, L255–281, L287; jev_doom.py L33, L41–45, L51; R13-S100 to R13-S120, R13-S68; HEAD unchanged 12 Oct 2026, 05:12 UTC, R14-S100). FazalAAli/jev-robotics-demo at 531de61 (jev_agent.py L29–30, L198–293; R13-S69; only commit, unchanged 12 Oct 2026, 05:12 UTC, R14-S101). bileshg/JevPlaysSnakeGame at b9237bf (src/agents/jev_agent.py L11–31, L54–64; src/game/engine.py L96–151, L113, L127–128; config.yaml L2; main.py L12; uv.lock L235–236; R14-S114, R14-S49, read 12 Oct 2026, 05:12–05:19 UTC). SDK defaults: typesafe-sdk 0.7.4 (typesafe_sdk/constants.py L15, L18; R14-S48; timeout, retries and no-key error R13-S300, R13-S301, R13-S304). Labels: Documented (source at pinned commits). Nothing was run.
  • Recount of 11 Oct 2026: the 71-row base as published here reproduces from this page's cells (error: 38/17/8/5/3), plus 3 coding-agent rows; every domain row and total recomputed by script from the map cells after the edit and checked against the totals in the research notes (38/20/8/5/3 = 74). jev-triage 1.0.3 at 6360e21 (index.js L32–49: score cut L45, 5,000 ms L39, failure path L41–44, bypass L34; R13-S200, R13-S201, R13-S202), host OpenClaw at aa6008a, the provenance commit of @openclaw/typesafe 2026.9.8 (src/auto-reply/reply/dispatch-from-config.choose-route.ts L557–692; src/plugins/hooks.ts L789–847; src/plugins/hook-runner-global.ts L22–30; src/plugins/hook-types.ts L478–481; R13-S203 to R13-S207), read 11 Oct 2026, 05:17–05:18; drift check at @openclaw/typesafe 2026.10.1 (9cf7fc2; R13-S208, R13-S209). jev-for-all 0.7.1 from the npm tarball (gitHead 74f62e7; bin/pick.ts L55–72, src/models.ts L20–75; R13-S222, R13-S223, R13-S224), read 11 Oct 2026, 05:20. hermes-jev-mana at 3daf639 (patches/jev-decisions.patch L88–93, L428–429, L436–458, L937–941, L1062–1078, L1396–1397; plugin/jev-mana/jevkit/decisions.py L282–287; plugin/jev-mana/decision_hooks.py L61–71; tools/jev_mana_install.py L334–337, L401–402; R13-S210 to R13-S215), read 11 Oct 2026, 05:18–05:20; patch L88–93, L428–429 and L1396–1397 spot-checked against the raw file at the pin at 05:38. Labels: Documented (source at pinned commits); the installer's no-key statement is Reported. LanceDB TypeSafeReranker no-key cell at b1b080b (python/python/lancedb/rerankers/typesafe.py L45–46, L94, L98–127, L153–157, L181–199; R13-S311, R13-S312), read 11 Oct 2026, 05:22; the SDK's no-key TypeSafeError, default timeout and retries from the typesafe-sdk 0.7.4 wheel (_core/config.py L25–37, constants.py L21–22, _core/retry.py L52–62; R13-S300, R13-S301, R13-S304), read 11 Oct 2026, 05:21.
  • Recount of 10 Oct 2026: the 69-row base as published here reproduces from this page's cells (error: 38/15/8/5/3), plus 2 coding-agent rows; every domain row and total recomputed by script from the map cells and checked against the totals in the research notes. jev-effort-router 0.2.2 at 562dc2a: client.py L178–179, L193–208, L210–228, L237–252; config.py L29–34, L147–152; router.py L105–137, L182–192, L250–253 (R12-S200–R12-S205); Hermes catalog pin and the one-commit diff (R12-S206, R12-S207); Hermes core sends the rewritten request: hermes_cli/middleware.py L63–99 and agent/turn_api_request.py L140–151 at f97608f (R12-S208, R12-S209); read 10 Oct 2026, 05:12–05:13 UTC. jev-gateway npm 0.5.1, repository named in npm metadata (gitHead 37ff982); code read from the npm 0.5.1 tarball, read in memory and not run: jev.js L65–66, L90–101; decide.js L12–28, L102–110, L122–133, L141–161; config.js L24, L39, L43–44; app.js L117–118, L150–153, L205–212; launcher.mjs L112–119 (R12-S241, R12-S257); 10 Oct 2026, 05:13–05:15 UTC.
  • Recount of 8 Oct 2026: the 64-row base as published here, plus 5 rows and 5 changed cells; the scripted totals in the research notes were recomputed from this page's cells. New rows: LiteLLM TypeSafe compaction guardrail at 7964577 (litellm/proxy/guardrails/guardrail_hooks/typesafe/typesafe.py; R9-S120); jev-reranker 0.1.2 d58594b (reranker.py, _client.py; R11-S200–R11-S203); LanceDB v0.40.0 b1b080b (rerankers/typesafe.py; R11-S204, R11-S205); pg-redact ee903ef (src/lib/jev.ts, src/app/api/classify/route.ts; R11-S220, R11-S221); docjev c7abe27 (src/jev_docs/engines/jev.py; R11-S222). Changed cells: jev-approvals with Hermes core agent/auxiliary_client.py L7610–7701, L7672–7675 at f97608f (R11-S110–R11-S112); jev-curator plugin/transport.py L118–131, plugin/graph.py L21–24, L165–176 (R11-S108, R11-S109); openlayer backends/__init__.py L30–55 (R11-S107); rh-guard score.ts L98–116, kinds.ts L36 (R11-S106); oh-my-claudecode v5.6.2 454bae0 (R11-S100–R11-S102) and jkudish/jev-mcp 0.14.1 86eae78 (R11-S103, R11-S104): failure paths unchanged.
  • Recount of 7 Oct 2026, 05:23–05:30 UTC: the 58-row base as published here (R10-S30), plus 4 judge rows mapped from Jev as a judge (R10-S31) and its 4 Oct note (R10-S32) at DeepEval a200ece, openlayer jevals 0a8f895, did-they-answer e0ee60c and competitor-hunter 40613ea; plus 2 Hermes rows. Every condition row and every domain sums to its n (script). No existing row changed a cell.
  • Hermes rows, 7 Oct 2026, 05:19–05:26 UTC (read at the pinned commits; spot-checks against the raw files at 05:24–05:25 matched): jev-approvals 28be98a (plugin/jev_policy.py L13, L54–59; R10-S41) with Hermes Agent core v2026.9.24 f97608f (tools/approval.py L774–790, tools/approval_smart.py L115–131; R10-S101–R10-S105, R9-S61); jev-curator 4e8626c (plugin/engine.py L91–94, plugin/guard.py L57–74, L143–160, plugin.yaml L50–53; R10-S106–R10-S111). Settled without a count change: rh-guard default mode (src/lib/risk/kinds.ts L176–189 at c2e682e; R10-S117, R10-S118); OpenCode v1.18.35 default rules (packages/opencode/src/agent/agent.ts L119–136 at 53d1eab; R10-S114–R10-S116); osuki 0.2.8, tag 0ae9e884a97a5539fef3f0772318a628c1f75e00 (R10-S112, R10-S113).
  • Recount of 6 Oct 2026, 05:22–05:29 UTC: the 51-row base as published here, read 05:25:44, plus 7 new rows; every domain row and total sums to its n (script). No existing row changed.
  • jev-permission-gate: madisonrickert/jev-permission-gate 7349bc9 (hooks/policy.ts, hooks/register.ts, hooks/typesafe.ts), read 4 Oct 2026; HEAD = that pin by git ls-remote, 6 Oct 2026, 05:20:19 (R9-S70). Not counted: gulbaki/jev-llm-guard 7c7b1b5 (src/cli.js, src/web-server.js; R9-S70, R9-S71).
  • Coding agents: six rows read at pinned commits, 6 Oct 2026, 05:14–05:25 (read at the pinned commits; spot-checked against the raw files at 05:22): jev-kit 3d74b05 (packages/hook-adapters/src/index.ts, packages/agent-review/src/index.ts, packages/decision-contract/src/index.ts, packages/cli/src/cli.ts; R9-S72, R9-S73); codex-jev-approval-hook b6242c9 (hook.ps1; R9-S81); rh-guard c2e682e (src/lib/risk/score.ts, jev.ts, hooks.ts, hosts.ts, hooks/run.ts; R9-S82); opencode-tool-gate bdf1ef8 (src/index.ts, src/jev.ts, src/judge.ts; R9-S74); @osuki-dev/opencode-osuki-agent 0.2.7, tag commit c96ce03c1c7dfc5c6fdf9d966691549101c68080 (dist/index.js; R9-S80); hermes-jev jev-judge 5dddbea (plugins/jev-judge/__init__.py, jev.py, gate.py, plugin.yaml; R9-S63).
  • Recount of 5 Oct 2026, 05:29 UTC: the 39-row base as published here, read 05:26, plus 12 new rows; every domain row and total sums to its n. No existing row changed.
  • Browser and computer use: eight projects read at pinned commits, 5 Oct 2026, 05:12–05:24 (spot-check of 15 key lines against the raw files): jev-ultrafast 1231850 (jev_ultrafast/model.py, agent.py); ironbee-express 05079b4 (src/engine/systemone.ts, src/agent/policy.ts, agent.ts, run/runner.ts); jev-agent-browser eb35251 (src/decision.js, src/loop.js, src/classifier.js, cli.js); jev-android be8364a (JevProvider.kt, ProviderTransport.kt, JevAgent.kt, Models.kt); computer-use-jev ff0ad8b (decide/decide.go, typesafe/client.go, cmd/computer-use-jev/main.go); jev-for-chrome d5c24de (src/background/agent.ts, src/shared/providers/http.ts, typesafe.ts); Ulka bb04433 (apps/extension/src/agent/vercel-jev.ts, agent-runner.ts, approvals.ts, background.ts); second-look 0c05d16 (backend/app/jev.py, backend/app/research.py). Not counted: trycua/cua jev-use ba0033a (run.py: mock provider by default).
  • Framework integrations: four decision rows read at pinned tags or commits, 5 Oct 2026, 05:12–05:27 (spot-check of 26 key lines against the raw files, plus a second read of the three decision paths): Spring AI TypeSafe 51993bb (JevDocumentFilter.java, RetryPolicy.java, TypeSafeConstants.java); LlamaIndex JevRerank 421afda (base.py, utils.py); LangChain ModelRouterMiddleware 4af7ab8 (model_router.py, classifier.py); LangChain autoModeMiddleware 417ddcf (src/middleware/autoMode.ts, classifier.ts).
  • Domain tables re-read on 4 Oct 2026 at 05:19; counts recomputed 05:19–05:30. Each cell's file path and line range is on its domain page.
  • Support-ticket triage: five projects read at pinned commits, 1 Oct 2026, 05:32–05:36; bypass and the zammad-jev-dispatcher malformed path read at the same pins, 14 Oct 2026 (R16-S100 to R16-S107).
  • Model routing: six routers read at pinned commits, 2 Oct 2026, 05:16–05:21; no-key and bypass paths read at the same pins, 13 Oct 2026, 05:18–05:26 (R15-S100 to R15-S130).
  • Content moderation: six projects read at pinned commits, 2 Oct 2026, 05:23–05:27; no-key and bypass paths read at the same pins, 13 Oct 2026, 05:18–05:26 (R15-S100 to R15-S130).
  • Claude Code and MCP guards: integrations read in pinned source, 29 Sep 2026, 07:09–07:14; versions rechecked 3 Oct 2026, 05:21 (oh-my-claudecode at v5.6.0, jkudish/jev-mcp at 0.13.0) and 8 Oct 2026 (v5.6.2 and 0.14.1: failure paths unchanged). The danna-zhou no-key cell was also Tested offline there (no Jev call), 29 Sep 2026. claude-model-guard and claude-jev-advisor read at their pins 16 Oct 2026; bypass entry points read 18 Oct 2026. ohmyjev read at its pin 16 Oct 2026; every entry-point file read for its Jev paths 18–19 Oct 2026 (R19-S200 to R19-S206); re-read at 0.13.2 (commit d307c39), 2 Nov 2026: gates now need lockdown (off by default); same five terms in lockdown mode (R26-S20 to R26-S24); re-read at 0.14.0 (commit fbc4ea4), 8 Nov 2026: failure cells unchanged; bypass cell adds the shadow setting and the in-repo move skip (R28-S20 to R28-S23).
  • Email and lead sorting: five projects read at pinned commits, 3 Oct 2026, 05:19–05:27; bypass and the spam-leadgen-pipeline no-key path read at the same pins, 14 Oct 2026 (R16-S108 to R16-S114).
  • Jev in n8n: five nodes read at pinned commits, 3 Oct 2026, 05:20–05:27; no-key, bypass and below-threshold paths read at the same pins and n8n's missing-credential path at release n8n@2.44.1, 14 Oct 2026 (R16-S115 to R16-S124, R16-S314 to R16-S321).
  • Trading and fraud gates: seven projects read at pinned commits, 4 Oct 2026, 05:14–05:21: QuantDinger a5a9f4c (backend_api_python/app/services/ai_decision_filter.py, services/strategy_v2/live_execution.py, routes/quick_trade.py, routes/quick_trade_ai.py, routes/alpaca.py, services/trading_executor.py, services/pending_order_worker.py, tests/test_ai_decision_filter.py); jev-trader b587759 (src/config.ts, model.ts, trader.ts, market.ts, server.ts); Jev Trade a3f2f83 (src/config.ts, model.ts, plan.ts, trader.ts, index.ts, market.ts, sleeves.ts, server.ts); btc-hft-jev 96f3541 (jevloop/client.py, loop.py, policy.py, battery.py, ladder.py, state.py, strategy.py, limits.py, execution/alpaca.py); jev-fraud-shield eeb4fc6 (jev_client.py, decision_engine.py, demo.py); fraud-jev aa33b97 (src/lib/fraud.ts, src/app/api/analyze/jev/route.ts); expense-policy gate 161c33b (src/jev_expense_gate/cli.py, jev_client.py, policy.py, pipeline.py, config.py, config/expense-policy.json).
  • Query wording: Google suggest (client=firefox), YouTube (ds=yt), Bing (osjson) and DuckDuckGo (ac), 4 Oct 2026, 05:21:29, for "jev fallback", "jev timeout", "jev error handling", "jev fail open", "jev retry" and "typesafe api error": no relevant suggestion (the same result as 3 Oct). A suggestion is a demand signal, never a volume.

Search published pools, pages, reports, and evidence.