MarkTechPost ★ 80 9 min

20 Jev Alternatives: The Decision Models Taking On TypeSafe in 2026

Agentic AIAI InfrastructureComparisonDecision ModelsFor DevsLanguage Model

🔗 https://www.marktechpost.com/2026/10/17/20-jev-alternatives-the-decision-models-taking-on-typesafe-in-2026/

📌 Jev 上線四週,就冒出 20 個挑戰者

TL;DR:TypeSafe 的決策模型 Jev 九月中上線,一個月內 Cloudflare、OpenAI、Perplexity 等至少 20 家團隊推出替代方案,場面瞬間變成混戰。

如果你還沒聽過「決策模型」(decision model)這個新品類:它不是聊天機器人,你預先定義好允許的答案範圍,模型只回傳一個標籤、一個分數,或是一個帶機率的是非題答案,完全不生成文字。TypeSafe 在 9 月 15 日推出 Jev 之後,短短四週內,至少 20 個替代方案陸續上線,陣營橫跨 Cloudflare、OpenAI、Perplexity、Liquid AI、AWS 的 Strands Labs,以及一批獨立開發者。

🤔 Jev 本身:好用,但有四個明顯缺口

Jev 是 TypeSafe 的第一個「System One」模型:你送一段狀態(例如一張工單或一行 log),搭配型別化的問題(Choice、Score 或 Noul 是非題),Jev 會在一次平行處理中回答所有問題。計價是每百萬 input token 0.042 美元,輸出免費,context 上限 64k token,且目前只接受文字輸入。權重未公開,得透過候補名單申請存取。TypeSafe 自己的 workflow 評測顯示 Jev 達到 67.8% 的一致率,每筆案例耗時 0.4 秒。

開發者社群最常提出的四個缺口是:不支援圖片、不能自架、沒有公開參數規模,也不能微調。接下來的 20 個替代方案,幾乎都是針對這四個缺口而來。

📊 一輪橫向比較:規模、授權與對 Jev 的基準分數

需要先說明:下列分數來自不同的評測集(JevBench、Decision Index、typed-decisions、Respan 的 Behavior Benchmark 等),彼此並不能直接比較,而且多數數字是廠商自行公布。唯一的第三方多模型對照表來自 Respan,但它本身也在賣一個競品模型,立場並不中立。

模型 / 團隊規模授權或計價對 Jev 的關鍵基準分數
Clef / Cloudflare27B(Qwen3.8-27B 基底 + 視覺編碼器)Apache-2.0,Workers AI 每百萬 token 0.24 美元BANKING77 F1 94.20 vs Jev 79.74;GPQA Diamond 仍是 Jev 領先 78.3 vs 48.0
Clef-flash / Cloudflare9B(Qwen3.5-9B 基底)Apache-2.0,每百萬 token 0.038 美元與 Clef 共用 API,號稱完全相容 Jev
d1-3B / Liquid AI3.1B(LFM2.5-VL-3B 基底)LFM Open License,開放權重Decision Index 0.2.1 得 48.57 分;RTX 4090 上延遲 8 毫秒
d1-omni-600M / Liquid AI587M,支援 30 秒音訊片段LFM Open License同上系列,未公布獨立分數
Decisions API(gpt-6-luna)/ OpenAI未公布每百萬 input token 0.10 美元,輸出免費,非 Jev 相容 schema官方宣稱比 Responses API 快約 10 倍,未公布基準分數
pplx-decider-v1-27b / Perplexity27B(Qwen3.8-27B 微調)Apache-2.0,每百萬 token 0.02 美元;4B flash 版 0.01 美元11 項任務面板平均 85.71% vs Jev 84.51%;BBH 仍是 Jev 領先 94.27 vs 82.80
Decider 1 / meraGPT未公布封閉權重,每百萬 token 0.04 美元typed-decisions 得 0.768 vs Jev 0.727;ECE 0.180 遜於 Jev 0.144
Span-01 / Respan未公布每百萬 token 0.02 美元,Lite 版免費官方宣稱 Behavior Benchmark F1 0.843,自家部落格表則為 0.806,落後 GPT-6 Sol 的 0.885
Standard One 8B8B(Ministral-3-8B 上的 LoRA)Apache-2.0JevBench public hard 54.95% vs Jev 72.07%;realistic transfer 90.83% vs 86.67%,兩組都是廠商自測
Tev1 / TogetherQwen3.5-4B 的 LoRA SFT,訓練成本約 17 美元、25 分鐘授權尚未確定Respan 測得準確率 0.901、ECE 0.031,表中最佳校準度,但 Together 自己提醒其 logprobs 並非校準過的信心值
GLiNER2.5-Decide / Fastino340M(DeBERTa-v3-large)Apache-2.017 領域自測 exact match 60.2%;48 vCPU Xeon 上 p50 延遲 167.3 毫秒;非 Jev API 相容
Strands Decider / AWS Strands Labs約 1.9B(Qwen3.5-2B-Base + pointer head)Apache-2.0,公開完整訓練流程與 246,678 筆訓練資料JevBench public 得 180/231(77.9%);RTX 3090 上中位延遲 115 毫秒
Kev-4B4B(Qwen3.5 LoRA + pointer head)Apache-2.0Respan 測得準確率 0.833、flip rate 0.060;自測 MMLU-Pro 0.565 vs Jev 0.840;選項順序會影響答案
Mapika Decider 12B0.8B 到 35B-A3B 多種規模Apache-2.0JevBench public hard 12B 版與 Jev 同分 0.730;4B 的 GGUF Q4_K_M 僅 2.7 GB,可跑在 CPU 上
Bespoke-Nimble-9B165 MiB LoRA(Qwen3.5-9B)Apache-2.0,僅訓練 2,676 筆資料自家 324 筆保留集測得 90.12% vs Jev 93.21%;H100 上延遲約 106 毫秒,機率未校準
Laya421M 英文版 / 322M 多語版(ModernBERT)Apache-2.0typed-decisions 0.766 vs Jev 0.727;Banking77 卻只有 0.425 vs 0.870
Von 1.2395M(ModernBERT-large)Apache-2.0Respan 測得準確率僅 0.422,表中最低;校準度是針對 JevBench 調的,跨領域可能失準
Open-Jev2B / 9B / 27B(Qwen3.5 adapter)未標明授權JevBench 子集:9B 得 77.49%,27B v1.1 得 85.28%;數值與時間類任務偏弱
OpenJev(NVIDIA DiffusionGemma 版)26B-A4B,4B 啟用免費額度 100M token,自架需 24GB 以上 GPUJevBench public 87.4%,p50 延遲 30 毫秒(49 tokens)

💡 API 相容是這波替代方案的共同套路

仔細看就會發現,多數團隊的策略並不是重新定義協定,而是直接相容 Jev 的 /v1/systemone 請求格式(Cloudflare 稱 Clef「完全相容 Jev」,Kev、Standard One、Strands Decider 等也是同一個路線),這代表開發者理論上可以把現有串接 Jev SDK 的程式碼原封不動指向這些替代模型,只需換個 base URL。少數例外是 OpenAI 用自家 schema、Together 的 Tev1 走一般 chat completions 介面,等於要求開發者額外改寫整合層。

⚠️ 分數好看不代表能直接上生產環境

文章反覆提醒兩件事:一是不同評測集(JevBench、Decision Index、typed-decisions、Respan Behavior Benchmark)之間的分數不能互相比較;二是多個模型存在校準度(ECE)落後 Jev、選項順序會影響答案(如 Kev-4B),或是 logprobs 並非真正校準過的信心值(如 Together 的 Tev1)等問題。換句話說,「贏過 Jev 的某一項分數」距離「可以安心取代 Jev」還有一段距離,尤其是牽涉到自動化決策的信心分數時,校準度往往比單一準確率更關鍵。

🎯 實務啟示

如果你正在評估要不要導入決策模型類服務,重點不是找「分數最高」的那一個,而是依照自己的限制條件去篩選:需要圖片輸入就看 Clef、pplx-decider 或 OpenJev;需要自架與完整訓練細節就看 AWS 的 Strands Decider;預算極度敏感就看 Clef-flash 或 Perplexity 的 flash-v1.2;需要校準良好的信心分數,則要特別留意 ECE 與 flip rate 這類指標,而不是只看單一準確率。由於多數模型都走 Jev 相容的 API,實際評估成本其實不高,值得挑幾個候選直接拿自己的資料跑一輪。

🔗 來源

#DecisionModels #TypeSafe #Jev #OpenSourceAI #Cloudflare #LiquidAI #OpenAI #Perplexity #AWS #LLM

原始資料 MarkTechPost · 收集於 2026-10-17
來源原標題
20 Jev Alternatives: The Decision Models Taking On TypeSafe in 2026
作者
Asif Razzaq
原始標籤
Agentic AI · AI Infrastructure · Artificial Intelligence · Comparison · Decision Models · Editors Pick · For Devs · Language Model · Staff · Tech News · Technology
原始連結
https://www.marktechpost.com/2026/10/17/20-jev-alternatives-the-decision-models-taking-on-typesafe-in-2026/

摘要原文

TypeSafe launched Jev on September 15, 2026. It is a decision model, not a chatbot. You define the allowed answers, and Jev returns a label, a score or a yes/no probability. In about 4 weeks, at least 20 Jev alternatives shipped. They come from Cloudflare, OpenAI, Perplexity, Liquid AI, AWS’s Strands Labs and independent developers. This guide compares each one on size, license, hardware, pricing, Jev API compatibility and published benchmarks. Jev is TypeSafe’s first ‘System One’ model. You send a state, such as a ticket or log line. You also send typed questions: Choice, Score or Noul (yes/no). Jev scores every question in one parallel pass and generates no text. TypeSafe’s docs list $0.042 per 1M input tokens, with free output. Context is 64k tokens per request. Input is text only. Weights are closed, and access runs through a waitlist. TypeSafe’s workflow evals put Jev at 67.8% agreement and 0.4 s per case. That leaves 4 gaps developers keep raising: no images, no self-hosting, no published size and no fine-tuning. The 20 models below fill some or all of them. Most figures below are self-reported. The suites differ: JevBench, Decision Index, typed-decisions and Respan’s behavior benchmark. Scores across suites are not comparable. The one multi-model third-party table comes from Respan , which sells a competing model. Cloudflare announced Clef on October 1, 2026. Clef is 27B on Qwen3.8-27B with a vision encoder. Clef-flash is 9B on Qwen3.5-9B. Both are Apache-2.0 on Hugging Face and served on Workers AI. They accept text, JSON and up to 4 images per request. Workers AI pricing is $0.24 (Clef) and $0.038 (Clef-flash) per 1M input tokens. Cloudflare calls the API fully Jev-compatible. In its own run, Clef scored 94.20 BANKING77 F1 versus Jev’s 79.74. Jev still wins GPQA Diamond, 78.3 versus 48.0. Liquid AI’s d1 family has hosted d1 and d1-ultra, plus 2 open models. d1-3B (3.1B) runs on LFM2.5-VL-3B. d1-omni-600M (587M) adds audio clips up to 30 s. The open weights use the LFM Open License. Liquid’s guide calls d1 through TypeSafe’s own SDK with a different base URL. Liquid reports d1-3B at 48.57 on Decision Index 0.2.1. It also reports 8 ms latency on an RTX 4090. Hosted parameter counts and paid rates are not disclosed. OpenAI released the Decisions API in public beta on October 6, 2026. It runs only on gpt-6-luna. It accepts text plus base64 images. Question types are predicate, choice and score. Pricing is $0.10 per 1M input tokens, with output not billed. The schema is OpenAI’s own, so it is not Jev-compatible. OpenAI claims about 10x faster responses than the Responses API. No benchmarks are published. Perplexity’s pplx-decider-v1-27b is a Qwen3.8-27B fine-tune under Apache-2.0. It reads text, JSON and up to 8 images per question. The API allows 128 questions and 255 options per request. The current pricing is $0.02 per 1M input tokens for v1.2 (27B). A 4B flash-v1.2 costs $0.01. On Perplexity’s 11-task panel, it scored 85.71% versus Jev’s 84.51%. Jev still won BBH, 94.27 versus 82.80. meraGPT announced Decider 1 on September 22, 2026. It is a hosted, closed-weight, text-only model. It allows up to 10 Choice labels and a 4,096-token context. The model page lists $0.04 per 1M input tokens. It exposes /v1/systemone and works with the TypeSafe SDK. On meraGPT’s typed-decisions run, it scored 0.768 versus Jev’s 0.727. An independent review notes its ECE of 0.180 trails Jev’s 0.144. Span-01 is a behavior-scoring model, not a general decision model. It returns present, absent or not_observable probabilities. It costs $0.02 per 1M input tokens. Span-01 Lite is free. Respan claims 0.843 overall F1 on its Behavior Benchmark. Its own blog table shows a lower 0.806, with GPT-6 Sol ahead at 0.885. Size, base model and license are not disclosed. Standard One ships as 3B and 8B models, both open and hosted. The 8B is a LoRA on Ministral-3-8B under Apache-2.0. It reads text and images, with a 32,768-token context. It serves /v1/systemone. Hosted text pricing is $0.018 (3B) and $0.035 (8B) per 1M tokens. On JevBench public hard, the 8B scored 54.95% versus Jev’s 72.07%. It led on realistic transfer, 90.83% versus 86.67%. Both runs are publisher-measured. Together trained Tev1 as a LoRA SFT of Qwen3.5-4B. It cost about $17 and 25 minutes on 37,840 examples. It picks from 2 to 24 options. The model card says the weights license is still being finalized. It answers through chat completions, not a native Jev endpoint. Respan measured 0.901 accuracy and 0.031 ECE, the best ECE in its table. Together warns its logprobs are not calibrated confidence. Fastino’s GLiNER2.5-Decide is a 340M DeBERTa-v3-large encoder under Apache 2.0. It handles decisions, span extraction and relations in one pass. A 1B and a 287M multilingual variant also exist. On Fastino’s 17-domain set, the model card lists 60.2% exact match. p50 latency is 167.3 ms on a 48-vCPU Xeon. It is not Jev API-compatible. AWS’s Strands Labs introduced Strands Decider on October 1, 2026. It is about 1.9B: Qwen3.5-2B-Base plus a pointer head. The repo publishes 246,678 training rows and the full recipe. One RTX 3090 trains it in about 11 hours. It serves a local /v1/systemone endpoint under Apache-2.0. The v1 checkpoint scored 180 of 231 (77.9%) on JevBench public. Median latency is 115 ms on an RTX 3090. Kev comes in 0.8B, 4B, 9B and 27B sizes on Qwen3.5 and Qwen3.8. Kev-4B is a LoRA plus pointer head under Apache-2.0. It supports 255 options. The TypeSafe SDK works against it unchanged. Kev-4B fits a 24 GB GPU or a 32 GB Apple Silicon Mac. Respan measured 0.833 accuracy and a 0.060 flip rate. Self-reported MMLU-Pro is 0.565 versus Jev’s 0.840. Option order can change its answers. Mapika’s Decider ships 0.8B to 35B-A3B variants on Qwen3.5 and Gemma 4. A decider-2b-vision model adds images. Everything is Apache-2.0, with 32k context and /v1/systemone. On the JevBench public hard tier, decider-12b v1 tied Jev at 0.730. The 4B GGUF Q4_K_M is 2.7 GB and runs on CPU. The 4B’s ECE is 0.184 on hard items, so expect overconfidence. Bespoke-Nimble-9B is a 165 MiB LoRA on Qwen3.5-9B, Apache-2.0 on Hugging Face. The current card lists 255 choices and 8,192 tokens. It reads English text only. On Bespoke’s 324-example held-out set, Nimble scored 90.12% versus Jev’s 93.21%. Latency is about 106 ms on an H100. It trained on only 2,676 examples, and its probabilities are not calibrated. Laya is a ModernBERT-based family with 421M English and 322M multilingual checkpoints. It is Apache-2.0 and text only. The laya-serve server exposes a Jev-shaped /v1/systemone endpoint. The typed-decisions checkpoint scored 0.766 versus Jev’s 0.727. On Banking77, it scored 0.425 versus 0.870. Respan measured 0.542 accuracy and a 0.396 injection success rate. p50 latency is 32.8 ms on a T4. Von is a 395M ModernBERT-large encoder with an option-marker head. It scores all options in one bidirectional pass. It is Apache-2.0 with an 8,192-token context. The repo reports 0.096 s p50 on 4 vCPUs and 0.023 s on an A10G. Respan measured Von 1.2 at 0.422 accuracy, the lowest in its table. Its calibration is tuned to JevBench and can mislead out of domain. Open-Jev ships 2B, 9B and 27B adapters on Qwen3.5 bases. Open-Jev-9B adds a scalar head and fits one 16 GB GPU. It matches the /v1/systemone request shape but claims no parity. On a 231-task JevBench subset, the project reports 77.49% for 9B and 85.28% for 27B v1.1. Each candidate is capped at 4,096 tokens. Numeric and timeline tasks are weak. This OpenJev reads decisions from NVIDIA’s DiffusionGemma 26B-A4B (4B active). It accepts text plus up to 8 images. It uses the same wire API, so Jev SDKs work unchanged. The project reports 87.4% on JevBench public and 30 ms p50 at 49 tokens. A free hosted endpoint gives 100M tokens per account. Self-hosting needs an NVIDIA GPU with at least 24 GB. InnerJev comes from a Fudan, Tongji and King’s College London team.

由 claude-code/sonnet 自動生成