A new kind of AI model from a ChatGPT inventor is thrilling developers
https://techcrunch.com/2026/09/18/a-new-kind-of-ai-model-from-a-chatgpt-inventor-is-thrilling-developers/📌 發明 RLHF 的人說:LLM 不是自動化該用的語言
TL;DR:TypeSafe AI 推出非 LLM 的 Jev,輸出校準機率而非文字,開發者實測比 LLM 分類器快 5 到 20 倍。
Diogo Almeida 參與打造了 ChatGPT,也發明了 RLHF——這個讓當代 AI 得以誕生的關鍵訓練技術。但他心碎了。「我們手握閃電,它卻不實用,」他告訴 TechCrunch。這句話,成了他離開 OpenAI 創辦新公司的起點。
🤔 問題不在模型,在於「語言」本身
Almeida 的診斷是:「我們花了四年把人類語言做得非常好,但這對自動化沒用,因為電腦說的是另一種語言。」兩年前他離開 OpenAI,創立 TypeSafe AI,試圖解決這個落差。這週,公司發表了新模型 Jev——一個基於 transformer,但刻意不輸出文字的模型。它輸出的是機率,公司稱之為「校準決策(calibrated decisions)」。
🧩 不說話的模型,為什麼反而更有用
放棄語言輸出帶來幾個直接效果:模型變得極其便宜且快速;因為輸出範圍由使用者預先定義,它不會產生幻覺(hallucinate)。計費方式也不同於一般 LLM——輸出 token 免費,輸入 token 以「十億」為單位計價,而非「百萬」。文章提到,需求一度高到公司短暫無法透過 API 服務所有使用者。
📊 開發者實測:快 5 到 20 倍,而且給出真實機率
Vercel 的軟體工程師 Pranit Sharma 原本用 OpenAI 的 ChatGPT Luna 5.6 跑一個分類器,審查指令是否安全;換成 Jev 後,結果快了 5 到 18 倍,準確度也更高。另一位開發者,Bryo AI 的 CTO Nikhil Mudholkar,拿 Jev 與 Gemini 比較商業郵件分類:Gemini 略準一些,但成本貴了 10 到 20 倍。真正打動他的是 Jev 會回傳「真實的機率」,他認為這對自動化工作流是關鍵能力。
Jev 也能反過來輔助 LLM:用它監控 agent 的行為軌跡、攔截越獄(jailbreak)嘗試,成本遠低於用另一個 agent 去監控 agent。開源模型 harness Pi 的作者、Earendil CTO Armin Ronacher 解釋這種設計的哲學:「這等於把幻覺問題的一部分交還給使用者——如果它只回傳 50% 機率,那可能就是丟硬幣,你可以選擇忽略;但如果是 95%,你就可以放心採取行動。」Ronacher 也提到另一個潛在用途:model routing,用 Jev 即時判斷一項工作該交給哪個模型處理,而不必動用昂貴的 LLM 來做這個判斷。
💡 模型取名自 Jevons 悖論
Jev 這個名字來自 19 世紀經濟學家 William Stanley Jevons,他提出的悖論描述:一項商品成本下降,反而會導致它被更廣泛地使用。Almeida 的賭注正是如此——智慧的成本下降,會讓它散布到軟體的每個角落。「我們認為未來會有大量智慧型軟體,以一種湧現、分散的方式存在,更像早期的網際網路,而不是現在大家在建的那些巨型 app。」
⚠️ 架構不透明,靠合成資料訓練
Almeida 對模型架構相當保密,外界觀察者推測它建立在某個開源權重 LLM 之上。公司把 Jev 稱為「System One 模型」,強調直覺而非推理,且針對特定任務優化。Almeida 表示 Jev 完全以合成資料訓練,採用他稱為「reinforcement learning from calibrated decisions」的技術。他形容這是自己「做過最好的賭注之一,比公司上線本身還好,甚至比 RLHF 還好」。Ronacher 認為,既然 Jev 的實用性已經顯現,競爭者很快就會出現。TypeSafe 本身也計畫在其他模態推出更多版本的模型。
🎯 實務啟示
如果你的系統裡有大量「分類、審查、路由」這類任務,目前用 LLM 硬解,Jev 這類「輸出機率而非文字」的模型提供了一個值得評估的方向:用機率閾值取代文字解析,天生規避幻覺問題,而且可能大幅降低延遲與成本。它與 LLM 並非取代關係,更像是分工——LLM 負責生成與推理,校準機率模型負責判斷與把關。
🔗 來源
- 標題:A new kind of AI model from a ChatGPT inventor is thrilling developers
- 作者/機構:Tim Fernholz, TechCrunch AI
- 連結:https://techcrunch.com/2026/09/18/a-new-kind-of-ai-model-from-a-chatgpt-inventor-is-thrilling-developers/
#TypeSafeAI #RLHF #AIAgents #CalibratedProbability #ModelRouting #Hallucination #AIStartup #SoftwareAutomation #Transformer #AIInfrastructure
原始資料 TechCrunch AI · 收集於 2026-09-18
摘要原文
ChatGPT broke Diogo Almeida’s heart. Almeida was an OpenAI researcher who helped build the chatbot and then invent reinforcement learning from human feedback (RLHF), the model-training technique perhaps most responsible for our current age of AI. But despite its capabilities, he was disappointed. “We have lightning in a bottle, and yet it is not useful,” Almeida told TechCrunch. “I’ve been battling that problem since then. It took me a while to come to the conclusion: the problem is we are optimizing for human language … We have been super good at human language for four years, but it’s not useful for automation because computers speak a different language.” Two years ago, Almeida left OpenAI to start TypeSafe AI , a startup trying to fix that problem. This week, the company released a new transformer-based model, Jev , that is not a large language model (LLM). It doesn’t output text, but instead produces probabilities, or what the company calls “calibrated decisions.” Eschewing language does a few things: It makes the model incredibly cheap and fast, and because users define the outputs in advance, it cannot hallucinate. Its output tokens are free, and input tokens are metered by the billion, not the million. A screenshot shows a comparison of Jev and an OpenAI model responding to the same requests. Image Credits: TypeSafe AI / TypeSafe AI Developers are taking a great interest in the product; the company briefly lost the ability to serve users from its API because demand was so high. Jev appears most useful for software automation. Thus far, software developers see it as a cheaper and more robust way to incorporate intelligence into their code. For example, Pranit Sharma, a software engineer at Vercel, a company making agentic infrastructure, said his company had used OpenAI’s ChatGPT Luna 5.6 to run a classifier to review commands for safety. When Vercel replaced OpenAI’s Luna with Jev, it got results 5 to 18 times more quickly and with greater accuracy. Another developer, Bryo AI CTO Nikhil Mudholkar, tested Jev against Gemini for classifying business emails. In his test, Gemini was slightly more accurate, but 10 to 20 times more expensive. More interesting to Mudholkar were Jev’s confidence scores — “it is the only one that hands back a real probability which makes it ideal for automating workflows!!” Besides replacing LLMs in certain use cases, the new model can also augment them, acting as a smart check on misbehavior. Using agents to monitor agents can quickly become expensive, but using Jev to do so, Almeida argues, makes sense. He sees users deploying Jev to track LLM agent traces and prevent jailbreaks. “At the end of the day, it delegates the hallucination problem a little bit to the user,” explained Armin Ronacher, the CTO of Earendil, which builds the open-source model harness Pi. “The user has to say, okay, if this only comes back with 50% probability, maybe this is a coin toss, and I disregard it. But if it’s 95%, sure, then I can do something with it.” Another potential use for Jev is model routing, Ronacher said. Predicting whether a given workload requires a specific model would be useful, but using an LLM for the job would be expensive. Jev’s low cost and speed make that kind of real-time sorting possible. And that’s Almeida’s hope. The model is named after William Stanley Jevons, the 19th-century economist whose eponymous paradox describes how the falling cost of a commodity can lead to it being used more and more. In this case, the falling cost of intelligence should lead to its widespread deployment. “We think that there’s just going to be smart software all over the place in a way that’s emergent and distributed … much more like the early internet than you know like the the mega apps that people are trying to build right now,” Almeida said. Almeida is tight-lipped about the model’s architecture, which outside observers suspect is built on top of an open-weight LLM. The company refers to Jev as a “System One model,” focused on intuition rather than reasoning, and specifically focused on the right task. Almeida says Jev is trained exclusively on synthetic data using a technique he calls “reinforcement learning from calibrated decisions.” “We made an early bet that we will be making all of our data, and that has been one of the best bets I’ve ever made in my life—better than our launch, in my opinion, better than RLHF,” he told TechCrunch. “Half of [our company] is a lab that basically owns this entire subfield of statistically well-understood synthetic data, and that is now my life joy.” For now, Jev stands alone as this kind of model, but Ronacher expects that competitors will spring up now that its utility is apparent. “We should have seen this earlier in many ways, but presumably because the LLMs are so cheap and subsidized, you often don’t have to be creative yet,” he said. TypeSafe itself will be building more versions of the model, in new modalities. Asked if TypeSafe is a frontier lab, Almeida said, “the main product of Frontier Labs is fear or hype. I would like our main product to be intelligence…[but we are] not a lab in the sense of, you know, like bet on infinite wealth, or a religion, or building God in a data center, or whatever is the thing of today.”
由 claude-code/sonnet 自動生成