MarkTechPost ★ 105 6 min

Liquid AI Releases Open-Weight d1-3B and d1-omni-600M: Multimodal Decision Models With Zero Output Tokens

Agentic AIAI InfrastructureDecision ModelsFor DevsLanguage ModelLarge Language ModelMachine LearningOpen Source

🔗 https://www.marktechpost.com/2026/10/07/liquid-ai-releases-open-weight-d1-3b-and-d1-omni-600m-multimodal-decision-models-with-zero-output-tokens/

📌 Liquid AI 開源 d1-3B / d1-omni-600M:一次 forward pass,零輸出 token 的決策模型

TL;DR:不寫文字、只吐機率的多模態決策模型,開源權重、支援 llama.cpp,主打 NVIDIA 全端即時推論。

一般的 LLM 要給你一個答案,得一個 token、一個 token 地把它寫出來,你的程式再負責解析。Liquid AI 的 d1 系列反過來做:讀一次輸入,直接回傳每個允許答案的機率,輸出 token 數是零。

🤔 決策不需要生成文字,只需要校準過的機率

Liquid AI 這次開源兩個模型:d1-3B 讀文字與圖片,d1-omni-600M 讀文字搭配圖片、或文字搭配音訊。兩者都不寫文字,而是針對一組「state」與一批「named questions」,讀一次就回傳每個允許答案的機率。一次呼叫裡可以讓多個問題共用同一個 state,每次回應都會標示 output_tokens: 0。Liquid AI 把這類模型定義為三種問題類型,並建議用於路由、內容審核、意圖分類、reranking、LLM-as-a-judge 評分、agent guardrail 與視覺檢測等場景,強調這不是聊天模型。

🧩 從既有 LFM2.5 模型權重平均與多次微調合併而來

d1-3B 共 3.12B 參數,起點是 decoder-only 的 vision-language 模型 LFM2.5-VL-3B。Liquid AI 先將 LFM2.5-2.6B 與該模型的文字骨幹做權重平均,再用不同 seed 與資料組合微調出多個 checkpoint,最後再合併一次。視覺端採用 400M 參數的 SigLIP2 NaFlex encoder,context 長度 32,768 token。README 特別提到,長輸入、打亂答案選項順序、修正資料捷徑(data shortcuts),比起用更進階的技巧更關鍵。

d1-omni-600M 共 587M 參數,起點是雙向編碼器 LFM2.5-Encoder-350M,由 381M 的共享主幹與決策頭、94M 視覺編碼器、112M 音訊編碼器組成,音訊編碼器是 17 層的 FastConformer。context 長度 16,384 token,音訊片段上限 30 秒,且一次請求只能帶圖片或音訊、不能同時帶兩者;音訊訓練資料僅涵蓋英語的 speaker-to-assistant 場景。

怎麼用:兩個 checkpoint 都在 Hugging Face 上,透過 Transformers 載入,並有第一天的 llama.cpp 支援。授權是 LFM Open License v1.0,年營收低於 1,000 萬美元可免費商用。d1-3B 需要 transformers>=5.14 並開啟 trust_remote_code=True,d1-omni-600M 需要 transformers>=5.15。兩者都提供 system_one(state, questions) 處理單一 state,以及 system_one_batch 處理打包請求的介面。README 建議 d1-omni-600M 在 GPU 上使用 float16,因為 bfloat16 會改變部分最高機率的答案。

📊 Decision Index 上,d1-3B 擠進所有 10B 以下模型之首

在 Decision Index v0.2.1 上,d1-3B 拿到 48.57 分,打敗所有 10B 以下的模型,也小幅領先 Decider 35B-A3B 的 47.11 分,只有 Winnow-12B 以 50.02 分更高。d1-3B 在 Tools 類別拿下 74.5 分、Arts 類別 36.3 分,但在 Knowledge 類別只有 23.8 分,相對弱勢。Liquid AI 說明這些分數是自行跑官方 scorer 所得,並非正式排行榜提交。

在七個公開文字 benchmark 上,d1-3B 平均 82.9 分,高於 Decider 4B 的 81.1 分;d1-omni-600M 平均 78.4 分,其中 Civil Comments 拿下 95.8 分、PAWS-X 拿下 79.5 分,均為該批比較中的最高分。在 11 個影像 benchmark 上,d1-3B 平均 74.1 分,比起其底層模型的 73.9 分略有提升。音訊方面,Liquid AI 直接稱決策類音訊 benchmark 仍是一個尚待解決的問題。

延遲方面,一個問題在 RTX 4090 上耗時 8 ms(使用 model.compile(mode=“reduce-overhead”),未開啟則為 16 ms),在 AMD MI325X 上 9 ms。Jetson 系列中,AGX Thor 為 16 ms、AGX Orin 為 26 ms、Orin Nano 為 50 ms;在 AGX Thor 上,對同一個 state 問三個問題只需 20 ms,相較單一問題的 16 ms 幾乎沒有額外負擔。

⚠️ 仍有明確的邊界

d1-omni-600M 目前沒有公開延遲數據,屬於較早期的研究性釋出;音訊訓練資料侵限於英語的 speaker-to-assistant 情境;一次請求無法同時帶圖片與音訊;GPU 上若用 bfloat16 而非 float16,部分答案的機率排序會改變。這些都代表它離「通用多模態決策引擎」還有一段距離,目前更適合定義明確、答案空間有限的任務。

🎯 對工程師的意義

如果你的系統裡本來就有「分類」「打分」「路由」這類只需要一個機率分佈、不需要生成文字的子任務,用傳統 LLM 加上 prompt 解析往往是殺雞用牛刀,還多了 token 生成的延遲與不穩定性。d1 這種零輸出 token、一次 forward pass 回傳校準機率的設計,如果延遲與分數數字能在自己的場景裡重現,對 guardrail、審核、agent 路由這類高頻、低延遲需求的子系統會是值得評估的選項。

🔗 來源

#LiquidAI #DecisionModels #OpenWeight #MultimodalAI #EdgeAI #NVIDIAJetson #LLMAlternatives #AIGuardrails #ModelRouting #MachineLearning

原始資料 MarkTechPost · 收集於 2026-10-07
來源原標題
Liquid AI Releases Open-Weight d1-3B and d1-omni-600M: Multimodal Decision Models With Zero Output Tokens
作者
Asif Razzaq
原始標籤
Agentic AI · AI Infrastructure · AI Shorts · Applications · Artificial Intelligence · Decision Models · Editors Pick · For Devs · Language Model · Large Language Model · Machine Learning · New Releases · Open Source · Staff · Tech News · Technology
原始連結
https://www.marktechpost.com/2026/10/07/liquid-ai-releases-open-weight-d1-3b-and-d1-omni-600m-multimodal-decision-models-with-zero-output-tokens/

摘要原文

Liquid AI has released Open d1 , two open-weight multimodal models in its d1 decision model family. d1-3B reads text and images. d1-omni-600M reads text with an image, or text with audio. Neither model writes text. Each returns calibrated, typed answers in one forward pass with zero output tokens. The target is real-time decisions on the NVIDIA stack: DGX servers, RTX workstations, and Jetson edge boards. Is it deployable? Yes. Both checkpoints are on Hugging Face, load through Transformers, and have day-one llama.cpp support. The LFM Open License v1.0 allows free commercial use below $10 million in annual revenue. d1-omni-600M is an early research release with no published latency figures. A generative LLM writes its answer token by token, and your code parses it. A decision model takes a state and a set of named questions. It reads them once and returns a probability for every allowed answer. The Liquid AI define three question types: Several questions can share one state in a single call. Every response reports output_tokens: 0 . Liquid AI recommends d1 for routing, moderation, intent classification, reranking, LLM-as-a-judge scoring, agent guardrails, and visual inspection. Neither checkpoint is a chat model. d1-3B has 3.12B parameters and starts from LFM2.5-VL-3B , a decoder-only vision-language model. Liquid AI averaged the weights of LFM2.5-2.6B with that model’s text backbone. It then fine-tuned several checkpoints with different seeds and data mixtures, and merged them again. It uses a 400M SigLIP2 NaFlex vision encoder and a 32,768-token context. Long inputs, shuffled answer options, and fixing data shortcuts mattered more than advanced techniques. d1-omni-600M has 587M parameters and starts from LFM2.5-Encoder-350M , a bidirectional encoder. That covers a 381M shared trunk and decision head, a 94M vision encoder, and a 112M audio encoder. The audio encoder is a 17-layer FastConformer. Context is 16,384 tokens. Audio clips are capped at 30 seconds. A request carries images or audio, never both. Audio training covered English speaker-to-assistant requests only. On Decision Index v0.2.1 , d1-3B scores 48.57. That beats every model under 10B and edges Decider 35B-A3B (47.11). Only Winnow-12B scores higher at 50.02. Liquid AI ran the official scorer itself, so d1 scores are not leaderboard submissions. d1-3B leads the Tools (74.5) and Arts (36.3) categories but trails on Knowledge (23.8). Across seven public text benchmarks, d1-3B averages 82.9, ahead of Decider 4B at 81.1. d1-omni-600M averages 78.4 and posts the top Civil Comments (95.8) and PAWS-X (79.5) scores. On 11 image benchmarks, d1-3B averages 74.1 against 73.9 for its base model. Liquid AI calls audio decision benchmarks an open problem. Liquid AI measured end-to-end latency, one warm request at a time. One question takes 8 ms on an RTX 4090 and 9 ms on an AMD MI325X. On Jetson, AGX Thor takes 16 ms, AGX Orin takes 26 ms, and Orin Nano takes 50 ms. On Jetson AGX Thor, three questions over one state take 20 ms versus 16 ms for one. The RTX 4090 figure uses model.compile(mode="reduce-overhead") . Without it, one question takes 16 ms. NVIDIA’s Jetson AI Lab also hosts d1-3B guides. Sources: d1-3B , d1-omni-600M , Decider 4B , Decider 35B-A3B , Winnow-12B model cards. Index scores as listed on the d1 cards. Latencies use different hardware and workloads, so they are not directly comparable. d1-3B needs transformers>=5.14 and trust_remote_code=True . d1-omni-600M needs transformers>=5.15 . Both expose system_one(state, questions) for one state and system_one_batch for packed requests. Liquid AI recommends float16 for d1-omni-600M on GPU, since bfloat16 changed some top answers. You can try ten camera-driven d1-3B demos in the Open d1 Arcade space. With NVIDIA, Liquid AI also showed d1-3B navigating Isaac Sim from a Jetson. Check out the d1-3B , d1-omni-600M and Technical details . All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter . Wait! are you on telegram? now you can join us on telegram as well. [Sponsored] The web is the one API most agents are missing. Databases, calendars and repos have APIs. The open web mostly doesn’t. The TinyFish MCP server gives any MCP client four tools: TinySearch, TinyFetch (full pages as markdown, JavaScript included), TinyBrowser for logins and forms, and TinyAgent for multi-step jobs. Search and Fetch are free. The post Liquid AI Releases Open-Weight d1-3B and d1-omni-600M: Multimodal Decision Models With Zero Output Tokens appeared first on MarkTechPost .

由 claude-code/sonnet 自動生成