Gemini 3.8 Live and 3.8 Live Extended Thinking
https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-8-live-gemini-3-8-live-extended-thinking/📌 Google發布Gemini 3.8 Live,語音對話模型奪下Speech-to-Speech評測冠軍
TL;DR:Gemini 3.8 Live與Extended Thinking主打即時視覺理解與背景工具呼叫,在多項語音評測拿下第一。
當語音助理還在為「聽懂你在說什麼」而努力時,Google已經把重點轉向另一個問題:AI能不能一邊聽、一邊想、一邊動手做事,而不打斷對話節奏?這就是Gemini 3.8 Live與3.8 Live Extended Thinking想解決的問題。
🤔 讓語音Agent真正能執行複雜任務
Google將這兩款模型定位為「近即時推理」的進化:3.8 Live訴求規模化與成本效益,結合對話智慧、流暢對答與視覺理解(visual grounding);3.8 Live Extended Thinking則訴求高複雜度任務,具備更強的智慧與多步推理能力。兩者的共同目標,是讓開發者與企業能建構可靠、可上生產環境的語音Agent,同時也讓一般使用者在Gemini App、Google Workspace與Search裡的語音互動更流暢、更有協作感。
🧩 邊推理邊說話,背景執行工具呼叫
3.8 Live能近即時處理視覺輸入,為對話補充上下文,並自動偵測、切換97種支援語言。它可以在背景執行工具與API呼叫,模型會先回應請求、持續對話,同時讓任務在背景完成,不需要使用者乾等。
面對需要更深入推理的任務,3.8 Live Extended Thinking採取「邊推理邊說話」的策略:用「讓我確認一下…」這類自然的口語提示先承接使用者的請求,並在多步驟背景任務進行時,用即時進度敘述帶著使用者一起走完整個流程,藉此在維持對話流暢度的同時完成更複雜的工作。
📊 多項語音評測拿下第一
根據Artificial Analysis的Speech to Speech Quality Index,3.8 Live Extended Thinking拿下總分82.6,排名第一;在τ-Voice上的agentic任務完成率達68.6%,在Sierra的τ-Voice-banking基準上為35.1%;在Big Bench Audio上的推理表現則達到97.7%。3.8 Live在Speech Agent Arena中則取得第二名的使用者偏好排名。在ServiceNow的EVA-Bench(用來評估語音Agent的基準)中,Google表示其模型在處理複雜工作流程時,成功在準確度與對話品質之間取得帕雷托最優(Pareto Frontier)的平衡。
💡 開發生態系與企業導入
透過Gemini Live API,Agora、Fishjam、LangChain、LiveKit、Pipecat、Vercel與Vision Agents等開發者平臺,能替開發者處理背後複雜的即時媒體串流基礎設施,讓開發者專注在使用者體驗設計上。Google也提到正與Salesforce、Genspark、Lumeris等公司合作,這些公司對3.8 Live系列的低延遲、流暢度與工具呼叫能力表示認可。此外,所有生成的音訊都以SynthID技術嵌入不可感知的浮水印,用於防止AI生成內容被誤用於製造不實資訊。
🎯 實務啟示
如果你要建構語音Agent,兩款模型分工明確:對話量大、追求成本效益與流暢度的場景適合3.8 Live;牽涉多步驟推理、需要背景任務協調(例如多步驟訂位、非同步函式呼叫)的場景則該用3.8 Live Extended Thinking。兩者都已透過Gemini API與Google AI Studio開放,並可與LiveKit、Pipecat、LangChain等現有語音框架直接整合,降低自建即時串流基礎設施的成本。
🔗 來源
- 標題:Gemini 3.8 Live and 3.8 Live Extended Thinking
- 作者/機構:Tom Ouyang(Principal Engineer)、Malini Jaganathan(Member of Technical Staff),代表Gemini Audio Team
- 連結:https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-8-live-gemini-3-8-live-extended-thinking/
#Gemini #GoogleAI #VoiceAI #ConversationalAI #SpeechToSpeech #AIAgents #LiveAPI #MultimodalAI #VoiceAgents #GenerativeAI
原始資料 Hacker News · 收集於 2026-09-16
摘要原文
Introducing Gemini 3.8 Live and 3.8 Live Extended Thinking Sep 15, 2026 | Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking are our most advanced live dialogue models yet. Major upgrades in intelligence and parallel reasoning make them more intuitive to collaborate with and use to execute complex tasks using your voice. Tom Ouyang Principal Engineer Malini Jaganathan Member of Technical Staff, on behalf of the Gemini Audio Team Your browser does not support the audio element. Listen to article [[duration]] minutes This content is generated by Google AI. Generative AI is experimental Voice Speed Voice Speed 0.75X 1X 1.5X 2X Read AI-generated summary We are launching Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking to make voice interactions more natural, fluid, and intelligent. These models handle complex reasoning, real-time visual context, and background task execution without interrupting your conversation. You can start using these features today through the Gemini API, Google Workspace, and the Gemini app. Summaries were generated by Google AI. Generative AI is experimental. Check out "Introducing Gemini 3.8 Live and 3.8 Live Extended Thinking" for smarter voice AI. Gemini 3.8 Live offers fast, fluid conversations with real-time visual and language support. Use 3.8 Live Extended Thinking to handle complex tasks while keeping the conversation flowing. These models work in the background to manage tools while you keep chatting. You can try these new features in Google Workspace, Search, and the Gemini app. Summaries were generated by Google AI. Generative AI is experimental. Google just launched two new AI models that make talking to your devices feel way more natural. They can handle interruptions, switch between languages, and even explain their thought process while they work. Whether you're solving a complex problem or just chatting, the AI now feels like it's actually listening and thinking along with you. It’s a big step toward making AI feel like a real conversation partner. Summaries were generated by Google AI. Generative AI is experimental. Explore other styles: General summary Bullet points Basic explainer Today, we’re introducing two new models that bring advancements in near real-time reasoning to more effectively enable voice agents and make conversing with AI feel more intuitive and intelligent. Gemini 3.8 Live : Built for scale and cost efficiency, combining conversational intelligence with fluid dialogue and visual grounding. Gemini 3.8 Live Extended Thinking : Built for high-complexity tasks, with increased intelligence and multi-step reasoning. For developers and enterprises, these models deliver the building blocks for reliable, production-ready voice agents. They also make speaking with Gemini across the Gemini app, Google Workspace, and Search more fluid and collaborative — helping you tackle complex tasks using just your voice. Experience more fluid, intelligent conversations Gemini 3.8 Live Extended Thinking provides enterprise-grade task completion and intelligence, capturing the #1 overall spot on Artificial Analysis' Speech to Speech Quality Index (82.6), and leads in agentic task completion with 68.6% on τ -Voice and 35.1% on Sierra’s τ -Voice-banking benchmark. It also provides strong reasoning capabilities, scoring 97.7% on Big Bench Audio, while maintaining a highly competitive price point compared to other frontier models. Gemini 3.8 Live has shown a high preference among users, securing a second place in the Speech Agent Arena . In addition to this performance, it remains highly cost-effective — providing developers and enterprises with a capable and efficient model built for scale. On ServiceNow’s EVA-Bench , a benchmark for evaluating voice agents, our models push the Pareto Frontier for complex workflows by successfully balancing accuracy with conversational quality. Note: This was run on the Live API on Gemini Enterprise Agent Platform. Gemini 3.8 Live processes visual inputs in near real-time, enriching conversations with context for more helpful responses. It automatically detects and transitions between 97 supported languages mid-conversation. It executes tools and API calls in the background while continuing the conversation, so the model can acknowledge requests and keep chatting while tasks finish in the background. Gemini 3.8 Live guides employee onboarding in real time, using visual context to answer live questions. Watch Gemini 3.8 Live play chess in near real-time using visual context, reasoning, and natural conversational flow. For tasks that require deeper reasoning, 3.8 Live Extended Thinking reasons and speaks simultaneously. It delivers increased intelligence for complex workflows while maintaining an uninterrupted conversational flow — using early verbal cues like “Let me check that…” to acknowledge prompts naturally, and live progress narration to walk users through multi-step background tasks as they progress. Watch Gemini 3.8 Live Extended Thinking transform raw sketches and near real-time voice feedback into functional React components. See Gemini 3.8 Live Extended Thinking coordinate multi-step bookings and asynchronous function calls — all without interrupting natural live conversation. Watch Gemini 3.8 Live build complete business plans and custom marketing toolkits on the fly through natural speech. Across Google Workspace and Search, our Live models deliver more intuitive, collaborative experiences — especially when tackling your most complex tasks. Try Gemini 3.8 Live Extended Thinking in Google Workspace with Docs Live, Gmail Live, and Keep Live. Get step-by-step, real-time troubleshooting help powered by Gemini 3.8 Live — right inside Search Live. Empowering the developer and enterprise voice ecosystem By using the Gemini Live API , developer platforms such as Agora , Fishjam , LangChain , LiveKit , Pipecat , Vercel , and Vision Agents enable developers to build and deploy high-performance voice-driven interfaces with ease. These platforms manage complex real-time media streaming infrastructure behind the scenes, allowing developers to focus entirely on crafting the user experience. We’re also partnering with companies like Salesforce, Genspark, and Lumeris who are excited about 3.8 Live and 3.8 Live Extended Thinking, highlighting its impressive latency, fluidity, and tool-calling capabilities. Ensure transparency with SynthID watermarking All audio generated by our AI products is watermarked with SynthID . This imperceptible watermark is woven directly into the audio output, ensuring AI-generated content remains detectable to help prevent misinformation. For details on our approach to safety and responsibility, review the model card . Start using our latest Gemini Audio models: 3.8 Live is rolling out starting today: For developers : In the Gemini API and Google AI Studio For enterprises : In private preview in Gemini Enterprise and coming soon to Gemini Enterprise for Customer Experience For everyone : In Search Live 3.8 Live Extended Thinking is rolling out starting today: For developers : In the Gemini API and Google AI Studio For enterprises : In private preview in Gemini Enterprise and coming soon to Gemini Enterprise for Customer Experience and Google Workspace business customers For everyone : In Gemini Live and for Google AI Pro and Ultra subscribers in Workspace in Docs, and all Google AI subscribers in Gmail and Keep Posted in: (480 points, 318 comments on Hacker News)
由 claude-code/sonnet 自動生成