Google DeepMind Google DeepMind ★ 119 5 min

Gemini 3.8 text-to-speech says hello

🔗 https://deepmind.google/blog/say-hello-to-gemini-38-text-to-speech/

📌 【Google DeepMind】Gemini 3.8 新 TTS 模型,逐行導演 AI 語音演出

TL;DR:Gemini 3.8 推出兩款新 TTS 模型,讓開發者能用自然語言打造客製化角色聲音並逐行導演臺詞情緒。

如果一個 AI 不只能唸稿,還能被你「說戲」,要求它在第三句嘆氣、第七句壓低聲音、句尾加一句自然的「嗯」,那語音生成離真正的配音演出還有多遠?Google DeepMind 今天用 Gemini 3.8 給出了答案。

🤔 背景:從固定語音庫到動態創作工具

Google 在 Gemini 家族中推出兩款新的文字轉語音模型:Gemini 3.8 Flash TTS 與 Gemini 3.8 Flash-Lite TTS。團隊將此定位為把語音生成「從靜態預設聲音,轉變為動態的創作工作室」,目標是讓創作者、開發者與企業打造更豐富、更具表現力的音訊體驗,同時強化 Gemini Notebook、Google Vids 等產品的使用體驗。兩款模型已可在 Google AI Studio、Gemini API、Gemini Enterprise、Gemini Notebook 與 Google Vids 中使用,並延續先前 3.5 Live Translate、3.5 Transcribe、3.8 Live、3.8 Live Extended Thinking 等 Gemini Audio 產品線。

🧩 兩款模型的分工:創意導演 vs 大規模量產

Gemini 3.8 Flash TTS 主打深度創意導演與角色設計,可用自然語言 prompt 從零打造全新聲音,應用在遊戲、沉浸式有聲書、Podcast 與互動媒體上,並能逐行控制表演細節,包括表演指示、節奏、口音轉換與應答式插話(backchanneling)。Gemini 3.8 Flash-Lite TTS 則針對高流量、需要成本效益的場景最佳化,適合大量配音、音訊內容製作與具表現力的語音 agent,同樣能細緻控制語氣、節奏與情緒層次。

聲音打造方面,開發者可用自然語言 prompt 跨越 100 多種語言與方言,從零設計聲音的角色、口音與特質,官方舉例包括墨爾本 DJ 的高能量聲線、單調的機器人聲,以及日本龍的聲音演出。語音庫也擴充到超過 2,000 個可直接上線使用的聲音,涵蓋墨西哥西班牙語、魁北克法語、蘇格蘭英語等地區變體。語音複製功能能透過 30 秒的音訊樣本重現一致的聲音特徵,並內建同意驗證機制:必須提供與參考聲音相符的口頭同意錄音才能建立複製聲音。官方也預告即將推出「語音混音」功能,讓使用者從既有語音庫挑選聲音後微調音色、音高、節奏與口音。

導演臺詞方面,開發者可自行撰寫舞臺指示,或讓 Gemini 依自然的劇本線索掌控表演節奏,例如冷靜的客服語氣或耳語式的懸疑場景。長篇生成能在數小時的連續音訊中維持穩定的音質、節奏與角色音色,適合 Podcast 與有聲書;原生雙人對話場景則能從單一劇本同時導演兩個角色的對話,保持聲音區隔與自然的輪流節奏。此外還支援腳本化的擬真聲效與應答插話,例如 、、 等非語言標記,以及 |mhm|、|yeah| 等主動聆聽用語,用於掌握喜劇節奏與反應點。

📊 數據:Hume AI 基準測試中的表現

官方公布的評測數據顯示,Gemini 3.8 Flash TTS 在 Hume AI 的 Voice Design Benchmark 中拿下整體第一(71.4 分),並在口音建模項目中同樣領先(60.8 分)。在 Hume AI 的 Overall Quality Index 中,Flash TTS 與 Flash-Lite TTS 分別拿下第一與第二名。相較於前代 Gemini 3.1 Flash TTS,兩款新模型在長篇內容生成與雙人劇本對話控制上有明顯進步。在 Voice Arena 的盲測人類偏好評比中,兩款模型在日語、巴西葡萄牙語、越南語、現代標準阿拉伯語、墨西哥西班牙語與印地語等多國語言中都取得領先地位。

⚠️ 限制與信任機制

語音生成能力越強,被濫用來假冒他人聲音的風險也越高。Google 在語音複製功能中加入同意驗證機制作為防線,並為所有 Gemini Audio 模型生成的音訊加上 SynthID 浮水印,這是一種嵌入音訊訊號中的不可感知標記,用來協助偵測 AI 生成內容以防範不實資訊。語音複製也附帶 C2PA 內容憑證,用來保護開發者與聲音提供者的權益。

🎯 實務啟示

這次更新的重點不只是「聲音更逼真」,而是把語音生成從單一段落的合成,變成可逐行導演、可長篇維持一致性的創作工具。如果產品需要角色化的語音 agent 或大量配音場景,值得評估 Flash-Lite 的成本效益;若需要精緻的角色演出與情緒控制,Flash TTS 的逐行導演能力可能是更合適的起點。

🔗 來源

#Gemini #TextToSpeech #GoogleDeepMind #VoiceAI #GenerativeAI #VoiceCloning #SynthID #ConversationalAI #AIStudio #AIAudio

原始資料 Google DeepMind · 收集於 2026-09-23
來源原標題
Gemini 3.8 text-to-speech says hello
機構
Google DeepMind
原始連結
https://deepmind.google/blog/say-hello-to-gemini-38-text-to-speech/

摘要原文

Gemini 3.8 text-to-speech says hello Sep 23, 2026 | Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS are our most expressive audio generation models yet. Generate custom character voices and direct scene dialogue across Google AI Studio, Gemini API, Gemini Enterprise, Gemini Notebook, and Google Vids. Leland Rechis Group Product Manager Alan Cowen Director, Research Science, on Behalf of the Gemini Audio Team Read AI-generated summary Check out "Gemini 3.8 text-to-speech says hello" to see how our new models work. Create custom voices from scratch or replicate existing ones with simple natural language prompts. Direct your audio line-by-line to control pacing, emotion, and even realistic conversational sounds. Use these models for high-quality audiobooks, podcasts, or real-time voice agents at scale. We’ve included built-in safety tools like watermarking to keep your generated audio secure. Summaries were generated by Google AI. Generative AI is experimental. Google just launched new AI tools that let you create and customize realistic voices from scratch. You can direct these voices to sound exactly how you want, from their accent to their emotional tone. It’s perfect for making audiobooks, games, or podcasts that sound like real people talking. Plus, they added safety features to make sure these voices are used responsibly. Summaries were generated by Google AI. Generative AI is experimental. Explore other styles: Bullet points Basic explainer Today, we’re introducing two new text-to-speech models to the Gemini family, transforming voice generation from static presets into a dynamic creative studio. These models enable creators, developers, and enterprises to create richer, more expressive audio experiences, while enabling improved user experiences in products like Gemini Notebook and Google Vids . Gemini 3.8 Flash TTS: Built for deep creative direction and character design. Create entirely new voices from scratch using natural language prompts to bring characters to life across gaming, immersive audiobooks, podcasts, and interactive media. Direct every performance line by line with granular control over acting cues, pacing, dialect shifts, and backchanneling. Gemini 3.8 Flash-Lite TTS: Built for high-volume, cost-efficient scale. Optimized for high-volume dubbing, audio content creation, and expressive voice agents with fine-grained control over tone, pacing, and expressive nuance. These models complement our fast-growing Gemini Audio family, following 3.5 Live Translate , 3.5 Transcribe , 3.8 Live, and 3.8 Live Extended Thinking . Create and customize your own voices Scale up from 30 original voices to an infinite library. Whether you need an entirely original character voice or a consistent brand ambassador, our 3.8 Flash TTS model powers a full vocal studio. This enables you to create and use expressive, natural-sounding voices for every moment, while empowering developers and enterprises to easily build custom audio experiences. Generative voice design: With Gemini 3.8 Flash TTS, create bespoke voices from scratch by customizing role, accent and voice characteristics across more than 100 languages and dialects using natural language prompting — whether you're bringing a dramatic, fire-breathing dragon to life or crafting a charismatic narrator with a distinct regional cadence. Hear how Gemini 3.8 Flash TTS generates a high-energy DJ voice from Melbourne. Hear how Gemini 3.8 Flash TTS generates a super-tinny, monotone robot voice. Hear how Gemini 3.8 Flash TTS brings a Japanese dragon to life. Expansive voice library: Access 2,000+ production-ready voices with broad language coverage — including regional varieties like Mexican Spanish, Quebec French, and Scots English. Voice replication: Recreate consistent vocal profiles from just a 30-second audio sample of your voice or a voice you have the rights to use, backed by built-in consent verification, SynthID watermarking, and C2PA credentials to protect both developers and their vocal talent. Save and scale: Save and manage the custom voices you designed to ensure consistent performance and minimal drift across ongoing projects. Voice remixing: Coming soon, pick a voice from our voice library and fine-tune timbre, pitch, pace, and accent. Use prompts to dial in characteristics (e.g. “add subtle Southern US accent” or “soften the delivery”). Direct the performance, line by line Once you've selected your voices, both TTS models give you precise control over how each line is delivered. Direct performance line by line: Write your own stage directions or let Gemini steer delivery with natural script cues — from a calm customer service agent to a whispered suspense scene. Hear how Gemini 3.8 Flash TTS enables natural, highly expressive conversations for interactive voice agents. Watch and hear how Gemini 3.8 Flash TTS uses granular script control to build a deeply engaging, immersive audio experience. Long-form generation: Maintain high voice quality, natural pacing, and character timbre across hours of continuous audio with minimal speaker drift — ideal for podcasts and audiobooks. Native two-speaker scene staging: Direct multi-turn conversations seamlessly from a single script —whether for a podcast or dramatic storytelling—while keeping both voices distinctly separated with natural conversational turn-taking. Scripted vocal bursts & backchanneling: Add realistic conversational texture using non verbal cues (like <laughs>, <sigh>, <gasp> and active-listening interjections (like |mhm| or|yeah|) for precise comedic timing and reaction beats. See how Gemini 3.8 Flash TTS turns natural language prompts into bespoke vocal personas from scratch. Watch how Gemini 3.8 Flash TTS enables creators to design custom scenes to bring animated dialogue to life. See how Gemini 3.8 Flash TTS turns scripts into fully performed dialogue scenes, letting creators direct vocal delivery, and natural turn-taking. Get expressive high-quality speech generation built for global scale Gemini 3.8 Flash TTS delivers leading voice customization capabilities, securing the #1 overall spot on Hume AI’s Voice Design Benchmark (71.4) and also leading in accent modeling (60.8). Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS enable truly expressive performances without sacrificing reliability, also securing the #1 and #2 spots respectively on Hume AI’s Overall Quality Index. The model shows major improvements on a wide range of use cases such as long-form content and dual-speaker screenplay control compared to Gemini 3.1 Flash TTS. In blind human preference evaluations on Voice Arena , Gemini 3.8 Flash and Flash-Lite TTS secure top positions amongst competitors in key global languages, including Japanese, Brazilian Portuguese, Vietnamese, Modern Standard Arabic (MSA), Mexican Spanish and Hindi. With support for over 100 languages, these models empower creators, developers, and enterprises to build high-quality, multilingual voice experiences worldwide. Build with trust, consent, and transparency We built our voice creation and replication capabilities with strict safeguards to help protect voice talent, respect identity, and ensure content transparency. For voice replication our system leverages consent verification: users must provide a verbal consent recording from the voice owner that matches the reference speaker before a voice can be created. More broadly, every audio clip generated by our Gemini Audio models is watermarked with SynthID . This imperceptible watermark is woven directly into the audio output, ensuring AI-generated speech remains detectable to help prevent misinformation. For more details on our approach to safety and responsibility, review the model card . Try our new Google AI Studio audio playground Starting today, developers can experience these new speech generation capabilities in Google AI Studio .

由 claude-code/sonnet 自動生成