Gemini 3.5 Transcribe vs OpenAI’s GPT-Transcribe
https://www.kdnuggets.com/gemini-3-5-transcribe-vs-openais-gpt-transcribe📌 Gemini 3.5 Transcribe 對決 GPT-Transcribe:分工不同的兩套語音辨識
TL;DR:Google 與 OpenAI 相隔四週推出新一代語音轉錄模型,一個主打內建分辨語者,一個主打便宜與低延遲。
語音轉錄模型很少像這次一樣,能做到真正對等的比較:Google 在 2026 年 8 月 26 日推出 Gemini 3.5 Transcribe,而 OpenAI 的 GPT-Transcribe 才剛在四週前、7 月 28 日發布。兩家不約而同都把產品拆成「即時串流」與「預錄音檔」兩種模型,這讓比較變得罕見地公平。
🤔 同時間點推出,才讓比較有意義
一般比較新舊模型世代的意義有限,但這次兩個實驗室幾乎同步推出新一代轉錄模型,才讓這篇比較真正成立。
🧩 兩套模型,兩種取捨
Gemini 3.5 Transcribe 取代了 Google 先前的 Chirp 3,Google 主打的賣點是速度:相較 Chirp 3,time-to-final-transcription 提升了 70%,準確率也同步提升。它拆成兩個獨立的 model ID:透過 Live API 提供次秒級延遲的 gemini-3.5-transcribe-live,以及透過 Interactions API 處理會議、通話紀錄等預錄音檔的 gemini-3.5-transcribe。根據 Artificial Analysis 的測量、並由 Google 官方引用的數字,串流情境的 WER(word error rate)為 4.0%,非串流情境為 2.6%;在更難的 FLEURS 多語言基準上,則分別是 5.50% 與 5.04%。預錄音檔模型還內建多語者辨識(reliably 支援到三位語者,更多語者則屬實驗性功能)與逐字時間戳記,無需額外模型,並支援超過 85 種語言與自訂詞彙辨識,還能透過 function calling 把後續任務(如圖片生成、檔案分析)轉交給其他 Gemini 模型。
GPT-Transcribe 則是 OpenAI 這條產品線的最新一棒——從 Whisper,到 2025 年 3 月首個真正建構在 GPT-4o 架構上的 gpt-4o-transcribe,再到現在的 GPT-Transcribe。OpenAI 現在建議用它取代 whisper-1、gpt-4o-transcribe 與 gpt-4o-mini-transcribe,作為轉錄原始語言錄音的首選。它同樣拆出一個串流版本 gpt-live-transcribe,供持續、低延遲的連線使用。在 OpenAI 自家於 Common Voice 22 種語言上的發布基準中,GPT-Transcribe 的 WER 大約是 whisper-1 的一半(從 40.37% 降到 19.27%),單位成本也比前代便宜 25%,定價為每分鐘檔案轉錄 0.0045 美元、每分鐘串流語音 0.017 美元。它支援關鍵字與多語言提示,協助辨識領域術語與語言切換,並會回報偵測到的語言。但誠實地說,原生 GPT-Transcribe 不支援語者分離(diarization)與逐字時間戳記,這兩項功能仍得依賴額外的 gpt-4o-transcribe-diarize 模型,或退回舊版 whisper-1。
以下是兩篇文章各自給出的最小範例。用 Gemini 3.5 Transcribe 處理三人會議錄音,搭配自然語言指令即可直接取得語者標籤與時間戳記:
from google import genai
client = genai.Client(api_key="YOUR_GOOGLE_API_KEY")
with open("meeting_recording.mp3", "rb") as f:
audio_bytes = f.read()
response = client.models.generate_content(
model="gemini-3.5-transcribe",
contents=[
{"text": "Transcribe this meeting with speaker labels and timestamps."},
{"inline_data": {"mime_type": "audio/mp3", "data": audio_bytes}},
],
)
print(response.text)
而 GPT-Transcribe 則適合即時字幕這類延遲敏感的場景,透過持久化的 WebSocket 連線,邊收音邊以 delta 事件回傳部分轉錄文字:
async with websockets.connect(uri, extra_headers=headers) as ws:
await ws.send(json.dumps({
"type": "transcription_session.update",
"session": {"input_audio_transcription": {"model": "gpt-live-transcribe"}},
}))
for chunk in audio_chunks:
await ws.send(json.dumps({
"type": "input_audio_buffer.append",
"audio": chunk,
}))
📊 關鍵數字並排看
| 項目 | Gemini 3.5 Transcribe | GPT-Transcribe |
|---|---|---|
| 發布日期 | 2026/8/26 | 2026/7/28 |
| 前代模型 | Chirp 3 | gpt-4o-transcribe |
| 串流模型 | gemini-3.5-transcribe-live | gpt-live-transcribe |
| 預錄音檔模型 | gemini-3.5-transcribe | gpt-transcribe |
| 詞錯率 | 4.0%(串流)/2.6%(非串流) | 約 19.27%(Common Voice,前代為 40.37%) |
| 語言支援 | 85 種以上 | 22 種以上有基準測試,支援關鍵字與語言提示 |
| 內建語者分離 | 有,可靠支援至 3 位語者 | 無,需另外的 gpt-4o-transcribe-diarize |
| 逐字時間戳記 | 內建 | 無,需 whisper-1 |
| 串流定價 | 尚未公布每分鐘價格 | 每分鐘 0.017 美元 |
| 檔案定價 | 尚未公布每分鐘價格 | 每分鐘 0.0045 美元 |
💡 選哪一個,取決於你有沒有多語者需求
一旦場景涉及會議紀錄、通話紀錄這類多語者音檔,Gemini 3.5 Transcribe 內建的語者分離與時間戳記能省下額外呼叫一個獨立模型的步驟;而如果任務單純是單一語者轉錄或即時字幕,不需要語者標籤,GPT-Transcribe 憑藉更低的價格與更輕量的整合方式更有優勢。
⚠️ 價格資訊不對等
目前 Gemini 3.5 Transcribe 尚未公布每分鐘的具體定價,這讓兩者在成本面的直接比較還無法完全對齊。
🎯 實務啟示
在選型前,先釐清你的應用是否真的需要語者分離與時間戳記——如果需要,Gemini 3.5 Transcribe 能省下一個額外模型呼叫的工程複雜度;如果只是單純轉錄或即時字幕,GPT-Transcribe 的定價與 WebSocket 串流介面可能是更精簡的選擇。
🔗 來源
- 標題:Gemini 3.5 Transcribe vs OpenAI’s GPT-Transcribe
- 作者/機構:Shittu Olumide, KDnuggets
- 連結:https://www.kdnuggets.com/gemini-3-5-transcribe-vs-openais-gpt-transcribe
#SpeechRecognition #Gemini #OpenAI #SpeechToText #AudioAI #LLM #MachineLearning #VoiceAI #APIComparison #DeveloperTools
原始資料 KDnuggets · 收集於 2026-09-28
摘要原文
Gemini 3.5 Transcribe vs OpenAI’s GPT-Transcribe Here's how each got to where it is, a real use case and working code for both, and a side-by-side on the numbers that actually matter. By Shittu Olumide , Technical Content Specialist on September 28, 2026 in Language Models Google shipped Gemini 3.5 Transcribe on August 26, 2026, and the timing makes it a genuinely useful comparison. OpenAI had released its own current flagship transcription model, GPT-Transcribe , just four weeks earlier, on July 28, 2026. Two labs, two new transcription models, released close enough together that comparing them actually means something right now instead of stacking one model generation against another. Both companies split their offering the same way too — one model built for real-time streaming, one built for pre-recorded audio — which makes the comparison unusually apples-to-apples. Here's how each got to where it is, a real use case and working code for both, and a side-by-side on the numbers that actually matter. Gemini 3.5 Transcribe Gemini 3.5 Transcribe replaces Chirp 3, Google's previous transcription model, and the improvement Google is leaning on hardest is speed: a 70% improvement in time-to-final-transcription over Chirp 3, alongside better accuracy. It ships as two distinct model IDs rather than one general-purpose endpoint: gemini-3.5-transcribe-live for continuous, sub-second-latency streaming through the Live API, and gemini-3.5-transcribe for pre-recorded audio, meetings, call logs, and similar, through the Interactions API. The real numbers, as measured by Artificial Analysis and cited directly in Google's announcement: a 4.0% word error rate (WER) for streaming use and 2.6% for non-streaming. On the FLEURS multilingual benchmark specifically, Google reports 5.50% WER streaming and 5.04% non-streaming — worth noting as a separate, harder benchmark rather than mixing the two numbers together. Beyond raw accuracy, the pre-recorded model includes built-in multi-speaker attribution (reliably up to three speakers, with more listed as experimental) and word-level timestamps out of the box, no separate model needed. It also supports over 85 languages, recognizes custom vocabulary, and can delegate follow-up tasks like image generation or file analysis to other Gemini models via function calling, currently live in the Gemini app on macOS. OpenAI's GPT-Transcribe Whisper was OpenAI's original open transcription model, superseded by gpt-4o-transcribe in March 2025, OpenAI's first transcription model actually built on the GPT-4o architecture rather than Whisper's older approach. GPT-Transcribe, released July 28, 2026, is the next step in that same line, and OpenAI now recommends it ahead of whisper-1, gpt-4o-transcribe, and gpt-4o-mini-transcribe for transcribing recorded speech in its original language. Like Gemini, it splits into a streaming sibling, gpt-live-transcribe , for continuous, low-latency sessions. The numbers: on OpenAI's own launch benchmark against Common Voice across 22 languages, GPT-Transcribe roughly halves whisper-1's word error rate, from 40.37% down to 19.27%, while costing 25% less per minute than its predecessor. Pricing lands at \$0.0045 per minute for file transcription and \$0.017 per minute of session audio for the streaming variant. It accepts keyword hints and multiple language hints to help with domain-specific terms and code-switching, and reports which languages it detected in the audio. The honest gap worth naming directly: plain GPT-Transcribe doesn't do speaker diarization or word-level timestamps — those still require the separate gpt-4o-transcribe-diarize model or, for timestamps specifically, the older whisper-1. Let's take a quick look at some use cases. Using Gemini 3.5 Transcribe for a Multi-Speaker Meeting Consider a real scenario where the built-in diarization actually earns its keep: transcribing a recorded three-person meeting and getting back who said what, not just a wall of undifferentiated text. from google import genai client = genai.Client(api_key="YOUR_GOOGLE_API_KEY") with open("meeting_recording.mp3", "rb") as f: audio_bytes = f.read() response = client.models.generate_content( model="gemini-3.5-transcribe", contents=[ {"text": "Transcribe this meeting with speaker labels and timestamps."}, {"inline_data": {"mime_type": "audio/mp3", "data": audio_bytes}}, ], ) print(response.text) The request sends the raw audio bytes alongside a plain-language instruction, since gemini-3.5-transcribe is built specifically to produce speaker-attributed, timestamped output without needing a separate diarization step or model. For a real meeting, that means the returned transcript already distinguishes Speaker 1 , Speaker 2 , and Speaker 3 with timestamps attached — output a post-call analytics pipeline could consume directly. Using GPT-Transcribe for Live Captioning Here's a scenario suited to streaming: real-time captions for a live event, where latency matters more than diarization. import asyncio import websockets import json async def stream_captions(audio_chunks): uri = "wss://api.openai.com/v1/realtime?intent=transcription" headers = {"Authorization": "Bearer YOUR_OPENAI_API_KEY"} async with websockets.connect(uri, extra_headers=headers) as ws: await ws.send(json.dumps({ "type": "transcription_session.update", "session": {"input_audio_transcription": {"model": "gpt-live-transcribe"}}, })) for chunk in audio_chunks: await ws.send(json.dumps({ "type": "input_audio_buffer.append", "audio": chunk, })) message = await ws.recv() event = json.loads(message) if event.get("type") == "conversation.item.input_audio_transcription.delta": print(event["delta"], end="", flush=True) This opens a persistent WebSocket connection rather than sending one request per audio clip, which is the whole point of a streaming model. Partial transcription text arrives as delta events while the speaker is still talking, not after the recording ends. Each audio chunk gets appended to an ongoing buffer, and gpt-live-transcribe returns incremental text as it becomes confident enough to commit — exactly the behavior a live-captioning display needs to stay in sync with the speaker. Comparison Table # Gemini 3.5 Transcribe OpenAI GPT-Transcribe Release date August 26, 2026 July 28, 2026 Predecessor Chirp 3 gpt-4o-transcribe Streaming model gemini-3.5-transcribe-live gpt-live-transcribe File/pre-recorded model gemini-3.5-transcribe gpt-transcribe Word error rate 4.0% streaming / 2.6% non-streaming (Artificial Analysis) ~19.27% on Common Voice, down from whisper-1's 40.37% Language support 85+ languages Keyword and language hints across 22+ benchmarked languages Built-in speaker diarization Yes, up to 3 speakers reliably No, requires separate gpt-4o-transcribe-diarize Word-level timestamps Yes, built in No, requires whisper-1 Streaming pricing Not published per-minute as of this writing \$0.017 per minute of session audio File pricing Not published per-minute as of this writing \$0.0045 per minute Wrapping Up Gemini 3.5 Transcribe's built-in diarization and timestamps make it the stronger pick the moment your use case is a meeting, a call log, or anything with multiple speakers you need told apart — that capability alone saves an entire second model call OpenAI's stack still requires. GPT-Transcribe earns its place on the other end: a cheaper, faster-to-integrate option when the job is straightforward single-speaker transcription or live captioning, and you don't need attribution at all. Shittu Olumide is a software engineer and technical writer passionate about leveraging cutting-edge technologies to craft compelling narratives, with a keen eye for detail and a knack for simplifying complex concepts. You can also find Shittu on Twitter . <= Previous post
由 claude-code/sonnet 自動生成