I created an interactive digital avatar of myself — and you can talk to it
https://techcrunch.com/2026/09/26/i-created-an-interactive-digital-avatar-of-myself-and-you-can-talk-to-it/📌 記者打造自己的AI分身:拆解互動虛擬人的技術串接
TL;DR:TechCrunch 記者體驗 Synthesia 打造的個人互動分身,揭露語音、語言、影像模型如何串成一套對話系統。
一位公關人員在會議上問記者是否介意收到 AI 生成的新聞稿。第二天,這位記者就見到了公關人員自己的 AI 互動分身,能回答關於公司業務的常見問題。她形容這是「AI 用在公關上的終極形態」,而接下來,她自己也成為了下一個實驗對象。
🤔 一家估值 40 億美元的虛擬人公司
Synthesia 是一家以影片生成起家的虛擬人新創公司,同類競爭者包括 D-ID、HeyGen 與 Colossyan。今年初它的估值來到 40 億美元,去年營收(ARR)已突破 1 億美元。Synthesia 讓企業用 AI 虛擬人製作訓練影片,也推出了名為 Roleplay Sessions 的產品,讓員工可以與互動式 AI 虛擬人練習銷售話術,並由系統給出評分。
🧩 一段兩分鐘錄音,換來一個會對話的分身
記者受邀在 Synthesia 紐約新辦公室內的小型攝影棚拍攝多張照片,並錄製兩分鐘的語音樣本,簽署同意書後,團隊花了幾天時間為她打造出四種版本的分身:兩種是「一般版」(只會朗讀給定的腳本,分別戴眼鏡與不戴眼鏡),另外兩種是「互動版」(能聽、能回答,同樣分兩個版本)。
互動分身背後的技術流程可以拆解成四步:
- 語音轉文字模型,將使用者說的話轉成文字。
- 具備代理能力的語言模型,理解文字內容並判斷該採取的回應或行動。
- 文字轉語音模型,把回應轉成語音。
- Synthesia 自研的影像模型,讓虛擬人隨著語音同步做出對嘴與動作。
Synthesia 表示,語音與影像模型可以替換成自家以外的選項,例如 Cartesia、ElevenLabs、Google 或 OpenAI 的模型,企業客戶也能選擇自建雲端主機,或付費交由 Synthesia 代管。整套產品線分為三類:一般的影片製作與發佈平臺、Roleplay Sessions 這類互動代理平臺,以及讓客戶自行串接影像與語音模型的 API 平臺。
📊 「決定性」的分身:只回答訓練過的內容
這次記者的互動分身被限定只訓練回答她所寫的一篇關於創投背景的新創公司詐欺率報導,屬於「決定性(deterministic)」型態,也就是只會針對訓練範圍內的內容作答。記者的父母試圖詢問「只有他們知道」的私人問題,模型都沒有回應,而是反覆導回那篇報導;她的母親則稱這個分身「amazing」。
⚠️ 聲音相似度普通,且無法臨場發揮
記者身邊的非科技圈朋友認為互動分身的聲音不太像她本人,相似度不如朗讀腳本的一般版分身。由於是決定性系統,這個分身永遠不會臨場說出訓練範圍外的新內容——記者形容自己看著分身說完話後陷入沉默,彷彿在等它眨眼、微笑,或做出某種「知道自己是誰」的回應,但那從未發生。她也提到,如果換成非決定性、由聊天機器人自由生成回應的版本,使用者反而更容易陷入某種「AI 心理依附」的狀態。
🎯 對工程師的實務啟示
這個案例展示了一種務實的產品設計選擇:把互動代理限定在單一資料來源、單一決定性回答範圍內,能有效避免模型「亂講話」的風險,特別適合客服、公關問答、企業培訓等需要可控輸出的場景。如果你正在設計企業級對話代理,「限定領域+決定性回應」可能比追求開放式生成更適合正式對外場合。
🔗 來源
- 標題:I created an interactive digital avatar of myself — and you can talk to it
- 作者/機構:Dominic-Madori Davis, TechCrunch AI
- 連結:https://techcrunch.com/2026/09/26/i-created-an-interactive-digital-avatar-of-myself-and-you-can-talk-to-it/
#DigitalAvatar #Synthesia #AIAgent #VoiceAI #TextToSpeech #VideoGeneration #ConversationalAI #EnterpriseAI #DigitalTwin #AIinPR
原始資料 TechCrunch AI · 收集於 2026-09-26
摘要原文
When Alexandru Voica, head of corporate affairs at the video-generation startup Synthesia, sent me a link this summer to the newest addition to their PR team, I was surprised. It was an interactive virtual avatar of him, trained to answer common press questions about Synthesia, like what it does and how it works. The day before, I was on a panel where PR people asked me if I minded pitches that used AI-generated text. But Alexandru’s avatar was beyond that — this seemed to me the final boss of using AI in PR. In September, Synthesia invited me to its new office space in New York. Originally based in the U.K., Synthesia is a hot digital avatar startup alongside others like D-ID, HeyGen, and Colossyan. It hit a $4 billion valuation earlier this year and said last year it had crossed $100 million in ARR . Synthesia lets enterprises build interactive training videos with AI avatars and recently launched a product called Roleplay Sessions that lets employees practice, for example, sales pitches with an interactive AI avatar that responds and scores their responses. When I went to the new office opening and they asked me if I would like my own AI avatar, I didn’t even hesitate to say yes. Of course I would like my own digital twin. My outfit was cute that day, and my hair was in place. Until I met my digital twin, I had been indifferent toward avatars, but I felt they would inevitably become part of everyday online life. I heard of people on Instagram creating them in their likenesses to help them make social content. I find it all to be very interesting, and it’s perhaps why I have no qualms now presenting to you my digital twin. This is the first time Synethsia has made a digital avatar for a journalist (or for anyone, period, outside of Voica). It is trained on my story about why venture-backed startups commit more fraud than non-VC-backed startups and will only answer questions about that story. Below, simply press “start in a new window” to begin. You can ask it questions like: Why did I decide to write this story? What is the research paper about? What did the researchers find? To make this, I entered a mini film studio nestled inside Synthesia’s office where they took numerous photos of me and captured a two-minute recording of my voice. I had to consent to these avatars being made and, well, digital Dom was born. They created a personal avatar for me (one that just reads whatever script I give it) — with and without glasses — and they made two interactive avatars for me (ones that can talk back and listen to me), also with and without glasses. We picked an article to train the interactive avatar on, and then one of the teams built my interactive avatar , which is powered by a combination of voice-to-text, video, language, and text-to-voice models. My avatar’s tech stack includes Synthesia’s own video and voice models, although the company also allows customers to choose alternatives from other labs like Cartesia, ElevenLabs, Google, or OpenAI. Enterprises can also choose to host their avatars on whatever cloud they want or pay Synthesia to host them. The voice-to-text model turns what people say into text, the agentic language model makes sense of text and can take actions based on it, the text-to-voice model turns a response into audio, and finally a video model (built by Synthesia) animates the avatar as it talks. Overall, Synthesia builds three types of products — a video-creation and distribution platform with classic avatars, where someone types in a script and the avatar repeats it; an agentic platform called Sessions where people can interact with the avatars in surveys or roleplay; and an API platform where people can take Synthesia video and voice models and combine them with other tech services to build interactive avatars or other types of products. It took the Synthesia team a couple of days to make my avatars. I played first with the personal ones and typed a fairly generic script to see how my AI voice sounded. I had it talk about how fall has arrived in New York, my favorite time of year. The voice was fairly accurate, and I was glad it didn’t pick up any of the hoarseness I had when I recorded my audio sample. I showed it to some non-tech friends who found it both interesting and creepy. Then I showed them my interactive one, which is deterministic, meaning it will only say what it was trained to respond to. In this case, that was my venture fraud story. I asked it questions like where I was before TechCrunch and what part of New York I lived in, but each time it directed me back to the story. My friends didn’t think the voice sounded much like mine and thought the likeness was not as good as the personal avatar, but nonetheless it was close enough to be somewhat creepy. My mom called it “amazing,” which is pretty high praise from her. She and my father kept trying to ask it questions “only they would know” about me — but the model didn’t answer, redirecting them each time to the venture fraud story. “I don’t remember giving birth to two of you,” she joked after testing the model. This experience has made me think about what the future of journalism could be. Would people be OK with turning on the news and it being presented by an avatar? One investor told me no immediately. Certainly there is a lot of pushback today on AI slop that has infiltrated social media and other news-sharing platforms. But others I asked weren’t so sure. Could avatars augment — or even replace — journalists? Would CEOs want to talk to an AI avatar of a journalist rather than a human one? What I like about my career is connecting with people, writing stories, and researching new topics. But the biggest part of journalism is trust. That doesn’t seem like it could ever be outsourced to an AI. Outside of journalism, I’m confident the idea of cloning yourself could be appealing. No more catching up on work after a holiday or vacation, because a version of you can always be around, answering questions. We’ll have to see how avatar usage evolves in corporate America. But now that I have my own, I have mixed feelings. After I got over the initial novelty of it, I examined my avatar closely after it stopped talking and waited — for what, I’m not sure. Maybe I’m waiting for it to blink. Or to say something new, or to smile, or to just let me know that it knows. Because my digital twins are deterministic, they will never do that. But I can see how easy it would be for someone to fall into a tinge of AI psychosis with one that was nondeterministic, meaning powered by a chatbot that was free to pontificate. I told one investor that, whatever the future of digital twins is, I predict that my generation, Gen Z, likely won’t get used to them. They feel sci-fi: Everything we’ve ever seen in a movie is here now. But I will say, I find digital avatars less jarring than humanoids . At least with an avatar, if stuff gets weird, I can always log off. Until then, however, here is my personal avatar, giving you a rundown of all the top stories on our site this week!
由 claude-code/sonnet 自動生成