โญ +144 today Python

jamiepine/voicebox

๐Ÿ”— https://github.com/jamiepine/voicebox โ†—

Voicebox The open-source AI voice studio. Clone any voice. Generate speech. Dictate into any app. Talk to agents in voices you own. The full voice I/O stack, running locally on your machine. voicebox.sh โ€ข Docs โ€ข Download โ€ข Features โ€ข API โ€ข Troubleshooting Click the image above to watch the demo video on voicebox.sh Built with Capy Voicebox is built and maintained with Capy . A Capy Captain thread directs the project day to day, and its crew threads test, rebase, and review each contributor pull request on Linux and on a Mac Studio before Jamie merges it. Voicebox stays free and open source under the MIT license, with no splash screens, banners, or interruptions in the app. Try Capy โ†’ ยท How Voicebox is built What is Voicebox? Voicebox is a local-first AI voice studio โ€” a free and open-source alternative to ElevenLabs and WisprFlow in one app. Clone voices from a few seconds of audio, generate speech in 23 languages across 8 TTS engines, dictate into any text field with a global hotkey, and give any MCP-aware AI agent a voice of your choosing. The two cloud incumbents sit on opposite halves of the voice I/O loop โ€” ElevenLabs on output, WisprFlow on input. Voicebox does both, bridges them with a bundled local LLM for refinement and per-profile personas, and runs the whole thing on your machine. Complete privacy โ€” models, voice data, and captures never leave your machine 8 TTS engines โ€” Qwen3-TTS, Qwen CustomVoice, Qwen VoiceDesign, LuxTTS, Chatterbox Multilingual, Chatterbox Turbo, HumeAI TADA, and Kokoro Voice cloning and preset voices โ€” zero-shot cloning from a reference sample, or 50+ curated preset voices via Kokoro and Qwen CustomVoice 23 languages โ€” from English to Arabic, Japanese, Hindi, Swahili, and more Post-processing effects โ€” pitch shift, reverb, delay, chorus, compression, and filters Expressive speech โ€” paralinguistic tags like [laugh] , [sigh] , [gasp] via Chatterbox Turbo; natural-language delivery control via Qwen CustomVoice; voices described in plain language via Qwen VoiceDesign Unlimited length โ€” auto-chunking with crossfade for scripts, articles, and chapters Stories editor โ€” multi-track timeline for conversations, podcasts, and narratives Voice input โ€” global dictation hotkey with push-to-talk and toggle modes, accessibility-verified auto-paste on macOS, in-app mic on every text field, Whisper-based STT Agent voice output โ€” one tool call ( voicebox_speak ) and any MCP-aware agent (Claude Code, Cursor, Cline) speaks to you in a voice you've cloned Voice personalities โ€” attach a free-form persona to any voice profile, then Compose, Rewrite, or Respond via a bundled local LLM โ€” agents can invoke the same modes over MCP API-first โ€” REST API plus a built-in MCP server for integrating voice I/O into your own apps and agents Native performance โ€” built with Tauri (Rust), not Electron Runs everywhere โ€” macOS (MLX/Metal), Windows (CUDA), Linux, AMD ROCm, Intel Arc, Docker Download Platform Download macOS (Apple Silicon) Download DMG macOS (Intel) Download DMG Windows Download MSI Docker docker compose up View all binaries โ†’ Linux โ€” Pre-built binaries are not yet available. See voicebox.sh/linux-install for build-from-source instructions. Having trouble? See the Troubleshooting Guide for common install, generation, model-download, and GPU issues. Features Multi-Engine Voice Cloning Eight TTS engines with different strengths, switchable per-generation: Engine Languages Strengths Qwen3-TTS (0.6B / 1.7B) 10 High-quality multilingual cloning, delivery instructions ("speak slowly", "whisper") Qwen CustomVoice 10 9 curated preset voices with natural-language delivery control โ€” no reference audio required Qwen VoiceDesign 10 Builds a voice from a written description โ€” no reference audio or preset needed LuxTTS English Lightweight (~1GB VRAM), 48kHz output, 150x realtime on CPU Chatterbox Multilingual 23 Broadest language coverage โ€” Arabic, Danish, Finnish, Greek, Hebrew, Hindi, Malay, Norwegian, Polish, Swahili, Swedish, Turkish and more Chatterbox Turbo English Fast 350M model with paralinguistic emotion/sound tags TADA (1B / 3B) 10 HumeAI speech-language model โ€” 700s+ coherent audio, text-acoustic dual alignment Kokoro 8 50 curated preset voices, tiny 82M model, fast CPU inference Emotions & Paralinguistic Tags Only Chatterbox Turbo interprets paralinguistic tags like [laugh] and [sigh] . Qwen3-TTS, LuxTTS, Chatterbox Multilingual, and HumeAI TADA read them literally as text. With Chatterbox Turbo selected, type / in the text input to open the tag inserter and add expressive tags inline with speech: Sounds: [laugh] [chuckle] [gasp] [cough] [sigh] [groan] [sniff] [shush] [clear throat] Delivery: [angry] [crying] [dramatic] [fear] [happy] [narration] [sarcastic] [surprised] [whispering] [advertisement] Post-Processing Effects 8 audio effects powered by Spotify's pedalboard library. Apply after generation, preview in real time, build reusable presets. Effect Description Pitch Shift Up or down by up to 12 semitones Reverb Configurable room size, damping, wet/dry mix Delay Echo with adjustable time, feedback, and mix Chorus / Flanger Modulated delay for metallic or lush textures Compressor Dynamic range compression Gain Volume adjustment (-40 to +40 dB) High-Pass Filter Remove low frequencies Low-Pass Filter Remove high frequencies Ships with 4 built-in presets (Robotic, Radio, Echo Chamber, Deep Voice) and supports custom presets. Effects can be assigned per-profile as defaults. Unlimited Generation Length Text is automatically split at sentence boundaries and each chunk is generated independently, then crossfaded together. Works with all engines. Configurable auto-chunking limit (100โ€“5,000 chars) Crossfade slider (0โ€“200ms) for smooth transitions Max text length: 50,000 characters Smart splitting respects abbreviations, CJK punctuation, and [tags] Generation Versions Every generation supports multiple versions with provenance tracking: Original โ€” clean TTS output, always preserved Effects versions โ€” apply different effects chains from any source version Takes โ€” regenerate with a new seed for variation Source tracking โ€” each version records its lineage Favorites โ€” star generations for quick access Async Generation Queue Generation is non-blocking. Submit and immediately start typing the next one. Serial execution queue prevents GPU contention Real-time SSE status streaming Failed generations can be retried Stale generations from crashes auto-recover on startup Voice Profile Management Create profiles from audio files or record directly in-app Import/export profiles to share or back up Multi-sample support for higher quality cloning Per-profile default effects chains Organize with descriptions and language tags Stories Editor Multi-voice timeline editor for conversations, podcasts, and narratives. Multi-track composition with drag-and-drop Inline audio trimming and splitting Auto-playback with synchronized playhead Version pinning per track clip Global Dictation & Voice Input The other half of the voice I/O loop. Hold a hotkey anywhere on your system, speak, release โ€” on macOS the transcript pastes straight into the focused text field. Or hit the mic on any Voicebox text input and dictate directly into the app. Configurable chord bindings โ€” hold-to-speak and tap-to-toggle chords, each rebindable in the in-app chord picker.

ๅ…งๅฎน็‚บๆ”ถ้›†็•ถๆ—ฅๆŠ“ๅ–็š„ repo ๆ่ฟฐๅŽŸๆ–‡๏ผŒๅฎŒๆ•ด่ณ‡่จŠ่ซ‹่ฆ‹ GitHub ๅŽŸ้ ใ€‚