palashdeb/omnivoice-studio

https://github.com/debpalash/OmniVoice-Studio/issues

[!WARNING] OmniVoice Studio is in active beta. Things may break between releases. For the latest features and fixes, clone the repo and run from source rather than using pre-built installers. Bug reports and PRs are very welcome — https://github.com/debpalash/OmniVoice-Studio/issues or join ***.

Features

Quickstart

Per-OS install guides — pick yours and follow it end-to-end:

• macOS — docs/install/macos.md
• Windows — docs/install/windows.md
• Linux — docs/install/linux.md
• Docker — docs/install/docker.md

Stuck? Run the built-in self-check first — Settings → About → "Run self-check" in the app, or uv run python backend/main.py --diagnose from a checkout (--deep also test-loads the active engine). Then see docs/install/troubleshooting.md for the top 10 install errors. The in-app error UI deeplinks to those entries when something breaks at runtime, and Settings → About → "Save diagnostic bundle" packages scrubbed logs + the self-check report for bug reports.

For Hugging Face token setup, see docs/setup/huggingface-token.md. For diarization-specific gating, see docs/features/diarization.md.

Screenshots

  <br/><b>Voice Clone</b><br/>
  <sub>Drop a 3-second clip → mirror any voice. 646 languages, zero-shot.</sub>
</td>
<td align="center" width="50%">
  
  <br/><b>Voice Design</b><br/>
  <sub>Build new voices from scratch — gender, age, accent, pitch, style.</sub>
</td>

  <br/><b>Video Dub***g</b><br/>
  <sub>Upload or paste a *** URL. Transcribe, translate, re-voice, export.</sub>
</td>
<td align="center">
  
  <br/><b>Voice Gallery</b><br/>
  <sub>Search ***, browse categories, download clips, build your library.</sub>
</td>

  <br/><b>Settings → Models</b><br/>
  <sub>15 models. One-click install. Auto-detects your platform (CUDA / MPS / CPU).</sub>
</td>
<td align="center">
  
  <br/><b>Projects</b><br/>
  <sub>Dub projects, voice profiles, generation history, exports — all searchable.</sub>
</td>

  <br/><b>Settings → Logs</b><br/>
  <sub>Live backend, frontend, and Tauri runtime logs. Filter, refresh, clear.</sub>
</td>

Why OmniVoice Studio?

ElevenLabs charges $5–$330/mo and processes your audio on their servers. OmniVoice Studio runs on your hardware, with no usage limits.

OmniVoice Studio gives you professional-grade AI tools without the subscription or the cloud.

System Requirements

[!TIP] On GPUs with ≤8 GB VRAM, OmniVoice automatically offloads TTS to CPU during transcription — no config needed. A dedicated GPU is not required; the entire pipeline runs on CPU (just slower).

TTS Engines

OmniVoice ships a multi-engine TTS backend. The default engine (OmniVoice) is always available; additional engines are opt-in and auto-detected. Switch engines in Settings → TTS Engine or via the OMNIVOICE_TTS_BACKEND env var.

CUDA = GPU-accelerated · MPS = Apple Silicon Metal · CPU = runs everywhere, slower for large models · KittenTTS and MOSS-TTS-Nano run realtime on CPU · MLX-Audio is Apple Silicon only.

ASR Engines

OmniVoice ships a multi-engine ASR (speech-to-text) backend that powers dictation, video dub***g, and subtitle generation — all fully local. ***X is the cross-platform default; the rest are opt-in and auto-detected. Switch in Settings → ASR Engine or via the OMNIVOICE_ASR_BACKEND env var.

***-family engines cover ~100 languages; FunASR / SenseVoice adds an all-in-one multilingual path with built-in voice-activity detection and inline speaker diarization. Every engine runs on-device — no API keys, no cloud.

Architecture

┌─────────────────────────────────────────────────┐
│                  Frontend (React)                │
│  DubTab · VoicePreview · BatchQueue · Gallery    │
├─────────────────────────────────────────────────┤
│                Backend (FastAPI)                  │
│  97 API endpoints · SSE streaming · SQLite       │
├──────────┬──────────┬──────────┬────────────────┤
│ WhisperX │  Demucs  │OmniVoice │   Pyannote     │
│   ASR    │  Source  │   TTS    │  Diarization   │
│          │  Sep.    │          │                │
└──────────┴──────────┴──────────┴────────────────┘
        CUDA / MPS / ROCm / CPU (auto-detected)

Roadmap

✅ Shipped

🔜 Up Next

• 🎬 Lip-sync v2 — visual speech timing with wav2lip
• 📖 Audiobook Editor — chapter-aware long-form narration
• 🌐 Hosted Demo — try OmniVoice without installing anything
• 🔌 Plugin Marketplace — community-contributed TTS engines and effects

Community

**→ Join the ***** — we respond to setup questions within hours, not days.

Contributing

We welcome contributions of all kinds — bug fixes, new TTS engine ***s, UI improvements, docs, and translations.

• 📖 Read the Contributing Guide for setup, code style, and PR workflow
• 🐛 Browse https://github.com/debpalash/OmniVoice-Studio/labels/good%20first%20issue
• 💬 Join our *** to discuss ideas or ask for help

FAQ

License

OmniVoice Studio is free and open-source software under the https://www.gnu.org/licenses/agpl-3.0.html.

Free for any use — including commercial and internal business use. Run it, sell the audio you produce with it, dub your own or clients' videos, roll it out across your team — all free, no license needed. As a network copyleft license, AGPL adds one obligation: if you modify OmniVoice Studio and offer that modified version to others over a network, you must make the complete corresponding source of your modified version available to them under the same AGPL-3.0 terms.

A commercial license is available for organizations that want to embed OmniVoice Studio in a closed-source or proprietary product or service without the AGPL-3.0 copyleft obligations. Pricing tiers coming soon. Inquiries: *******.

The bundled omnivoice/ TTS model by Han Zhu remains Apache-2.0 upstream. See LICENSE for the full, ***ding terms.

Acknowledgments

OmniVoice Studio is built on the shoulders of exceptional open-source work:

</picture>