R3gm/SoniTranslate
Synchronized Translation for Videos. Video dubbing
Extracts audio from videos using speaker diarization (Pyannote), translates transcribed content across 100+ languages, and synthesizes new audio with voice cloning to match original speaker characteristics. Built on Gradio for the web interface, it integrates Hugging Face models for speech recognition and generation, with GPU acceleration via CUDA for real-time processing. Deployable locally, on Google Colab, or via Hugging Face Spaces for browser-based video dubbing without manual subtitle editing.
1,341 stars.
Stars
1,341
Forks
320
Language
Python
License
Apache-2.0
Category
Last pushed
Dec 02, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/voice-ai/R3gm/SoniTranslate"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
jianchang512/pyvideotrans
Translate the video from one language to another and embed dubbing & subtitles.
ThioJoe/Auto-Synced-Translated-Dubs
Automatically translates the text of a video based on a subtitle file, and then uses AI voice...
krillinai/KrillinAI
Video translation and dubbing tool powered by LLMs. The video translator offers 100 language...
AI4Bharat/Chitralekha
Chitralekha - A video transcreation platform for Indic languages, supporting transcription,...
juntaosun/ComeCut
「来剪」轻量级视频编辑器。网页版、桌面版等均可免费使用，功能灵感源自 CapCut 等编辑器。A Lightweight Video Editor. Free for the web,...