yl4579/StyleTTS2
StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
Combines latent diffusion for style generation with pre-trained speech language models (WavLM) as adversarial discriminators, enabling reference-free style synthesis and differentiable duration modeling for end-to-end training. Provides pre-trained components including multilingual text aligners, pitch extractors, and PL-BERT models, supporting single and multi-speaker training on datasets like LJSpeech, VCTK, and LibriTTS with zero-shot speaker adaptation capabilities. Built on PyTorch with configuration-driven training pipelines and Hugging Face integration for inference.
6,205 stars. No commits in the last 6 months.
Stars
6,205
Forks
662
Language
Python
License
MIT
Category
Last pushed
Aug 10, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/yl4579/StyleTTS2"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.