DDSP-SVC

What DDSP-SVC is

DDSP-SVC is a free, open-source project for real-time singing voice conversion on a personal computer. It runs locally on Windows with Python dependencies and pretrained model assets. Its GUI handles real-time conversion using sliding windows, cross-fading, SOLA-based splicing and contextual semantic reference. For offline work, its command-line interface converts an input WAV file to an output WAV file, with pitch-shift and speaker options. The project also documents preparing audio datasets and training models with a rectified-flow script, including multi-speaker setups using a speaker count and speaker-numbered folders. Setup instructions support ContentVec or HubertSoft encoders, an NSF-HiFiGAN vocoder and the RMVPE pitch extractor; PyTorch is recommended, and TensorBoard can show training status and generated test audio. Dataset guidance suggests about 1,000 training clips and about 10 validation clips, each at least two seconds long. The author asks users to work only with legally obtained, authorized data and avoid illegal use of models or generated audio.

Who it suits

It suits people seeking a locally run singing voice conversion tool, including users who want to train single- or multi-speaker models. Users should be prepared to install Python dependencies and pretrained model assets.

Limits

The free plan is personal-computer software that requires local Python dependencies and pretrained model assets. Dataset guidance recommends about 1,000 training clips and about 10 validation clips, each at least two seconds long.

Getting started

1. Open the project website on GitHub.
2. Use a Windows computer for the documented self-hosted setup.
3. Install the local Python dependencies and pretrained model assets.
4. Choose an encoder and configure the vocoder and pitch extractor.
5. Run the local conversion GUI or use the command-line interface for WAV conversion.

Verdict

DDSP-SVC combines real-time conversion with offline WAV processing and model training. Its local setup and dataset requirements are important considerations before getting started.