UtaForge AI

Free plan MacWindows

What UtaForge AI is

UtaForge AI is a free, open-source local tool for creating VOICEVOX singing covers and lyric videos from audio and lyrics. It analyzes a source vocal’s pitch, volume, and lyric timing, then transfers those elements to a VOICEVOX voice. Lyrics can be supplied as text, Markdown, or LRC, with line and mora timing edited on a waveform. The project creates subtitled MP4 videos in vertical 9:16 or widescreen 16:9 formats. Visuals may use PSD-based lip-sync, blinking, facial expressions, or a still image. Exports include audio, video, VOICEVOX .vvproj projects, and UtaFormatix .ufdata files. A browser-based Studio and command-line interface are available. Processing stays on the local computer and does not require external web services. VOICEVOX ENGINE and ffmpeg are required; audio separation can use audio-separator or Demucs. It supports macOS 13 or later and Windows 11 with Python 3.11 or 3.12. The project is alpha and uses the MIT License.

Who it suits

UtaForge AI suits creators making VOICEVOX covers or lyric videos on macOS or Windows. Users should have rights to the music, lyrics, voices, images, characters, and generated works they use.

What it does well

Free and open source
Runs processing locally
Supports text, Markdown, and LRC lyrics
Exports audio, video, and project files
Provides browser Studio and command-line interfaces

What to know first

Project status is alpha
Requires VOICEVOX ENGINE and ffmpeg
Supports macOS 13+ or Windows 11
Output quality and formats may change

Verdict

UtaForge AI provides local tools for transferring vocal performance details to VOICEVOX voices and producing lyric videos. Its alpha status and required companion software are important considerations for setup and ongoing use.

Facts from UtaForge AI's own pages

Audio analysis: It analyzes vocal pitch, volume, and lyric timing and transfers singing characteristics to VOICEVOX output. · github.com, 11 Oct 2026
Data handling: The security policy says inputs, lyrics, images, generated files, and external models are stored on local disk, and advises checking project and cache contents before sharing. · github.com, 4 Oct 2026
Exports: It can export MP3 audio, VOICEVOX .vvproj projects, UtaFormatix .ufdata, and MP4 video. · github.com, 11 Oct 2026
Integrations: The project requires a running VOICEVOX ENGINE and ffmpeg, and supports audio-separator or Demucs for source separation. · github.com, 11 Oct 2026
Intended users: The README asks users to confirm they have rights to the music, lyrics, voices, images, characters, and generated works they use. · github.com, 4 Oct 2026
Interfaces: It provides both a browser-based Studio and a command-line interface. · github.com, 11 Oct 2026
License: The source code is distributed under the MIT License. · github.com, 11 Oct 2026
Local processing: The tool runs locally and does not require external web services. · github.com, 11 Oct 2026
Lyrics: Lyrics can be provided as text, Markdown, or LRC, and timing can be edited over a waveform. · github.com, 4 Oct 2026
Lyrics and editing: Lyrics can be provided as text, Markdown, or LRC, with line and mora timing editable on a waveform. · github.com, 11 Oct 2026
Platforms: The stated operating system requirements are macOS 13 or later and Windows 11; Python 3.11 or 3.12 is also required. · github.com, 11 Oct 2026
Privacy: Inputs, lyrics, artwork, generated files, and external models are stored on local disk; the README says project and work directories are excluded from Git by default. · github.com, 11 Oct 2026
Project status: The project is marked alpha, and its specification, project format, and output quality may change. · github.com, 4 Oct 2026
Project status and limits: The project is alpha, and its specifications, project format, and output quality may change. · github.com, 11 Oct 2026
Purpose: UtaForge AI is an open-source tool that generates VOICEVOX singing covers and lyric videos from audio and lyrics. · github.com, 11 Oct 2026
Requirements: The README lists macOS 13 or later or Windows 11, plus Python 3.11 or 3.12, as requirements. · github.com, 4 Oct 2026
Security reporting: The security policy supports only the latest main branch and asks users to report vulnerabilities through GitHub private vulnerability reporting. · github.com, 11 Oct 2026
Security support: The security policy supports only the latest main branch and directs vulnerability reports through GitHub’s private vulnerability reporting. · github.com, 4 Oct 2026
Video: It can create subtitled MP4 videos in 9:16 or 16:9 formats, with PSD-based lip-sync and facial expressions or a still image. · github.com, 4 Oct 2026
Video features: It can generate subtitled MP4s in vertical 9:16 or widescreen 16:9 formats, with PSD-based lip-sync, blinking, and facial expressions. · github.com, 11 Oct 2026

Where UtaForge AI stands on Freedom251

AI Song Cover Generators#47 of 56