NeuralNote

What NeuralNote is

NeuralNote is an audio plugin for transcribing audio to MIDI in a digital audio workstation. Its MuScriptor model can process full mixes and group notes by instrument. A built-in multi-instrument synth has per-instrument gain, mute, and solo controls. You can record audio in the plugin or load WAV, AIFF, FLAC, MP3, or OGG Vorbis files, then drag the resulting MIDI to a MIDI track or save it as a MIDI file.

The project describes NeuralNote as a VST3, AU, and standalone AudioFX plugin. Transcription runs on the user's CPU or GPU, and audio stays on the user's machine; the plugin goes online to download models and check for updates. MuScriptor models come in small, medium, and large sizes, trading speed for quality. Downloads are about 210 MB, 620 MB, and 2.7 GB respectively, and a GPU is recommended for medium and large models. Installers are listed for Apple Silicon macOS and x64 Windows. Linux prebuilt binaries are described as coming soon, with source builds available meanwhile. NeuralNote's code is Apache-2.0, but MuScriptor weights use CC BY-NC 4.0 and may only be used non-commercially. The repository credits NeuralNote v2 as developed by Damien Ronssin with AI assistance.

Who it suits

NeuralNote suits musicians and audio producers who want to turn recorded or loaded audio into MIDI for a digital audio workstation, including full mixes with notes grouped by instrument. It is also a fit for users who can work with its listed plugin formats or source-build on Linux and whose intended use of MuScriptor weights is non-commercial.

Limits

The MuScriptor weights are for non-commercial use. Model downloads are about 210 MB for small, 620 MB for medium, and 2.7 GB for large; a GPU is recommended for medium and large models. Linux prebuilt binaries are described as coming soon, with source builds available meanwhile.

Getting started

1. Visit https://github.com/DamRsn/NeuralNote.
2. Choose the free open-source project.
3. On Apple Silicon macOS or x64 Windows, use the listed installer; on Linux, build from source.
4. Select a small, medium, or large MuScriptor model and download it.
5. Record audio or load a supported file, then drag MIDI to a track or save it.

Verdict

Choose NeuralNote if you want local audio-to-MIDI transcription with instrument-grouped notes and a built-in synth. Look elsewhere if you need commercial use of MuScriptor weights or a Linux prebuilt installer.