Live Music Models
Online Supplement
Magenta RT Interactive Demos (Colab)
Abstract
We introduce a new class of generative models for music called live music models that produce a continuous stream of music in real-time with synchronized user control. We release Magenta RealTime, an open-weights live music model that can be steered using text or audio prompts to control acoustic style. On automatic metrics of music quality, Magenta RealTime outperforms other open-weights music generation models, despite using fewer parameters and offering first-of-its-kind live generation capabilities. We also release Lyria RealTime, an API-based model with extended controls, offering access to our most powerful model with wide prompt coverage. These models demonstrate a new paradigm for AI-assisted music creation that emphasizes human-in-the-loop interaction for live music performance.
Magenta RT - Prompt Transitions
These samples demonstrate the model's ability to create smooth transitions between different musical ideas.
Accordion to Ambient
Baroque to West Coast Hip Hop
Blues Rock to Balalaika Ensemble
Blues Rock to Glitch Hop
Bongos to Lute
Bongos to Viola Ensemble
Didgeridoo to Charango
Erhu to Mandolin
Fuzz Guitar to Trance
Psychedelic to Moombahton
Sarod to Funk Drums
Zither to Dreamy
Magenta RT - Fixed prompts (Song Describer Dataset)
These samples are generated by using a fixed text prompt
Groovy and Funky
"Groovy funky song with an intimate touch, perfect for a small self contained dance"
Upbeat Latin/Salsa
"An upbeat song with a latin or salsa feel"
Classic 70s Pop-Rock
"A classic pop-rock straight out of the 70s, with a very straightforward 4/4 drum beat, a very interesting instrumentation and a natural development that leads to the chorus. The very-low register bass piano notes are a very subtle, yet quite interesting feature of this song. It is a very cheerful, promising tune that would help me get up and be ready to roll for my day."
Experimental Trance
"Trance experimental electronic track with a weird sounding vocal sampled lead, hollow drums and a 8-bit sounding beat."
Slow Piano Ambiance
"A rather slow piano track creating a quiet and relaxed ambiance"
Upbeat Blues Rock
"Upbeat fast tempo with a blues rock feel that one can dance"