Realtime interactive generative models FTW!

Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM!

* Live Jamming with audio input 🎤🎸🎵
* Personalize your own models 🔧
* Tech report 📜

Links below in the 🧵...

We’ve released The Infinite Crate, a plugin to play with Lyria RealTime directly in the DAW (or as a standalone app)! Super happy to see this out in the world and have real-time generation better integrated with music production tools 🎶

Download here: g.co/magenta/infinite-crate

And finally, the Magenta project has a long history of contributing to the open-source community and I am very proud to be part of a team that continues to put artists, researchers and all-round creative experimentation at the forefront.

And better yet, it opens the way to accessible on-device generation and customisation (more on this in the coming weeks!), two aspects that are crucial to music making with AI models.

I’m particularly excited about this as it’s the only open model that enables streaming audio generation with real-time controls creating what feels like a genuinely new paradigm that is both fun and musically inspiring

More technical details to come in a paper soon, but in the meantime you can jump right into it: t.co/bFkJiDAYVl

We’ve just released Magenta RealTime, an open-weights live music model that lets you craft sounds in real time by exploring the latent space through text and audio!

🤗 Model: huggingface.co/google/magen...
🧑‍💻Code: github.com/magenta/mage...
📝Blog post: magenta.withgoogle.com/magenta-real...

We are hiring on the Generative Media team in London: boards.greenhouse.io/deepmind/job...

We work on Imagen, Veo, Lyria and all that good stuff. Come work with us! If you're interested, apply before Feb 28.

Thanks for this! Would love to be added too :)

Submissions are open for the IJCNN Special Track on "Human-AI Interaction in Creative Arts and Sciences". If you're a researcher or artist working on how AI intersects with human creativity and scientific inquiry, consider submitting a paper or demo: 2025.ijcnn.org/authors/spec...