Riffusion

Riffing on Diffusion: Generating Audio Clips from Text with Spectrograms

Stable Diffusion is an open-source AI model that can generate images from text. Riffusion tweaked the model to make it able to create images called spectrograms, and then turn those into audio clips. Spectrograms are like pictures that show what different frequencies sound like at different times. They also made an interactive web app so anyone can type in a prompt to generate an audio clip, and then the app will make a smooth transition between different prompts or different seeds of the same prompt.

Generate Audio Clips

Stable Diffusion models generate music with realistic and natural sounding dynamics.

Create Musical Diffusions

Create unique soundscapes with Musical Diffusionsexplore a range of sonic textures and atmospheres to add depth to your music.