overview
What is Riffusion?
Riffusion is a AI music generation tool developed by Seth Forsgren and Hayk Martiros that enables users to create full-length songs from text prompts. It visualizes music as spectrograms, which are then converted into audio, allowing for the generation of instrumental and vocal ideas, loops, and soundtrack sketches. The platform offers options for stem downloads and remixing, providing users with control over individual elements. It supports experimental sound generation and direct manipulation of audio components, facilitating a workflow focused on creative control. Riffusion operates by leveraging a fine-tuned Stable Diffusion model to create spectrogram images—visual representations of audio frequencies over time—which are then converted into playable audio clips.
