ElevenLabs Instant Soundtracks: music and effects for video in one step
Upload a video and the model creates an original score and synced effects as separate layers you can edit.
ElevenLabs has released Instant Soundtracks: upload a video and get original music along with synced sound effects.
What’s new
The model analyzes the footage, finds moments that need an effect and places each one at the right spot on the timeline. It can also:
- use a video’s existing audio as a reference, picking up genre, crescendos, BPM and instrumentation;
- adjust timing for short-form content;
- shift the music’s mood between scenes.
How to try it
It works in ElevenCreative (Music Video Editor), on the ElevenMusic platform and through the Video to Music API. In the editor, effects sit on a separate layer, so you can change them independently of the music without starting over. The API has add_sfx, separate_tracks and use_audio_as_reference parameters. With separate_tracks=true, music and effects come back as separate files in a ZIP.
Limitations
A single request handles up to 10 videos, with a combined total of up to 200 MB and 10 minutes. The announcement doesn’t cover plans, pricing or licensing terms for generated music, so check those separately before commercial use.
Prepared with AI from public sources.