falVideo to audioComing soon

sonilo/v1.1/video-to-sound-effects

sonilo/v1.1/video-to-sound-effects is a video to audio tool from fal that runs in the background and returns audio. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Priced by usage

Pricing

$0.0117 per second. Measured from the input file. The final charge comes from usage.

Limits

Runs
In the background
Returns
audio
Longest queue wait
3600s
Run deadline
1800s
Largest inline input
1024 KB
Largest input file
500 MB
Largest output
4768 MB
Outputs per run
16

Input

FieldKindDefaultDescription
video_url requiredURL or file—The video to add sound to (public URL, or upload a file). The generated audio matches the video's length.
prompttext—Optional. Describe the kind of sound you want; it steers the generated audio for every scene. Leave empty to caption the video automatically.
segmentsJSON—Optional. Split the video into time ranges, each with its own sound description. Leave empty to split into scenes automatically.
audio_formatone of
wav, mp3, aac, flac
aacFormat of the returned audio file: aac (default), mp3, wav, or flac. (The video with sound is always AAC.)
keep_speech_vocaltrue or falsefalseKeep the original video's speech/vocals. When on, the source audio is separated (music source separation) and the isolated vocals are kept as recorded, with the generated sound mixed in at a level matched to the voice; the rest of the original soundtrack (music, ambience) is dropped. Applies to the returned audio and video. When off (default), the result carries only the generated sound.

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "fal",
    "model": "sonilo/v1.1/video-to-sound-effects",
    "input": {
      "video_url": "https://storage.googleapis.com/falserverless/model_tests/video_models/mmaudio_input.mp4"
    }
  }'