ReplicateImage to videoComing soon

lightricks/audio-to-video

lightricks/audio-to-video is an image to video tool from Replicate that runs in the background and returns video. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Price pending

Pricing

Price pending.

Limits

Runs
In the background
Returns
video
Longest queue wait
3600s
Run deadline
3600s
Largest inline input
1024 KB
Largest input file
500 MB
Largest output
4768 MB
Outputs per run
16

Input

FieldKindDefaultDescription
audio requiredURL or file—Audio file to be used as the soundtrack for the video. Supported formats: wav, mp3, flac, ogg, m4a.
imageURL or file—Input image to be used as the first frame of the video. Required if prompt is not provided.
prompttextText description of how the video should be generated. Required if image is not provided. If image is provided, this describes how the image should be animated.
guidance_scalenumber
1 to 50
—Guidance scale (CFG) for video generation. Higher values make the output more closely follow the prompt but may reduce quality.

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "replicate",
    "model": "lightricks/audio-to-video",
    "input": {
      "audio": "<audio>"
    }
  }'