ReplicateAudio to videoComing soon

sync/lipsync-2-pro

sync/lipsync-2-pro is an audio to video tool from Replicate that runs in the background and returns video. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Price pending

Pricing

Price pending.

Limits

Runs
In the background
Returns
video
Longest queue wait
3600s
Run deadline
1800s
Largest inline input
1024 KB
Largest input file
500 MB
Largest output
4768 MB
Outputs per run
16

Input

FieldKindDefaultDescription
audio requiredURL or file—Input audio file (.wav)
video requiredtext—Input video file (.mp4)
temperaturenumber
0 to 1
0.5How expressive lipsync can be (0-1)
active_speakertrue or falsefalseWhether to detect active speaker (i.e. whoever is speaking in the clip will be used for lipsync)

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "replicate",
    "model": "sync/lipsync-2-pro",
    "input": {
      "audio": "<audio>",
      "video": "<video>"
    }
  }'