falAudio to videoComing soon

fal-ai/wan/v2.2-14b/speech-to-video

Name: fal-ai/wan/v2.2-14b/speech-to-video
Brand: fal

fal-ai/wan/v2.2-14b/speech-to-video is an audio to video tool from fal that runs in the background and returns video. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Priced by usage

Pricing

$0.26 per second. Measured from the input file. The final charge comes from usage.

Limits

Runs: In the background
Returns: video
Longest queue wait: 3600s
Run deadline: 1800s
Largest inline input: 1024 KB
Largest input file: 500 MB
Largest output: 4768 MB
Outputs per run: 16

Input

Field	Kind	Default	Description
`prompt` required	text	—	The text prompt used for video generation.
`negative_prompt`	text		Negative prompt for video generation.
`num_frames`	number (whole) 40 to 120	80	Number of frames to generate. Must be between 40 to 120, (must be multiple of 4).
`frames_per_second`	number (whole) 4 to 60	16	Frames per second of the generated video. Must be between 4 to 60. When using interpolation and `adjust_fps_for_interpolation` is set to true (default true,) the final FPS will be multiplied by the number of interpolated frames plus one. For example, if the generated frames per second is 16 and the number of interpolated frames is 1, the final frames per second will be 32. If `adjust_fps_for_interpolation` is set to false, this value will be used as-is.
`seed`	number (whole)	—	Random seed for reproducibility. If None, a random seed is chosen.
`resolution`	one of 480p, 580p, 720p	480p	Resolution of the generated video (480p, 580p, or 720p).
`num_inference_steps`	number (whole) 2 to 40	27	Number of inference steps for sampling. Higher values give better quality but take longer.
`guidance_scale`	number 1 to 10	3.5	Classifier-free guidance scale. Higher values give better adherence to the prompt but may decrease quality.
`shift`	number 1 to 10	5	Shift value for the video. Must be between 1.0 and 10.0.
`video_quality`	one of low, medium, high, maximum	high	The quality of the output video. Higher quality means better visual quality but larger file size.
`video_write_mode`	one of fast, balanced, small	balanced	The write mode of the output video. Faster write mode means faster results but larger file size, balanced write mode is a good compromise between speed and quality, and small write mode is the slowest but produces the smallest file size.
`image_url` required	URL or file	—	URL of the input image. If the input image does not match the chosen aspect ratio, it is resized and center cropped.
`audio_url` required	URL or file	—	The URL of the audio file.

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "fal",
    "model": "fal-ai/wan/v2.2-14b/speech-to-video",
    "input": {
      "prompt": "Summer beach vacation style, a white cat wearing sunglasses sits on a surfboard.",
      "image_url": "https://storage.googleapis.com/falserverless/example_inputs/wan_s2v_cat.png",
      "audio_url": "https://storage.googleapis.com/falserverless/example_inputs/wan_s2v_talk.wav"
    }
  }'