falAudio to videoComing soon

fal-ai/ltx-2.3-22b/distilled/audio-to-video/lora

Name: fal-ai/ltx-2.3-22b/distilled/audio-to-video/lora
Brand: fal

fal-ai/ltx-2.3-22b/distilled/audio-to-video/lora is an audio to video tool from fal that runs in the background and returns video. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Price pending

Pricing

Price pending.

Limits

Runs: In the background
Returns: video
Longest queue wait: 3600s
Run deadline: 1800s
Largest inline input: 1024 KB
Largest input file: 500 MB
Largest output: 4768 MB
Outputs per run: 16

Input

Field	Kind	Default	Description
`prompt` required	text	—	The prompt to generate the video from.
`audio_url` required	URL or file	—	The URL of the audio to generate the video from.
`image_url`	URL or file	—	Optional URL of an image to use as the first frame of the video.
`end_image_url`	URL or file	—	The URL of the image to use as the end of the video.
`match_audio_length`	true or false	true	When enabled, the number of frames will be calculated based on the audio duration and FPS. When disabled, use the specified num_frames.
`num_frames`	number (whole) 9 to 481	121	The number of frames to generate.
`video_size`	JSON	landscape_16_9	The size of the generated video. Use 'auto' to match the input image dimensions if provided.
`use_multiscale`	true or false	true	Whether to use multi-scale generation. If True, the model will generate the video at a smaller scale first, then use the smaller video to guide the generation of a video at or above your requested size. This results in better coherence and details.
`fps`	number 1 to 60	24	The frames per second of the generated video.
`scheduler`	one of ltx2, linear_quadratic, beta	ltx2	The scheduler to use.
`acceleration`	one of none, regular, high, full	none	The acceleration level to use.
`camera_lora`	one of dolly_in, dolly_out, dolly_left, dolly_right, jib_up, jib_down, static, none	none	The camera LoRA to use. This allows you to control the camera movement of the generated video more accurately than just prompting the model to move the camera.
`camera_lora_scale`	number 0 to 1	1	The scale of the camera LoRA to use. This allows you to control the camera movement of the generated video more accurately than just prompting the model to move the camera.
`negative_prompt`	text	news broadcast, 3d animation, computer graphics, pc game, console game, video game, cartoon, childish, watermark, logo, text, on screen text, subtitles, titles, signature, slowmo, static	The negative prompt to generate the video from.
`seed`	number (whole)	—	The seed for the random number generator.
`enable_prompt_expansion`	true or false	true	Whether to enable prompt expansion.
`video_output_type`	one of X264 (.mp4), VP9 (.webm), PRORES4444 (.mov), GIF (.gif)	X264 (.mp4)	The output type of the generated video.
`video_quality`	one of low, medium, high, maximum	high	The quality of the generated video.
`video_write_mode`	one of fast, balanced, small	balanced	The write mode of the generated video.
`loras` required	JSON	—	The LoRAs to use for the generation.
`distill_lora_second_pass_scale`	number 0 to 1	0.5	The scale of the distill LoRA to use for the second and subsequent passes.
`image_strength`	number 0 to 1	1	The strength of the image to use for the video generation.
`end_image_strength`	number 0 to 1	1	The strength of the end image to use for the video generation.
`audio_strength`	number 0 to 1	1	Audio conditioning strength. Values below 1.0 will allow the model to change the audio, while a value of exactly 1.0 will use the input audio without modification.
`preprocess_audio`	true or false	true	Whether to preprocess the audio before using it as conditioning.

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "fal",
    "model": "fal-ai/ltx-2.3-22b/distilled/audio-to-video/lora",
    "input": {
      "prompt": "A woman speaks to the camera",
      "audio_url": "https://storage.googleapis.com/falserverless/example_inputs/ltx-2-a2v-input-audio.mp3",
      "loras": {}
    }
  }'