falVideo to videoComing soon

fal-ai/flux-3-action/so101

fal-ai/flux-3-action/so101 is a video to video tool from fal that runs in the background and returns video. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Price pending

Pricing

Price pending.

Limits

Runs
In the background
Returns
video
Longest queue wait
3600s
Run deadline
1800s
Largest inline input
1024 KB
Largest input file
500 MB
Largest output
4768 MB
Outputs per run
16

Input

FieldKindDefaultDescription
prompt requiredtext—Natural-language task instruction for the robot.
scene_image_url requiredtext—Current frame from the fixed scene camera (tiled left). Resized to 256x256.
wrist_image_url requiredtext—Current frame from the wrist camera (tiled right). Resized to 256x256.
state requiredlist—Measured state: shoulder pan, shoulder lift, elbow flex, wrist flex, wrist roll (degrees), gripper (percent).
state_historyJSON—Measured states at the 7 control ticks (30 Hz) before `state`, oldest first. Requires `command_history`. Omit for a fresh episode.
command_historyJSON—Absolute commands in effect at each of the 8 observation ticks, oldest first; the last row is the most recent command sent. Requires `state_history`.
history_scene_image_urltext—Scene frame from the oldest history tick (7 ticks before now). Requires `state_history`. Defaults to the current frame.
history_wrist_image_urltext—Wrist frame from the oldest history tick. Requires `state_history`.
num_inference_stepsnumber (whole)
1 to 8
4Euler denoising steps. The checkpoint was validated at 4.
guidance_scalenumber
1 to 10
3Classifier-free guidance on video and action; 1.0 disables CFG.
seednumber (whole)—Sampling seed. Omit for a random seed; the reference evaluation seed is 0 for DROID and 42 for SO-101.

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "fal",
    "model": "fal-ai/flux-3-action/so101",
    "input": {
      "prompt": "place the box in the container",
      "scene_image_url": "https://v3b.fal.media/files/b/0aaba0cf/rbESQ2h5nozh5K8Ms1FDm_scene.png",
      "wrist_image_url": "https://v3b.fal.media/files/b/0aaba0cf/qyaj49X3PZc70wJwz90f1_wrist.png",
      "state": [
        "<state>"
      ]
    }
  }'