Spiral gives your agent every tool with one account. Browse the tools →

Muse · Video

How to Use Sync Lipsync 2.0 in Muse

Sync Lipsync 2.0 matches existing talking footage to replacement speech while preserving the speaker’s style. It suits general dubbing and dialogue changes; Sync Lipsync 2.0 Pro adds finer detail around teeth and facial hair.

Prompts to try with Sync Lipsync 2.0 in Muse

Copy an example into Muse, or ask in your own words.

Use Sync Lipsync 2.0 to match the supplied talking-head video to the supplied Spanish recording. Check that the presenter is already speaking in the source footage.

Sync Lipsync 2.0Muse
Try asking
  • Use Sync Lipsync 2.0 to match this instructor video to the supplied Japanese narration. Flag any sections where the instructor’s mouth is still before proceeding.

  • Use Sync Lipsync 2.0 to make separate previews of this presenter video with the two supplied greeting recordings. Label each preview with the intended recipient.

  • Make a talking-head video with Sync Lipsync 2.0 from this headshot and this 20-second voiceover.

  • Create a 15-second founder intro with Sync Lipsync 2.0 using the photo and script I attach.

How to set up Sync Lipsync 2.0 in Muse

Pick the way that suits you. Each takes about two minutes.

Use the Muse connector

  1. Create an API key

    Create one under API keys in the Spiral console.

  2. Send Muse this message

    Muse reads Spiral's skill and asks for an API key.

    set up https://spiral.ai/SKILL.md
  3. Give Muse the key

    Paste the key when Muse asks for it, never in the chat itself.

Use the Spiral skill

  1. Send Muse this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run Sync Lipsync 2.0

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "fal",
        "model": "fal-ai/sync-lipsync/v2",
        "input": {
          "video_url": "https://v3.fal.media/files/tiger/IugLCDJRIoGqvqTa-EJTr_3wg74vCqyNuQ-IiBd77MM_output.mp4",
          "audio_url": "https://fal.media/files/lion/vyFWygmZsIZlUO4s0nr2n.wav"
        }
      }'

Then paste one of the prompts above: Muse finds Sync Lipsync 2.0 on Spiral, shows the price and runs it.

Sync Lipsync 2.0 providers and prices

Spiral runs Sync Lipsync 2.0 through fal. Open a card for today's price, with every fee included.

falVideo
Sync Lipsync 2.0
fal-ai/sync-lipsync/v2

Settings you can ask for

Sync Lipsync 2.0 works from your video URL and audio URL. Ask Muse for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Modellipsync-2 or lipsync-2-prolipsync-2

The model to use for lipsyncing. lipsync-2-pro will cost roughly 1.67 times as much as lipsync-2 for the same duration.

Sync modecut_off, loop, bounce, silence, or remapcut_off

Lipsync mode when audio and video durations are out of sync.

Every API field of Sync Lipsync 2.0 is on its tool page: open its card above.

What can you do with Sync Lipsync 2.0 in Muse?

Make a recorded presenter speak a translated or revised audio track while retaining their speaking style. Ask your chat app to use Sync Lipsync 2 with the supplied footage and finished speech, then review the result.

Localize instructor-led lessons

Match an instructor’s talking footage to separately recorded translations for learners in other languages.

Dub creator videos

Give a talking-head video a translated speech track with mouth movements that follow the new recording.

Personalize sales greetings

Reuse a recorded presenter with separately prepared greetings for individual prospects.

Adapt customer onboarding videos

Match a presenter’s footage to new onboarding messages for different customers or audiences.

Replace a recorded line

Pair an existing talking shot with a corrected audio take, then review whether the mouth movement fits the replacement dialogue.

Add dialogue to generated humans

Match an AI-generated human’s visible speaking motion to a finished voice recording.

Localize animated dialogue

Use an existing animated talking shot with a human-like face and a translated dialogue recording.

Questions about Sync Lipsync 2.0 in Muse

Can Muse use Sync Lipsync 2.0?

Yes. Add Spiral to Muse as an MCP server, and Muse can find and run Sync Lipsync 2.0 like any built-in tool.

How much does Sync Lipsync 2.0 cost in Muse?

Up to $3.90 per run at the default inputs for 60 seconds of input. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Muse plan is separate.

Do I need a fal account to use Sync Lipsync 2.0 in Muse?

You need no fal account. Muse uses one Spiral API key for every tool, and Spiral runs Sync Lipsync 2.0 on its own fal account.

How long does it take to set up Sync Lipsync 2.0 in Muse?

About two minutes: create an API key, then send Muse this message, then give Muse the key.

Does Muse wait while Sync Lipsync 2.0 runs?

Sync Lipsync 2.0 runs in the background. Muse starts the run, checks on it and gives you the video when it's ready.

What does Sync Lipsync 2 change in a video?

It changes the speaker’s lip movements to match a replacement audio track. Use it to dub talking footage or change dialogue while retaining the speaker’s visual speaking style.

Can Sync Lipsync 2 work with different languages?

Yes. Supply the translated speech as audio, and it can match the speaker’s lips to that recording in any language.

Can I start with a still photo?

Use video that already shows natural speaking motion. Still frames and inactive mouths do not provide the motion Sync Lipsync 2 needs for reliable results.

Is the finished video only 512×512?

The 512×512 limit describes the generated face region. The face is placed back into the original frame, and the output retains the source video’s dimensions and orientation.

Does Sync Lipsync 2 work on animated characters?

It can work on animated characters with human-like faces. Animals and non-humanoid characters are unsupported, so start with a short test before processing a longer scene.

Get started

Start using Sync Lipsync 2.0 in Muse

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Muse:

Set up Muse

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options