How to Use Sync Lipsync 2.0 in Muse Code
Sync Lipsync 2.0 matches existing talking footage to replacement speech while preserving the speaker’s style. It suits general dubbing and dialogue changes; Sync Lipsync 2.0 Pro adds finer detail around teeth and facial hair.
Prompts to try with Sync Lipsync 2.0 in Muse Code
Copy an example into Muse Code, or ask in your own words.
Use Sync Lipsync 2.0 to match assets/presenter.mp4 to assets/corrected-dialogue.wav. Check that the source shows natural speaking motion, then save a preview for review.
Use Sync Lipsync 2.0 to make Spanish and Japanese versions of assets/lesson.mp4 with the finished recordings in assets/dubs. Keep the outputs clearly labeled by language.
Use Sync Lipsync 2.0 to create previews from the presenter clips and matching replacement recordings in this project. Report clips with still mouths or full profile views before processing them.
Make a talking-head video with Sync Lipsync 2.0 from this headshot and this 20-second voiceover. Save the result in ./assets.
Create a 15-second founder intro with Sync Lipsync 2.0 using the photo and script I attach.
How to set up Sync Lipsync 2.0 in Muse Code
Pick the way that suits you. Each takes about two minutes.
Use Spiral's MCP server
- Install Muse Code
curl -fsSL https://dev.meta.ai/install.sh | bash
- Ask Muse to add the server
Start muse and ask:
Add the Spiral MCP server at https://api.spiral.ai/mcp
- Sign in
In your terminal, run:
muse mcp login spiral
Use the Spiral skill
- Send Muse Code this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run Sync Lipsync 2.0
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "fal", "model": "fal-ai/sync-lipsync/v2", "input": { "video_url": "https://v3.fal.media/files/tiger/IugLCDJRIoGqvqTa-EJTr_3wg74vCqyNuQ-IiBd77MM_output.mp4", "audio_url": "https://fal.media/files/lion/vyFWygmZsIZlUO4s0nr2n.wav" } }'
Then paste one of the prompts above: Muse Code finds Sync Lipsync 2.0 on Spiral, shows the price and runs it.
Sync Lipsync 2.0 providers and prices
Spiral runs Sync Lipsync 2.0 through fal. Open a card for today's price, with every fee included.
Settings you can ask for
Sync Lipsync 2.0 works from your video URL and audio URL. Ask Muse Code for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Model | lipsync-2 or lipsync-2-pro | lipsync-2 | The model to use for lipsyncing. |
| Sync mode | cut_off, loop, bounce, silence, or remap | cut_off | Lipsync mode when audio and video durations are out of sync. |
Every API field of Sync Lipsync 2.0 is on its tool page: open its card above.
What can you do with Sync Lipsync 2.0 in Muse Code?
Turn recorded presenters and animated talking shots in your project into videos with replacement dialogue. Your coding agent can prepare the media, run Sync Lipsync 2, and organize previews for review.
Localize instructor-led lessons
Match an instructor’s talking footage to separately recorded translations for learners in other languages.
Dub creator videos
Give a talking-head video a translated speech track with mouth movements that follow the new recording.
Personalize sales greetings
Reuse a recorded presenter with separately prepared greetings for individual prospects.
Adapt customer onboarding videos
Match a presenter’s footage to new onboarding messages for different customers or audiences.
Replace a recorded line
Pair an existing talking shot with a corrected audio take, then review whether the mouth movement fits the replacement dialogue.
Add dialogue to generated humans
Match an AI-generated human’s visible speaking motion to a finished voice recording.
Localize animated dialogue
Use an existing animated talking shot with a human-like face and a translated dialogue recording.
More on Sync Lipsync 2.0 and Muse Code
Overview
Sync Lipsync 2.0 in other agents
Questions about Sync Lipsync 2.0 in Muse Code
Can Muse Code use Sync Lipsync 2.0?
Yes. Add Spiral to Muse Code as an MCP server, and Muse Code can find and run Sync Lipsync 2.0 like any built-in tool.
How much does Sync Lipsync 2.0 cost in Muse Code?
Up to $3.90 per run at the default inputs for 60 seconds of input. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Muse Code plan is separate.
Do I need a fal account to use Sync Lipsync 2.0 in Muse Code?
No. Spiral runs Sync Lipsync 2.0 on its own fal account. You sign in to Spiral once and never paste a key.
How long does it take to set up Sync Lipsync 2.0 in Muse Code?
About two minutes: install Muse Code, then ask Muse to add the server, then sign in.
Does Muse Code wait while Sync Lipsync 2.0 runs?
Sync Lipsync 2.0 runs in the background. Muse Code starts the run, checks on it and gives you the video when it's ready.
What does Sync Lipsync 2 change in a video?
It changes the speaker’s lip movements to match a replacement audio track. Use it to dub talking footage or change dialogue while retaining the speaker’s visual speaking style.
Can Sync Lipsync 2 work with different languages?
Yes. Supply the translated speech as audio, and it can match the speaker’s lips to that recording in any language.
Can I start with a still photo?
Use video that already shows natural speaking motion. Still frames and inactive mouths do not provide the motion Sync Lipsync 2 needs for reliable results.
Is the finished video only 512×512?
The 512×512 limit describes the generated face region. The face is placed back into the original frame, and the output retains the source video’s dimensions and orientation.
Does Sync Lipsync 2 work on animated characters?
It can work on animated characters with human-like faces. Animals and non-humanoid characters are unsupported, so start with a short test before processing a longer scene.
Start using Sync Lipsync 2.0 in Muse Code
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Muse Code:
set up https://spiral.ai/SKILL.md


