Spiral gives your agent every tool with one account. Browse the tools →

Grok · Video

How to Use LatentSync in Grok

LatentSync matches a recorded speaker's mouth movements to replacement speech for dubbing and dialogue corrections. It edits existing footage while aiming to preserve the speaker's identity and head pose.

Prompts to try with LatentSync in Grok

Copy an example into Grok, or ask in your own words.

Use LatentSync to match this presenter video to my replacement narration. Show me the result for a mouth-timing review.

LatentSyncGrok
Try asking
  • Use LatentSync to match this animated dialogue shot to the revised voice recording. Help me check the lips and teeth before I approve it.

  • Use LatentSync to create two edits of this clip, one with guidance at 1 and another at 1.5. Compare speech alignment and visible jitter.

  • Use LatentSync to dub this 10-second instructor clip with the translated recording. Prepare it as a review cut for a fluent speaker.

  • Use LatentSync to replace the spoken line in this spokesperson clip with my corrected recording. Help me compare facial stability with the original.

How to set up LatentSync in Grok

Pick the way that suits you. Each takes about two minutes.

Use the Grok connector

  1. Add a custom connector

    In Grok open Settings › Connect Apps, then Add a custom connector. Name it Spiral, paste this URL, leave Headers empty and click Add MCP.

    https://api.spiral.ai/mcp
  2. Sign in to Spiral and approve

    Grok opens Spiral: sign in, pick the organization and click Authorize. Spiral gives the connection its own API key; Grok never sees it, and you can remove the connection under Settings › Connected apps.

  3. Check that it is connected

    Connect Apps › Custom shows Spiral as Connected. It works in every Grok chat and Grok bot.

Use the Spiral skill

  1. Send Grok this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run LatentSync

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "fal",
        "model": "fal-ai/latentsync",
        "input": {
          "video_url": "https://fal.media/files/koala/8teUPbRRMtAUTORDvqy0l.mp4",
          "audio_url": "https://fal.media/files/lion/vyFWygmZsIZlUO4s0nr2n.wav"
        }
      }'

Then paste one of the prompts above: Grok finds LatentSync on Spiral, shows the price and runs it.

LatentSync providers and prices

Spiral runs LatentSync through fal. Open a card for today's price, with every fee included.

falVideo
LatentSync
fal-ai/latentsync

Settings you can ask for

LatentSync works from your video URL and audio URL. Ask Grok for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Guidance scale1 to 21

Guidance scale for the model inference

Seeda whole number

Random seed for generation. If None, a random seed will be used.

Loop modepingpong or loop

Video loop mode when audio is longer than video. Options: pingpong, loop

Every API field of LatentSync is on its tool page: open its card above.

What can you do with LatentSync in Grok?

Create dubbed presenter clips and revised character dialogue from existing footage with LatentSync. A chat app can help you compare edits and decide whether stronger synchronization is worth any visible distortion.

Dub a presenter clip

Match an existing presenter shot to a recorded translation. Review the mouth timing against the translated speech before editing the result into the finished video.

Correct a spoken line

Replace a mispronounced name or outdated sentence in a talking-head segment using a newly recorded line.

Update training videos

Use existing instructor footage with revised narration for a changed lesson or procedure. Start with a short passage for review.

Revise animated dialogue

Match an animated character's mouth movements to a replacement voice performance in an existing dialogue shot.

Prepare spokesperson ad edits

Create separate review cuts of an existing spokesperson video for recorded messages aimed at different audiences.

Build language lesson clips

Pair presenter footage with recorded example phrases for a language lesson. Have a fluent reviewer check the resulting mouth movements.

Questions about LatentSync in Grok

Can Grok use LatentSync?

Yes. Add Spiral to Grok as an MCP server, and Grok can find and run LatentSync like any built-in tool.

How much does LatentSync cost in Grok?

Up to $0.39 per run at the default inputs for 60 seconds of input. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Grok plan is separate.

Do I need a fal account to use LatentSync in Grok?

No. Spiral runs LatentSync on its own fal account. You sign in to Spiral once and never paste a key.

How long does it take to set up LatentSync in Grok?

About two minutes: add a custom connector, then sign in to Spiral and approve, then check that it is connected.

Does Grok wait while LatentSync runs?

LatentSync runs in the background. Grok starts the run, checks on it and gives you the video when it's ready.

What is LatentSync best used for?

Use LatentSync to match a recorded speaker's mouth to replacement dialogue. Dubbing, corrected narration, and updated presenter clips are practical starting points.

Can LatentSync work with animated characters?

Yes. LatentSync supports both real people and animated characters in existing footage; try a short dialogue shot before processing a longer scene.

Why can stronger lip synchronization make the video look worse?

Higher guidance can improve mouth-to-audio alignment while introducing distortion or jitter. Increase it gradually and compare both timing and facial stability.

Does LatentSync support Chinese speech?

ByteDance specifically improved Chinese-video performance in LatentSync 1.5 by adding Chinese training data. For Chinese dialogue, test a representative passage rather than assuming identical results across releases.

What does the published 512 by 512 resolution mean?

ByteDance describes 512 by 512 as the training resolution for LatentSync 1.6, introduced to address blurry teeth and lips. Treat that figure as release-specific training information when planning output quality.

Get started

Start using LatentSync in Grok

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Grok:

Set up Grok

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options