Spiral gives your agent every tool with one account. Browse the tools →

Factory Droid · VideoReleased 2023-10-10

How to Use ElevenLabs Dubbing in Factory Droid

ElevenLabs Dubbing translates recorded speech in audio or video while preserving the speakers’ voice characteristics. Use it for localized tutorials, interviews, and podcasts; it does not synchronize lip movements.

Prompts to try with ElevenLabs Dubbing in Factory Droid

Copy an example into Factory Droid, or ask in your own words.

Use ElevenLabs Dubbing to translate the English walkthrough in this project into Spanish. Read the documentation and make a review checklist for product names and technical terms.

ElevenLabs DubbingFactory Droid
Try asking
  • Use ElevenLabs Dubbing to create a Japanese edition of the project’s recorded installation tutorial. List the spoken commands and version numbers a reviewer should check.

  • Use ElevenLabs Dubbing to translate our recorded two-person product interview into Portuguese. Prepare a checklist for voice consistency at each speaker change.

  • Use ElevenLabs Dubbing to translate the project’s English onboarding video into Hindi. Compare the spoken instructions with the documentation and flag steps needing human review.

  • Use ElevenLabs Dubbing to create a French edition of our recorded feature demo. Add a review checklist for translation accuracy and speech timing against the screen recording.

How to set up ElevenLabs Dubbing in Factory Droid

Pick the way that suits you. Each takes about two minutes.

Use Spiral's MCP server

  1. Add the server

    Droid saves it to your user config, ~/.factory/mcp.json, so it works in every project.

    droid mcp add spiral https://api.spiral.ai/mcp --type http
  2. Sign in

    Start droid, type /mcp, select spiral and authenticate it. Sign in to Spiral in the browser and click Authorize. No API key.

  3. Check it

    Spiral shows as connected. needs authentication means the sign-in did not finish: run /mcp again.

    droid mcp list

Use the Spiral skill

  1. Send Factory Droid this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run ElevenLabs Dubbing

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "fal",
        "model": "fal-ai/elevenlabs/dubbing",
        "input": {
          "audio_url": "<audio_url>",
          "target_lang": "es"
        }
      }'

Then paste one of the prompts above: Factory Droid finds ElevenLabs Dubbing on Spiral, shows the price and runs it.

ElevenLabs Dubbing providers and prices

Spiral runs ElevenLabs Dubbing through fal. Open a card for today's price, with every fee included.

falVideo
ElevenLabs Dubbing
fal-ai/elevenlabs/dubbing

Settings you can ask for

ElevenLabs Dubbing works from your audio URL and video URL. Ask Factory Droid for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Number of speakers1 to 50

Number of speakers in the audio. If not provided, will be auto-detected.

Highest resolutionon or offon

Whether to use the highest resolution for dubbing.

Every API field of ElevenLabs Dubbing is on its tool page: open its card above.

What can you do with ElevenLabs Dubbing in Factory Droid?

Create translated editions of the project’s recorded demos, tutorials, and training videos with ElevenLabs Dubbing. Use the project’s terminology to prepare a review checklist for the translated speech.

Software tutorial localization

Translate a recorded walkthrough for users who speak another language while retaining the presenter’s voice characteristics.

Podcast translations

Create another language edition of a recorded podcast, with speaker detection for host and guest dialogue.

Customer interview localization

Dub recorded interviews for international audiences, then review whether each person’s voice stays consistent.

Recorded course lessons

Translate spoken lessons into another language. Include a native speaker’s review of explanations and terminology before release.

Employee training videos

Prepare translated editions of recorded onboarding and training sessions, with a review of instructions and speaker delivery.

Documentary narration

Translate recorded narration while retaining background audio. Check visible dialogue separately because dubbing does not synchronize lips.

Product demonstration videos

Create translated speech for an existing product demonstration and review the timing against the actions shown onscreen.

Recorded panel discussions

Translate discussions with multiple speakers, then check voice consistency at speaker changes.

Questions about ElevenLabs Dubbing in Factory Droid

Can Factory Droid use ElevenLabs Dubbing?

Yes. Add Spiral to Factory Droid as an MCP server, and Factory Droid can find and run ElevenLabs Dubbing like any built-in tool.

How much does ElevenLabs Dubbing cost in Factory Droid?

Up to $0.78 per run at the default inputs for 60 seconds of input. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Factory Droid plan is separate.

Do I need a fal account to use ElevenLabs Dubbing in Factory Droid?

No. Spiral runs ElevenLabs Dubbing on its own fal account. You sign in to Spiral once and never paste a key.

How long does it take to set up ElevenLabs Dubbing in Factory Droid?

About two minutes: add the server, then sign in, then check it.

Does Factory Droid wait while ElevenLabs Dubbing runs?

ElevenLabs Dubbing runs in the background. Factory Droid starts the run, checks on it and gives you the video, audio when it's ready.

Will ElevenLabs Dubbing keep the original voices?

It is designed to preserve each speaker’s voice characteristics, tone, and delivery while translating the speech. Review the result for voice consistency before publishing.

Can ElevenLabs Dubbing handle interviews and podcasts?

Yes. Speaker detection makes recordings with multiple voices a practical use, including interviews, podcasts, and panel discussions.

Does ElevenLabs Dubbing change mouth movements?

No. It translates the speech without synchronizing visible lip movements, so review close-up dialogue shots separately.

Which languages can I use for dubbing?

Supported languages include English, Spanish, French, German, Japanese, Hindi, Portuguese, Polish, and Arabic. Pick the destination language explicitly when asking your agent for a dub.

Will dubbed video keep the source resolution and surround sound?

Do not assume either will carry over. ElevenLabs says video output is commonly 1080p and may differ from the source; 5.1 and other multichannel audio are not preserved.

Get started

Start using ElevenLabs Dubbing in Factory Droid

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Factory Droid:

Set up Factory Droid

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options