Spiral gives your agent every tool with one account. Browse the tools →

Factory Droid · VideoReleased 2026-10-20

How to Use HeyGen Video Reference to Video in Factory Droid

HeyGen Video Reference to Video puts supplied products, people, or places into a new scene with sound. Unlike HeyGen Video Image to Video, it uses references to guide the scene instead of making one still the opening frame.

Prompts to try with HeyGen Video Reference to Video in Factory Droid

Copy an example into Factory Droid, or ask in your own words.

Use HeyGen Video Reference to Video with the project's approved mug photo. Make a 10-second landscape café shot at 1080p, with the mug resting on a counter, warm morning light, a slow push-in, and distant café chatter.

HeyGen Video Reference to VideoFactory Droid
Try asking
  • Estimate, then generate a 5-second 9:16 clip with HeyGen Video Reference to Video: a paper boat drifting down a rainy street. Save the result in ./assets.

  • Make a 10-second product teaser with HeyGen Video Reference to Video for a smartwatch, slow orbit shot, studio lighting.

  • Generate three 5-second b-roll clips of a busy coffee shop with HeyGen Video Reference to Video and list what each cost.

  • Make a 6-second 16:9 drone shot over a misty pine forest at sunrise with HeyGen Video Reference to Video.

How to set up HeyGen Video Reference to Video in Factory Droid

Pick the way that suits you. Each takes about two minutes.

Use Spiral's MCP server

  1. Add the server

    Droid saves it to your user config, ~/.factory/mcp.json, so it works in every project.

    droid mcp add spiral https://api.spiral.ai/mcp --type http
  2. Sign in

    Start droid, type /mcp, select spiral and authenticate it. Sign in to Spiral in the browser and click Authorize. No API key.

  3. Check it

    Spiral shows as connected. needs authentication means the sign-in did not finish: run /mcp again.

    droid mcp list

Use the Spiral skill

  1. Send Factory Droid this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run HeyGen Video Reference to Video

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "fal",
        "model": "heygen/heygen-video/reference-to-video",
        "input": {
          "prompt": "<prompt>"
        }
      }'

Then paste one of the prompts above: Factory Droid finds HeyGen Video Reference to Video on Spiral, shows the price and runs it.

HeyGen Video Reference to Video providers and prices

Spiral runs HeyGen Video Reference to Video through fal. Open a card for today's price, with every fee included.

falVideo
HeyGen Video Reference to Video
heygen/heygen-video/reference-to-video

Settings you can ask for

HeyGen Video Reference to Video works from your prompt, reference image URLs, reference video URLs, and reference audio URLs. Ask Factory Droid for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Duration5 to 155
Resolution480p, 768p, 1080p, or 2k768p
Prompt enhancementturbo, quality, ultraquality, or disabledturbo
Seed0 to 4294967295
Aspect ratioadaptive, 21:9, 16:9, 4:3, 1:1, 3:4, or 9:16adaptive

Every API field of HeyGen Video Reference to Video is on its tool page: open its card above.

What can you do with HeyGen Video Reference to Video in Factory Droid?

Turn a project's visual brief into short video assets with sound. Use HeyGen Video to test a shot's composition, motion, and style before placing it in the interface.

Product B-roll

Make a short shot of a product resting on a counter, with a slow camera move and room sound. Keep detailed handling out of the scene.

Hospitality mood shots

Create a brief hotel, café, or lounge scene for a promotional edit. Specify the light, camera position, and background sound.

Ad storyboard tests

Test a single advertising shot before committing to a full sequence. Compare how different framing and lighting choices communicate the same idea.

Stylized social shorts

Build a short anime or clay scene around one simple action. Direct its sound as carefully as its appearance.

Short spoken introductions

Create a brief introduction with a stationary subject and one short line of dialogue. Keep gestures simple and review the result before using it.

Animate approved artwork

Start with an approved illustration and add a simple movement with sound. Choose HeyGen Video Image to Video when the artwork must be the opening frame.

Place an existing product in a new setting

Use a product reference to brief a new scene around its recognizable appearance, such as a ceramic cup on a café counter.

Questions about HeyGen Video Reference to Video in Factory Droid

Can Factory Droid use HeyGen Video Reference to Video?

Yes. Add Spiral to Factory Droid as an MCP server, and Factory Droid can find and run HeyGen Video Reference to Video like any built-in tool.

How much does HeyGen Video Reference to Video cost in Factory Droid?

`resolution`: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on `duration`, default 5. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Factory Droid plan is separate.

Do I need a fal account to use HeyGen Video Reference to Video in Factory Droid?

No. Spiral runs HeyGen Video Reference to Video on its own fal account. You sign in to Spiral once and never paste a key.

How long does it take to set up HeyGen Video Reference to Video in Factory Droid?

About two minutes: add the server, then sign in, then check it.

Does Factory Droid wait while HeyGen Video Reference to Video runs?

HeyGen Video Reference to Video runs in the background. Factory Droid starts the run, checks on it and gives you the video when it's ready.

What is HeyGen Video useful for?

Use it for short scenes with sound: product B-roll, ad concepts, location shots, and stylized shorts. Give each shot one clear subject and one action.

Does HeyGen Video generate sound?

Yes. Describe the sound you want alongside the action, such as a machine hum, footsteps, or a short spoken line.

Where does HeyGen Video struggle?

HeyGen flags long on-screen text, delicate motion involving hair or paper, and close hand work as less reliable. For an assembly demonstration, consider a simpler shot and add precise instructions during editing.

How should I write a HeyGen Video prompt?

Describe one subject doing one thing, then specify the camera, lens, movement, lighting, and sound. A concrete shot description gives you a clearer brief to revise than a broad request for a cinematic video.

When should I turn prompt enhancement off?

Turn it off when you want to preserve an already detailed brief. Leave enhancement on when you want the model to expand a short idea.

Get started

Start using HeyGen Video Reference to Video in Factory Droid

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Factory Droid:

Set up Factory Droid

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options