How to Use HeyGen Video Reference to Video in Factory Droid
HeyGen Video Reference to Video puts supplied products, people, or places into a new scene with sound. Unlike HeyGen Video Image to Video, it uses references to guide the scene instead of making one still the opening frame.
Prompts to try with HeyGen Video Reference to Video in Factory Droid
Copy an example into Factory Droid, or ask in your own words.
Use HeyGen Video Reference to Video with the project's approved mug photo. Make a 10-second landscape café shot at 1080p, with the mug resting on a counter, warm morning light, a slow push-in, and distant café chatter.
Estimate, then generate a 5-second 9:16 clip with HeyGen Video Reference to Video: a paper boat drifting down a rainy street. Save the result in ./assets.
Make a 10-second product teaser with HeyGen Video Reference to Video for a smartwatch, slow orbit shot, studio lighting.
Generate three 5-second b-roll clips of a busy coffee shop with HeyGen Video Reference to Video and list what each cost.
Make a 6-second 16:9 drone shot over a misty pine forest at sunrise with HeyGen Video Reference to Video.
How to set up HeyGen Video Reference to Video in Factory Droid
Pick the way that suits you. Each takes about two minutes.
Use Spiral's MCP server
- Add the server
Droid saves it to your user config, ~/.factory/mcp.json, so it works in every project.
droid mcp add spiral https://api.spiral.ai/mcp --type http
- Sign in
Start droid, type /mcp, select spiral and authenticate it. Sign in to Spiral in the browser and click Authorize. No API key.
- Check it
Spiral shows as connected. needs authentication means the sign-in did not finish: run /mcp again.
droid mcp list
Use the Spiral skill
- Send Factory Droid this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run HeyGen Video Reference to Video
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "fal", "model": "heygen/heygen-video/reference-to-video", "input": { "prompt": "<prompt>" } }'
Then paste one of the prompts above: Factory Droid finds HeyGen Video Reference to Video on Spiral, shows the price and runs it.
HeyGen Video Reference to Video providers and prices
Spiral runs HeyGen Video Reference to Video through fal. Open a card for today's price, with every fee included.
resolution: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on duration, default 5.
Settings you can ask for
HeyGen Video Reference to Video works from your prompt, reference image URLs, reference video URLs, and reference audio URLs. Ask Factory Droid for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Duration | 5 to 15 | 5 | |
| Resolution | 480p, 768p, 1080p, or 2k | 768p | |
| Prompt enhancement | turbo, quality, ultraquality, or disabled | turbo | |
| Seed | 0 to 4294967295 | ||
| Aspect ratio | adaptive, 21:9, 16:9, 4:3, 1:1, 3:4, or 9:16 | adaptive |
Every API field of HeyGen Video Reference to Video is on its tool page: open its card above.
What can you do with HeyGen Video Reference to Video in Factory Droid?
Turn a project's visual brief into short video assets with sound. Use HeyGen Video to test a shot's composition, motion, and style before placing it in the interface.
Product B-roll
Make a short shot of a product resting on a counter, with a slow camera move and room sound. Keep detailed handling out of the scene.
Hospitality mood shots
Create a brief hotel, café, or lounge scene for a promotional edit. Specify the light, camera position, and background sound.
Ad storyboard tests
Test a single advertising shot before committing to a full sequence. Compare how different framing and lighting choices communicate the same idea.
Stylized social shorts
Build a short anime or clay scene around one simple action. Direct its sound as carefully as its appearance.
Short spoken introductions
Create a brief introduction with a stationary subject and one short line of dialogue. Keep gestures simple and review the result before using it.
Animate approved artwork
Start with an approved illustration and add a simple movement with sound. Choose HeyGen Video Image to Video when the artwork must be the opening frame.
Place an existing product in a new setting
Use a product reference to brief a new scene around its recognizable appearance, such as a ceramic cup on a café counter.
More on HeyGen Video Reference to Video and Factory Droid
Overview
HeyGen Video Reference to Video in other agents
Questions about HeyGen Video Reference to Video in Factory Droid
Can Factory Droid use HeyGen Video Reference to Video?
Yes. Add Spiral to Factory Droid as an MCP server, and Factory Droid can find and run HeyGen Video Reference to Video like any built-in tool.
How much does HeyGen Video Reference to Video cost in Factory Droid?
`resolution`: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on `duration`, default 5. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Factory Droid plan is separate.
Do I need a fal account to use HeyGen Video Reference to Video in Factory Droid?
No. Spiral runs HeyGen Video Reference to Video on its own fal account. You sign in to Spiral once and never paste a key.
How long does it take to set up HeyGen Video Reference to Video in Factory Droid?
About two minutes: add the server, then sign in, then check it.
Does Factory Droid wait while HeyGen Video Reference to Video runs?
HeyGen Video Reference to Video runs in the background. Factory Droid starts the run, checks on it and gives you the video when it's ready.
What is HeyGen Video useful for?
Use it for short scenes with sound: product B-roll, ad concepts, location shots, and stylized shorts. Give each shot one clear subject and one action.
Does HeyGen Video generate sound?
Yes. Describe the sound you want alongside the action, such as a machine hum, footsteps, or a short spoken line.
Where does HeyGen Video struggle?
HeyGen flags long on-screen text, delicate motion involving hair or paper, and close hand work as less reliable. For an assembly demonstration, consider a simpler shot and add precise instructions during editing.
How should I write a HeyGen Video prompt?
Describe one subject doing one thing, then specify the camera, lens, movement, lighting, and sound. A concrete shot description gives you a clearer brief to revise than a broad request for a cinematic video.
When should I turn prompt enhancement off?
Turn it off when you want to preserve an already detailed brief. Leave enhancement on when you want the model to expand a short idea.
Start using HeyGen Video Reference to Video in Factory Droid
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Factory Droid:
set up https://spiral.ai/SKILL.md


