How to Use HeyGen Video Reference to Video in Muse Code
HeyGen Video Reference to Video puts supplied products, people, or places into a new scene with sound. Unlike HeyGen Video Image to Video, it uses references to guide the scene instead of making one still the opening frame.
Prompts to try with HeyGen Video Reference to Video in Muse Code
Copy an example into Muse Code, or ask in your own words.
Use HeyGen Video Reference to Video with the project's approved mug photo. Make a 10-second landscape café shot at 1080p, with the mug resting on a counter, warm morning light, a slow push-in, and distant café chatter.
Estimate, then generate a 5-second 9:16 clip with HeyGen Video Reference to Video: a paper boat drifting down a rainy street. Save the result in ./assets.
Make a 10-second product teaser with HeyGen Video Reference to Video for a smartwatch, slow orbit shot, studio lighting.
Generate three 5-second b-roll clips of a busy coffee shop with HeyGen Video Reference to Video and list what each cost.
Make a 6-second 16:9 drone shot over a misty pine forest at sunrise with HeyGen Video Reference to Video.
How to set up HeyGen Video Reference to Video in Muse Code
Pick the way that suits you. Each takes about two minutes.
Use Spiral's MCP server
- Install Muse Code
curl -fsSL https://dev.meta.ai/install.sh | bash
- Ask Muse to add the server
Start muse and ask:
Add the Spiral MCP server at https://api.spiral.ai/mcp
- Sign in
In your terminal, run:
muse mcp login spiral
Use the Spiral skill
- Send Muse Code this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run HeyGen Video Reference to Video
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "fal", "model": "heygen/heygen-video/reference-to-video", "input": { "prompt": "<prompt>" } }'
Then paste one of the prompts above: Muse Code finds HeyGen Video Reference to Video on Spiral, shows the price and runs it.
HeyGen Video Reference to Video providers and prices
Spiral runs HeyGen Video Reference to Video through fal. Open a card for today's price, with every fee included.
resolution: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on duration, default 5.
Settings you can ask for
HeyGen Video Reference to Video works from your prompt, reference image URLs, reference video URLs, and reference audio URLs. Ask Muse Code for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Duration | 5 to 15 | 5 | |
| Resolution | 480p, 768p, 1080p, or 2k | 768p | |
| Prompt enhancement | turbo, quality, ultraquality, or disabled | turbo | |
| Seed | 0 to 4294967295 | ||
| Aspect ratio | adaptive, 21:9, 16:9, 4:3, 1:1, 3:4, or 9:16 | adaptive |
Every API field of HeyGen Video Reference to Video is on its tool page: open its card above.
What can you do with HeyGen Video Reference to Video in Muse Code?
Turn a project's visual brief into short video assets with sound. Use HeyGen Video to test a shot's composition, motion, and style before placing it in the interface.
Product B-roll
Make a short shot of a product resting on a counter, with a slow camera move and room sound. Keep detailed handling out of the scene.
Hospitality mood shots
Create a brief hotel, café, or lounge scene for a promotional edit. Specify the light, camera position, and background sound.
Ad storyboard tests
Test a single advertising shot before committing to a full sequence. Compare how different framing and lighting choices communicate the same idea.
Stylized social shorts
Build a short anime or clay scene around one simple action. Direct its sound as carefully as its appearance.
Short spoken introductions
Create a brief introduction with a stationary subject and one short line of dialogue. Keep gestures simple and review the result before using it.
Animate approved artwork
Start with an approved illustration and add a simple movement with sound. Choose HeyGen Video Image to Video when the artwork must be the opening frame.
Place an existing product in a new setting
Use a product reference to brief a new scene around its recognizable appearance, such as a ceramic cup on a café counter.
More on HeyGen Video Reference to Video and Muse Code
Overview
HeyGen Video Reference to Video in other agents
Questions about HeyGen Video Reference to Video in Muse Code
Can Muse Code use HeyGen Video Reference to Video?
Yes. Add Spiral to Muse Code as an MCP server, and Muse Code can find and run HeyGen Video Reference to Video like any built-in tool.
How much does HeyGen Video Reference to Video cost in Muse Code?
`resolution`: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on `duration`, default 5. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Muse Code plan is separate.
Do I need a fal account to use HeyGen Video Reference to Video in Muse Code?
No. Spiral runs HeyGen Video Reference to Video on its own fal account. You sign in to Spiral once and never paste a key.
How long does it take to set up HeyGen Video Reference to Video in Muse Code?
About two minutes: install Muse Code, then ask Muse to add the server, then sign in.
Does Muse Code wait while HeyGen Video Reference to Video runs?
HeyGen Video Reference to Video runs in the background. Muse Code starts the run, checks on it and gives you the video when it's ready.
What is HeyGen Video useful for?
Use it for short scenes with sound: product B-roll, ad concepts, location shots, and stylized shorts. Give each shot one clear subject and one action.
Does HeyGen Video generate sound?
Yes. Describe the sound you want alongside the action, such as a machine hum, footsteps, or a short spoken line.
Where does HeyGen Video struggle?
HeyGen flags long on-screen text, delicate motion involving hair or paper, and close hand work as less reliable. For an assembly demonstration, consider a simpler shot and add precise instructions during editing.
How should I write a HeyGen Video prompt?
Describe one subject doing one thing, then specify the camera, lens, movement, lighting, and sound. A concrete shot description gives you a clearer brief to revise than a broad request for a cinematic video.
When should I turn prompt enhancement off?
Turn it off when you want to preserve an already detailed brief. Leave enhancement on when you want the model to expand a short idea.
Start using HeyGen Video Reference to Video in Muse Code
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Muse Code:
set up https://spiral.ai/SKILL.md


