How to Use HeyGen Video Reference to Video in Gemini CLI
HeyGen Video Reference to Video puts supplied products, people, or places into a new scene with sound. Unlike HeyGen Video Image to Video, it uses references to guide the scene instead of making one still the opening frame.
Prompts to try with HeyGen Video Reference to Video in Gemini CLI
Copy an example into Gemini CLI, or ask in your own words.
Use HeyGen Video Reference to Video with the project's approved mug photo. Make a 10-second landscape café shot at 1080p, with the mug resting on a counter, warm morning light, a slow push-in, and distant café chatter.
Estimate, then generate a 5-second 9:16 clip with HeyGen Video Reference to Video: a paper boat drifting down a rainy street. Save the result in ./assets.
Make a 10-second product teaser with HeyGen Video Reference to Video for a smartwatch, slow orbit shot, studio lighting.
Generate three 5-second b-roll clips of a busy coffee shop with HeyGen Video Reference to Video and list what each cost.
Make a 6-second 16:9 drone shot over a misty pine forest at sunrise with HeyGen Video Reference to Video.
How to set up HeyGen Video Reference to Video in Gemini CLI
Pick the way that suits you. Each takes about two minutes.
Use Spiral's MCP server
- Add the server
Or add it to ~/.gemini/settings.json yourself:
gemini mcp add --scope user --transport http spiral https://api.spiral.ai/mcp
- Sign in
Start gemini and run:
/mcp auth spiral
- Check it
In Gemini CLI, run /mcp. From your shell:
gemini mcp list
Use the Spiral skill
- Send Gemini CLI this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run HeyGen Video Reference to Video
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "fal", "model": "heygen/heygen-video/reference-to-video", "input": { "prompt": "<prompt>" } }'
Then paste one of the prompts above: Gemini CLI finds HeyGen Video Reference to Video on Spiral, shows the price and runs it.
HeyGen Video Reference to Video providers and prices
Spiral runs HeyGen Video Reference to Video through fal. Open a card for today's price, with every fee included.
resolution: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on duration, default 5.
Settings you can ask for
HeyGen Video Reference to Video works from your prompt, reference image URLs, reference video URLs, and reference audio URLs. Ask Gemini CLI for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Duration | 5 to 15 | 5 | |
| Resolution | 480p, 768p, 1080p, or 2k | 768p | |
| Prompt enhancement | turbo, quality, ultraquality, or disabled | turbo | |
| Seed | 0 to 4294967295 | ||
| Aspect ratio | adaptive, 21:9, 16:9, 4:3, 1:1, 3:4, or 9:16 | adaptive |
Every API field of HeyGen Video Reference to Video is on its tool page: open its card above.
What can you do with HeyGen Video Reference to Video in Gemini CLI?
Turn a project's visual brief into short video assets with sound. Use HeyGen Video to test a shot's composition, motion, and style before placing it in the interface.
Product B-roll
Make a short shot of a product resting on a counter, with a slow camera move and room sound. Keep detailed handling out of the scene.
Hospitality mood shots
Create a brief hotel, café, or lounge scene for a promotional edit. Specify the light, camera position, and background sound.
Ad storyboard tests
Test a single advertising shot before committing to a full sequence. Compare how different framing and lighting choices communicate the same idea.
Stylized social shorts
Build a short anime or clay scene around one simple action. Direct its sound as carefully as its appearance.
Short spoken introductions
Create a brief introduction with a stationary subject and one short line of dialogue. Keep gestures simple and review the result before using it.
Animate approved artwork
Start with an approved illustration and add a simple movement with sound. Choose HeyGen Video Image to Video when the artwork must be the opening frame.
Place an existing product in a new setting
Use a product reference to brief a new scene around its recognizable appearance, such as a ceramic cup on a café counter.
More on HeyGen Video Reference to Video and Gemini CLI
Overview
HeyGen Video Reference to Video in other agents
Questions about HeyGen Video Reference to Video in Gemini CLI
Can Gemini CLI use HeyGen Video Reference to Video?
Yes. Add Spiral to Gemini CLI as an MCP server, and Gemini CLI can find and run HeyGen Video Reference to Video like any built-in tool.
How much does HeyGen Video Reference to Video cost in Gemini CLI?
`resolution`: 480p $0.026, 768p (default) $0.026, 2k $0.078, 1080p $0.078 per second. Billed on `duration`, default 5. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Gemini CLI plan is separate.
Do I need a fal account to use HeyGen Video Reference to Video in Gemini CLI?
No. Spiral runs HeyGen Video Reference to Video on its own fal account. You sign in to Spiral once and never paste a key.
How long does it take to set up HeyGen Video Reference to Video in Gemini CLI?
About two minutes: add the server, then sign in, then check it.
Does Gemini CLI wait while HeyGen Video Reference to Video runs?
HeyGen Video Reference to Video runs in the background. Gemini CLI starts the run, checks on it and gives you the video when it's ready.
What is HeyGen Video useful for?
Use it for short scenes with sound: product B-roll, ad concepts, location shots, and stylized shorts. Give each shot one clear subject and one action.
Does HeyGen Video generate sound?
Yes. Describe the sound you want alongside the action, such as a machine hum, footsteps, or a short spoken line.
Where does HeyGen Video struggle?
HeyGen flags long on-screen text, delicate motion involving hair or paper, and close hand work as less reliable. For an assembly demonstration, consider a simpler shot and add precise instructions during editing.
How should I write a HeyGen Video prompt?
Describe one subject doing one thing, then specify the camera, lens, movement, lighting, and sound. A concrete shot description gives you a clearer brief to revise than a broad request for a cinematic video.
When should I turn prompt enhancement off?
Turn it off when you want to preserve an already detailed brief. Leave enhancement on when you want the model to expand a short idea.
Start using HeyGen Video Reference to Video in Gemini CLI
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Gemini CLI:
set up https://spiral.ai/SKILL.md


