How to Use SAM 3.1 Image in Factory Droid
SAM 3.1 Image extracts object masks from photos using short descriptions, points, or boxes. Use it for product cutouts, editing selections, and draft annotations.
Prompts to try with SAM 3.1 Image in Factory Droid
Copy an example into Factory Droid, or ask in your own words.
Use SAM 3.1 Image on the product photos in public/products with the description "shoe." Save each mask beside its source and build an overlay preview for review.
Use SAM 3.1 Image to select "chair" in the room photos under assets/rooms. Request separate masks and bounding boxes, then build a crop review page.
Use SAM 3.1 Image on assets/team.jpg with the description "person." Create a preview that overlays the returned selections on the original photo.
Use SAM 3.1 Image to draft "bottle" masks for the images in data/photos. Save the results as proposed annotations and add an accept-or-reject review screen.
Use SAM 3.1 Image to select the backpack in assets/backpack.jpg, using a box around it to clarify the target. Save the mask and a side-by-side source preview.
How to set up SAM 3.1 Image in Factory Droid
Pick the way that suits you. Each takes about two minutes.
Use Spiral's MCP server
- Add the server
Droid saves it to your user config, ~/.factory/mcp.json, so it works in every project.
droid mcp add spiral https://api.spiral.ai/mcp --type http
- Sign in
Start droid, type /mcp, select spiral and authenticate it. Sign in to Spiral in the browser and click Authorize. No API key.
- Check it
Spiral shows as connected. needs authentication means the sign-in did not finish: run /mcp again.
droid mcp list
Use the Spiral skill
- Send Factory Droid this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run SAM 3.1 Image
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "fal", "model": "fal-ai/sam-3-1/image", "input": { "image_url": "https://raw.githubusercontent.com/facebookresearch/segment-anything-2/main/notebooks/images/truck.jpg" } }'
Then paste one of the prompts above: Factory Droid finds SAM 3.1 Image on Spiral, shows the price and runs it.
SAM 3.1 Image providers and prices
Spiral runs SAM 3.1 Image through fal. Open a card for today's price, with every fee included.
Settings you can ask for
SAM 3.1 Image works from your image URL and prompt. Ask Factory Droid for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Apply mask | on or off | on | Apply the mask on the image. |
| Output format | jpeg, png, or webp | png | The format of the generated image. |
| Return multiple masks | on or off | off | If True, upload and return multiple generated masks as defined by |
| Max masks | 1 to 32 | 3 | Maximum number of masks to return when |
| Include scores | on or off | off | Whether to include mask confidence scores. |
| Include boxes | on or off | off | Whether to include bounding boxes for each mask (when available). |
Every API field of Sam 3 1 · Image to Image is on its tool page: open its card above.
What can you do with SAM 3.1 Image in Factory Droid?
Turn project photos into object selections for asset preparation and annotation tools. A coding agent can save masks beside their source images and build previews for checking them.
Product cutout preparation
Select a shoe, bag, or other product in a photo, then use its mask to prepare a cutout. Inspect the selection before placing it on a new background.
Selective photo edits
Extract a mask for a jacket, chair, or car so an image editor can apply a color or exposure change to that object.
Draft segmentation annotations
Generate object masks for a labeled image dataset. Have an annotator correct the selections before accepting them as training labels.
Object crop preparation
Locate objects in a photo and use their bounding boxes to prepare individual crops for a catalog or review sheet.
Count review
Request separate selections for a visible category, such as chairs or bottles. Compare the masks with the photo to produce a reviewed count.
Redaction preparation
Select visible screens or license plates to prepare masks for a separate blur or pixelation step. Review the full photo for missed regions before sharing.
More on SAM 3.1 Image and Factory Droid
Overview
SAM 3.1 Image in other agents
More Factory Droid guides
Questions about SAM 3.1 Image in Factory Droid
Can Factory Droid use SAM 3.1 Image?
Yes. Add Spiral to Factory Droid as an MCP server, and Factory Droid can find and run SAM 3.1 Image like any built-in tool.
How much does SAM 3.1 Image cost in Factory Droid?
$0.013 per run at the default inputs. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Factory Droid plan is separate.
Do I need a fal account to use SAM 3.1 Image in Factory Droid?
No. Spiral runs SAM 3.1 Image on its own fal account. You sign in to Spiral once and never paste a key.
How long does it take to set up SAM 3.1 Image in Factory Droid?
About two minutes: add the server, then sign in, then check it.
Does Factory Droid wait while SAM 3.1 Image runs?
SAM 3.1 Image runs in the background. Factory Droid starts the run, checks on it and gives you the image when it's ready.
What is SAM 3.1 Image useful for?
Use it to select objects in existing photos. The resulting masks can support product cutouts, selective edits, and draft image annotations.
How should I describe the object I want?
Start with a short phrase such as "red backpack" or "car wheel." Meta documents limitations with longer instructions involving complex spatial relationships, so use a point or box to clarify the target.
Can SAM 3.1 select several objects of the same type?
Concept segmentation targets all matching instances, such as the chairs in a room. Review the returned masks before using them as a count or completed annotation.
What size are the segmentation masks?
Meta's reference implementation resizes binary masks to the original image dimensions. Use those dimensions when aligning a mask with the source photo.
Can I correct a selection with points?
Yes. Points associated with the same object refine its selection; use them when the text description leaves the target ambiguous.
Start using SAM 3.1 Image in Factory Droid
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Factory Droid:
set up https://spiral.ai/SKILL.md


