How to Use Firecrawl website content in Zapier
Firecrawl follows a website’s sitemap and links to collect page content as Markdown, HTML, or structured JSON. Use it to research a documentation section or collect material across several pages.
Prompts to try with Firecrawl website content in Zapier
Copy an example into Zapier, or ask in your own words.
Every Monday, use Firecrawl website content to collect https://docs.pydantic.dev/latest/migration/ and relevant linked pages. Compare the returned text with the previous saved collection and summarize changed migration guidance.
Every Wednesday, use Firecrawl website content to collect up to 40 pages under https://nextjs.org/docs/app/building-your-application/upgrading. Report changes found since the previous collection.
Every Friday, use Firecrawl website content to collect up to 25 pages from https://blog.python.org/. Compare returned article titles and text with the previous collection and summarize new release announcements.
Every Monday, use Firecrawl website content to collect https://www.mozilla.org/en-US/firefox/features/ and linked feature pages. Compare the returned descriptions with the previous collection and report wording changes.
Every Thursday, use Firecrawl website content to collect https://docs.astro.build/en/guides/content-collections/ and relevant linked guides. Summarize changed instructions and examples found since the previous collection.
How to set up Firecrawl website content in Zapier
Pick the way that suits you. Each takes about two minutes.
Use the Spiral skill
- Send Zapier this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use Spiral's MCP server
- Add an MCP Client connection
In Zapier open Apps, click Add connection and search for MCP Client. Fill in the form:
https://api.spiral.ai/mcp
- Sign in to Spiral and approve
Spiral opens: sign in, pick the organization and click Authorize. No API key. Spiral gives the connection its own key; Zapier never sees it, and you can remove it under Settings › Connected apps in the console.
- Run a Spiral tool in a Zap
Add an MCP Client step to a Zap and choose the Run Tool action with your Spiral connection. Pick a tool: discover finds the right model for a task, estimate_cost prices it and run runs it. For example, run with:
{ "provider": "fal", "model": "fal-ai/flux/schnell", "input": { "prompt": "a lighthouse at dawn" }, "wait": true } - Run Firecrawl website content in a workflow step
Give the step an instruction like the ones below and run it on your trigger or schedule. Spiral finds Firecrawl website content, prices it and runs it each time the step fires.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run Firecrawl website content
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "firecrawl", "model": "firecrawl/crawl", "input": { "url": "<url>" } }'
Then paste one of the prompts above: Zapier finds Firecrawl website content on Spiral, shows the price and runs it.
Firecrawl website content providers and prices
Spiral runs Firecrawl website content through Firecrawl. Open a card for today's price, with every fee included.
$0.001746 per page crawled ($0.00873 with JSON output). PII redaction, a prompt injection check or lockdown: $0.006984 more per page each.
Settings you can ask for
Ask Zapier for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Delay | a number | Delay in seconds between scrapes. This helps respect website rate limits. Setting this forces concurrency to 1. | |
| Limit | a whole number | 10000 | Maximum number of pages to crawl. Default limit is 10000. |
| Sitemap | skip, include, or only | include | Sitemap mode when crawling. If you set it to 'skip', the crawler will ignore the website sitemap and only crawl the entered URL and discover pages from there onwards. If you set it to 'only', the crawler will only crawl URLs from the sitemap (plus the start URL) and will not discover links from HTML. |
| Max concurrency | a whole number | Maximum number of concurrent scrapes. This parameter allows you to set a concurrency limit for this crawl. If not specified, the crawl adheres to your team's concurrency limit. | |
| Regex on full URL | on or off | off | When true, includePaths and excludePaths regex patterns are matched against the full URL (including query parameters) instead of just the URL pathname. Useful when you need to filter URLs based on query strings. |
| Allow subdomains | on or off | off | Allows the crawler to follow links to subdomains of the main domain. |
| Ignore robots txt | on or off | off | Ignore the website's robots.txt rules. Enterprise only — contact [email protected] to enable. |
| Crawl entire domain | on or off | off | Allows the crawler to follow internal links to sibling or parent URLs, not just child paths. false: Only crawls deeper (child) URLs. → e.g. /features/feature-1 → /features/feature-1/tips ✅ → Won't follow /pricing or / ❌ true: Crawls any internal links, including siblings and parents. → e.g. /features/feature-1 → /pricing, /, etc. ✅ Use true for broader internal coverage beyond nested paths. |
| Max discovery depth | a whole number | Maximum depth to crawl based on discovery order. The root site and sitemapped pages has a discovery depth of 0. For example, if you set it to 1, and you set | |
| Allow external links | on or off | off | Allows the crawler to follow links to external websites. External links are followed one hop (the links found on those external pages are not crawled). Links pointing to an external site's homepage (a root URL with no path) are skipped and reported in Get Crawl Errors with the code EXTERNAL_LINK; redirects to an external homepage are skipped for the same reason. |
| Ignore query parameters | on or off | off | Do not re-scrape the same path with different (or none) query parameters |
Every API field of Firecrawl Crawl · Website Pages is on its tool page: open its card above.
What can you do with Firecrawl website content in Zapier?
Produce a recurring digest of changes found in a public documentation section or company blog. Compare each saved crawl with the previous collection, allowing for Firecrawl’s default two-day cache window.
Build a documentation reference
Collect a public documentation section as Markdown and use its page content to answer implementation questions.
Prepare a migration checklist
Read migration guides across a documentation site and assemble a checklist of changes relevant to your application.
Compare published product capabilities
Collect public product and documentation pages, then compare supported features using passages from the returned content.
Review documentation changes
Compare saved crawls of the same documentation section to identify changed instructions and examples.
Audit your website’s content
Collect your public pages and review their text for outdated descriptions, repeated explanations, and inconsistent terminology.
Create a structured article inventory
Extract article titles, stated publication dates, and topics from a public blog into structured records for editorial review.
More on Firecrawl website content and Zapier
Overview
Firecrawl website content in other agents
Questions about Firecrawl website content in Zapier
Can Zapier use Firecrawl website content?
Yes. Add Spiral to Zapier as an MCP server, and Zapier can find and run Firecrawl website content like any built-in tool.
How much does Firecrawl website content cost in Zapier?
$0.001746 per page crawled ($0.00873 with JSON output). PII redaction, a prompt injection check or lockdown: $0.006984 more per page each. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Zapier plan is separate.
Do I need a Firecrawl account to use Firecrawl website content in Zapier?
No. Spiral runs Firecrawl website content on its own Firecrawl account. You sign in to Spiral once and never paste a key.
How long does it take to set up Firecrawl website content in Zapier?
About two minutes: add an MCP Client connection, then sign in to Spiral and approve, then run a Spiral tool in a Zap.
Does Zapier wait while Firecrawl website content runs?
Firecrawl website content runs in the background. Zapier starts the run, checks on it and gives you the json when it's ready.
What does Firecrawl collect from a website?
Firecrawl discovers pages through sitemaps and links, then returns their content as Markdown, HTML, or structured data. JSON extraction uses AI to turn page content into structured records.
Will a crawl include every page on a site?
Coverage depends on sitemap and link discovery, robots.txt rules, and the crawl’s scope. Firecrawl documents a default cap of 10,000 pages, and an inclusion rule that rejects the starting URL can produce zero results.
How fresh is the returned content?
Firecrawl’s default cache window is two days. A newly requested crawl can therefore include cached page content rather than a new fetch of every page.
Can a large crawl’s results span multiple responses?
Yes. Firecrawl provides a next URL for another 10 MB of data when a response is too large or the crawl is still incomplete.
How long can completed results be retrieved?
Completed crawl results remain retrievable through Firecrawl’s API for 24 hours. Save the returned content within that window if you need it for later comparisons.
Start using Firecrawl website content in Zapier
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Zapier:
set up https://spiral.ai/SKILL.md


