Spiral gives your agent every tool with one account. Browse the tools →

Muse Code · Web

How to Use Firecrawl web page content in Muse Code

Firecrawl returns one URL's content as Markdown, HTML, structured data, or a screenshot. Use it to read a specific documentation page, product page, or public report without crawling an entire website.

Prompts to try with Firecrawl web page content in Muse Code

Copy an example into Muse Code, or ask in your own words.

Use Firecrawl web page content on https://nextjs.org/docs/app/getting-started/installation. Compare the instructions with this project's package.json and identify any missing requirements.

Firecrawl web page contentMuse Code
Try asking
  • Use Firecrawl web page content on https://react.dev/reference/react/useEffect. Review this project's effects and identify places where the documented cleanup behavior matters.

  • Use Firecrawl web page content on https://docs.python.org/3/library/asyncio-task.html. Compare its task-cancellation guidance with the async workers in this repository and propose specific fixes.

  • Use Firecrawl web page content on https://www.postgresql.org/docs/current/sql-insert.html. Check this project's upsert queries against the documented ON CONFLICT behavior.

  • Use Firecrawl web page content on https://www.rust-lang.org/learn. Save the retrieved page as Markdown in this project's reference directory and draft a learning checklist using only what it contains.

How to set up Firecrawl web page content in Muse Code

Pick the way that suits you. Each takes about two minutes.

Use Spiral's MCP server

  1. Install Muse Code
    curl -fsSL https://dev.meta.ai/install.sh | bash
  2. Ask Muse to add the server

    Start muse and ask:

    Add the Spiral MCP server at https://api.spiral.ai/mcp
  3. Sign in

    In your terminal, run:

    muse mcp login spiral

Use the Spiral skill

  1. Send Muse Code this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run Firecrawl web page content

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "firecrawl",
        "model": "firecrawl/scrape",
        "input": {
          "url": "<url>"
        }
      }'

Then paste one of the prompts above: Muse Code finds Firecrawl web page content on Spiral, shows the price and runs it.

Firecrawl web page content providers and prices

Spiral runs Firecrawl web page content through Firecrawl. Open a card for today's price, with every fee included.

FirecrawlWeb

Settings you can ask for

Ask Muse Code for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Proxybasic, enhanced, or autoauto

Specifies the type of proxy to use.

  • basic: Proxies for scraping sites with none to basic anti-bot solutions.
Max agea whole number172800000

Returns a cached version of the page if it is younger than this age in milliseconds.

Min agea whole number

When set, the request only checks the cache and never triggers a fresh scrape.

Mobileon or offoff

Set to true if you want to emulate scraping from a mobile device. Useful for testing responsive pages and taking mobile screenshots.

Timeout1000 to 30000060000

Timeout in milliseconds for the request. Minimum is 1000 (1 second). Default is 60000 (60 seconds). Maximum is 300000 (300 seconds).

Wait fora whole number up to 600000

Specify a delay in milliseconds before fetching the content, allowing the page sufficient time to load.

Block adson or offon

Enables ad-blocking and cookie popup blocking.

Lockdownon or offoff

If true, serves the request from Firecrawl's cache only and never makes an outbound request to the target URL.

Tool detailcompact, summary, or full

How much of each tool contract to return in data.tools when domainTools is true.

Domain toolson or offoff

When true on an ordinary URL scrape, data.tools lists tool contracts matched to the scraped page's domain (same DiscoveredTool shape as search).

Store in cacheon or offon

If true, the page will be stored in the Firecrawl index and cache.

Only main contenton or offon

Only return the main content of the page excluding headers, navs, footers, etc. This is a deterministic HTML-level filter applied before markdown is generated; no LLM is involved.

Only clean contenton or offoff

Beta. Run an additional LLM-based pass over the generated markdown to remove residual boilerplate that onlyMainContent can miss (cookie banners, ad blocks, social share widgets, breadcrumbs, newsletter signups, comment sections, related-article lists).

Zero data retentionon or offoff

If true, this will enable zero data retention for this scrape. To enable this feature, please contact [email protected]

Remove base64 imageson or offon

Removes all base 64 images from the markdown output, which may be overwhelmingly long.

Skip tls verificationon or offon

Skip TLS certificate verification when making requests.

Check prompt injectionon or offoff

When enabled, scans the page content for prompt injection attempts before any LLM-backed format (such as json, summary or question) runs.

Every API field of Firecrawl Scrape · Web Page Content is on its tool page: open its card above.

What can you do with Firecrawl web page content in Muse Code?

Turn a specific documentation page into a concrete code review or implementation plan. A coding agent can compare Firecrawl's extracted text with project files and cite the instructions behind each proposed change.

Check an implementation against official documentation

Read a specific framework guide and compare its instructions with the project's code. Link each proposed correction to the retrieved documentation.

Build a focused reference collection

Convert selected public documentation pages into Markdown for a support assistant. Retrieve each guide separately so the collection contains the pages people actually need.

Review release notes

Read a software project's public release page and extract changes relevant to an upgrade. Compare later captures to identify newly published notes.

Compare published product specifications

Read named manufacturers' product pages and organize their stated dimensions, materials, and compatibility claims into a comparison table.

Watch public policy pages for revisions

Capture a company's public terms or privacy policy on a schedule. Compare the retrieved text with an earlier capture and report the changed passages.

Read public PDF reports

Extract text from a public report's PDF URL, including scanned documents supported through OCR. Pull out the sections needed for a research brief.

Review a page's visual presentation

Capture a screenshot of a named public page and inspect its headings, layout, and visible content alongside the extracted text.

Firecrawl web page content success rate and speed on Spiral

Success and speed over the last 24 hours, across every run of these tools on Spiral.

Success rate
94.2%
Fastest median run time
3.7s
Runs, last 24 hours
910
ToolSuccessMedian timeRuns
Firecrawl Scrape · Web Page Content94.2%3.7s910

Questions about Firecrawl web page content in Muse Code

Can Muse Code use Firecrawl web page content?

Yes. Add Spiral to Muse Code as an MCP server, and Muse Code can find and run Firecrawl web page content like any built-in tool.

How much does Firecrawl web page content cost in Muse Code?

$0.00175 per page ($0.00873 with JSON output). Each parsed PDF page: $0.00175. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Muse Code plan is separate.

Do I need a Firecrawl account to use Firecrawl web page content in Muse Code?

No. Spiral runs Firecrawl web page content on its own Firecrawl account. You sign in to Spiral once and never paste a key.

How long does it take to set up Firecrawl web page content in Muse Code?

About two minutes: install Muse Code, then ask Muse to add the server, then sign in.

Does Muse Code wait while Firecrawl web page content runs?

Firecrawl web page content runs in the background. Muse Code starts the run, checks on it and gives you the json when it's ready.

Does Firecrawl capture a whole website in one scrape?

Scrape retrieves one URL's page content. A documentation homepage does not include every linked guide; those pages require their own requests or a separate crawl.

How fresh is the returned page?

Firecrawl's default cache window is two days. It can return a cached capture within that window, so request a fresh capture when checking a recently changed announcement or policy.

Can Firecrawl read scanned reports?

Firecrawl supports both text-based and scanned PDFs, including OCR for scanned content. Supply the report's PDF URL to retrieve its extracted content as Markdown.

Does a successful response mean the source page was available?

Firecrawl can report a successful request even when the target website returned an error such as 403 or 404. Check the target page status in the returned metadata before treating the content as a valid capture.

Is structured JSON copied directly from the website?

Firecrawl's JSON mode uses an LLM to extract requested fields from a single page and can follow a supplied schema. Those fields are generated extraction results, rather than necessarily being the website's own underlying JSON.

Get started

Start using Firecrawl web page content in Muse Code

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Muse Code:

Set up Muse Code

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options