firecrawl-build-crawl

Integrate Firecrawl `/crawl` into product code for bulk extraction across a site or site section. Use when a feature needs many related pages, such as…

INSTALLATION
npx skills add https://github.com/firecrawl/skills --skill firecrawl-build-crawl
Run in your project or agent environment. Adjust flags if your CLI version differs.

SKILL.md

Firecrawl Build Crawl

Use this when the product needs many pages from the same site, not just one.

Use This When

  • the feature targets a docs section, blog, or help center
  • you need bulk extraction with path or depth boundaries
  • the product should ingest or refresh a site section at once

Guidance

  • Keep crawl scope narrow with path, depth, or page-count constraints.
  • Prefer /crawl over many manual /scrape calls when the site structure is stable.
  • Treat this as secondary to /scrape, /search, and /interact unless the feature is clearly site-wide.

When Not To Use It

Docs (Source of Truth)

Read the docs for request/response schemas, parameters, and SDK examples before writing integration code:

See Also

BrowserAct

Let your agent run on any real-world website

Bypass CAPTCHA & anti-bot for free. Start local, scale to cloud.

Explore BrowserAct Skills →

Stop writing automation&scrapers

Install the CLI. Run your first Skill in 30 seconds. Scale when you're ready.

Start free
free · no credit card