DiscordSign up
SKILLS.SH

firecrawl-crawl

Bulk extract content from entire websites or site sections with depth and path filtering. Crawls pages following links up to configurable depth limits and page counts, with path inclusion/exclusion filters to scope extraction Supports async job polling or synchronous waiting with progress display via --wait and --progress flags Offers concurrency control, request delays, and JSON output formatting for integration into agent workflows Part of a four-step escalation pattern: search → scrape → map → crawl, used when single-page extraction is insufficient

INSTALLATION
npx skills add https://github.com/firecrawl/cli --skill firecrawl-crawl
Run in your project or agent environment. Adjust flags if your CLI version differs.

SKILL.md

$2a

Check status of a running crawl

firecrawl crawl

## Options

| Option                    | Description                                 |

| ------------------------- | ------------------------------------------- |

| `--wait`                  | Wait for crawl to complete before returning |

| `--progress`              | Show progress while waiting                 |

| `--limit <n>`             | Max pages to crawl                          |

| `--max-depth <n>`         | Max link depth to follow                    |

| `--include-paths <paths>` | Only crawl URLs matching these paths        |

| `--exclude-paths <paths>` | Skip URLs matching these paths              |

| `--delay <ms>`            | Delay between requests                      |

| `--max-concurrency <n>`   | Max parallel crawl workers                  |

| `--pretty`                | Pretty print JSON output                    |

| `-o, --output <path>`     | Output file path                            |

## Tips

- Always use `--wait` when you need the results immediately. Without it, crawl returns a job ID for async polling.

- Use `--include-paths` to scope the crawl — don't crawl an entire site when you only need one section.

- Crawl consumes credits per page. Check `firecrawl credit-usage` before large crawls.

## See also

- [firecrawl-scrape](../firecrawl-scrape/SKILL.md) — scrape individual pages

- [firecrawl-map](../firecrawl-map/SKILL.md) — discover URLs before deciding to crawl

- [firecrawl-download](../firecrawl-download/SKILL.md) — download site to local files (uses map + scrape)
BrowserAct

Let your agent run on any real-world website

Bypass CAPTCHA & anti-bot for free. Start local, scale to cloud.

Explore BrowserAct Skills →

Related skills

launch-strategy
3/3

Structured framework for planning product launches, feature announcements, and go-to-market strategies. Organizes launches across five phases (internal, alpha, beta, early access, full) with specific actions and goals for each stage Uses the ORB framework to balance owned channels (email, blog, community), rented channels (social, app stores), and borrowed channels (guest posts, influencers, partnerships) Includes dedicated Product Hunt strategy with pre-launch preparation, launch-day tactics, and post-launch conversion guidance Provides launch checklist covering pre-launch setup, launch-day coordination, and post-launch user education and retention Emphasizes treating launches as ongoing moments rather than one-time events, with guidance on spacing feature announcements and maintaining momentum

coreyhaines31
SKILLS.SH
56.2K29.8K
2026-05-21
competitor-alternatives
2/3

SEO-optimized competitor comparison and alternative pages that position your product against rivals. Covers four page formats: singular alternatives, plural alternatives, you vs. competitor, and competitor vs. competitor comparisons Includes centralized competitor data architecture for consistent, maintainable information across all comparison pages Provides structured research process covering product features, pricing, reviews, and customer feedback with quarterly update cadence Emphasizes honest positioning that acknowledges competitor strengths and clearly defines who each product serves best

coreyhaines31
SKILLS.SH
54.3K29.8K
2026-05-21
firecrawl-search
1/3

Web search with optional full-page content extraction from results. Returns real search results as JSON with optional --scrape flag to fetch complete page markdown for each result, avoiding redundant fetches Supports filtering by source type (web, images, news), category (GitHub, research, PDF), time range (past hour/day/week/month/year), location, and country Use --limit to control result count and --scrape-formats to customize output formats when extracting full content Part of a workflow escalation pattern: search first to discover URLs, then use dedicated scrape/map/crawl skills for deeper extraction

firecrawl
SKILLS.SH
43.3K414
2026-05-21
customer-research
3/3

When the user wants to conduct, analyze, or synthesize customer research. Use when the user mentions &quot;customer research,&quot; &quot;ICP research,&quot; &quot;talk to customers,&quot;…

coreyhaines31
SKILLS.SH
34.3K29.8K
2026-05-21

Stop writing automation&scrapers

Install the CLI. Run your first Skill in 30 seconds. Scale when you're ready.

Start free
free · no credit card