Launch Week I / Day 7: Crawl Webhooks (v1)

Welcome to Day 7 of Firecrawl’s Launch Week! We’re excited to introduce new /crawl webhook support.

You can now pass a webhook parameter to the /crawl endpoint. This will send a POST request to the URL you specify when the crawl is started, updated and completed.

The webhook will now trigger for every page crawled and not just the whole result at the end.

There are now 4 types of events:

• crawl.started - Triggered when the crawl is started.
• crawl.page - Triggered for every page crawled.
• crawl.completed - Triggered when the crawl is completed to let you know it’s done.
• crawl.failed - Triggered when the crawl fails.

• success - If the webhook was successful in crawling the page correctly.
• type - The type of event that occurred.
• id - The ID of the crawl.
• data - The data that was scraped (Array). This will only be non empty on crawl.page and will contain 1 item if the page was scraped successfully. The response is the same as the /scrape endpoint.
• error - If the webhook failed, this will contain the error message.

Learn more about the webhook in our documentation.