Launch Week I / Day 4: Introducing Firecrawl /v1

Welcome to Day 4 of Firecrawl’s Launch Week! Today, we’re thrilled to announce our biggest release yet: Firecrawl /v1.

Introducing Firecrawl /v1

Firecrawl v1 is a more reliable and developer-friendly API that makes gathering any web data seamless. We’ve packed this release with numerous improvements and new features to enhance your web scraping experience. Let’s dive into the exciting updates!

1. New Scrape Formats

With v1, you now have the flexibility to choose your output formats. From markdown to screenshots, get your data exactly how you want it. You can even specify multiple output formats in a single request!

2. Improved Crawl Status

We’ve significantly enhanced our crawl status results:

• Pagination by default for easy content streaming
• A ‘next’ parameter to show which URL to query next
• Improved clarity on errors, credits used, and crawl expiration

3. Enhanced Markdown Parsing

Our markdown parsing has been upgraded, with improved content cleaning by default. The onlyMainContent option is now set to true by default, resulting in cleaner text chunks and improved quality of LLM outputs.

4. V1 Support for All SDKs

We’ve bumped all our SDKs to version 1.0, ensuring full compatibility with the new v1 API. Don’t worry - they’re backwards compatible with v0 too! We’re also excited to introduce two new SDKs: GO and Rust. A big thanks to our amazing contributors @sanixdarker and @kentchiahaohsu for their work on these.

5. New /map Endpoint

As announced yesterday, our new v1 endpoint /map is the fastest way to gather and search for relevant links on a website. If you missed it, check out our previous post for more details.

6. Improved Developer Experience

We’ve enhanced the developer experience across all our API endpoints. This includes reducing complexity and providing more descriptive errors. For a smooth transition, check out our guide on how to migrate from v0: https://docs.firecrawl.dev/migrating-from-v0

A Milestone Achievement

We’re thrilled to announce that we’ve just hit 10,000 GitHub stars! This achievement wouldn’t have been possible without our amazing community, contributors, and partners. Thank you for your continued support and enthusiasm.

Check out our v1 documentation here: https://docs.firecrawl.dev/v1-welcome

And don’t forget to star our GitHub repo: https://github.com/mendableai/firecrawl

Stay tuned for our final day of Launch Week tomorrow. We can’t wait to show you what else we have in store!