Launch Week II Recap
Welcome to the recap of Firecrawl’s second Launch Week! Over the past seven days, we’ve rolled out a series of exciting new features and enhancements designed to supercharge your web scraping projects. In case you missed any of the announcements, here’s a day-by-day rundown of everything we’ve launched.
Day 1: Introducing the Batch Scrape Endpoint
We kicked off Launch Week II by unveiling our new Batch Scrape Endpoint, allowing you to scrape multiple URLs simultaneously. This feature streamlines bulk data collection, offering both synchronous and asynchronous methods to suit your needs.
Day 2: Introducing Location and Language Settings
On Day 2, we added Geolocation Support to our scraping requests. You can now specify the country and preferred languages to get location-specific content, enhancing the relevance and accuracy of your data.
Day 3: Introducing Credit Packs
Day 3 saw the launch of flexible Credit Packs, starting at just $9/month for 1,000 credits. We also introduced a new Auto Recharge feature, which automatically tops up your account when you’re running low, ensuring uninterrupted scraping.
Day 4: Advanced iframe Scraping
We took iframe handling to the next level on Day 4 with Advanced iframe Scraping. This update includes recursive traversal, cross-origin handling, and dynamic content loading capabilities, making it easier to scrape complex web pages.
Day 5: Introducing Two New Actions
On Day 5, we added two powerful new actions to our scraping toolkit:
- Scrape: Capture page content during interaction sequences.
- Wait for Selector: Wait for specific elements to appear before proceeding, ensuring more reliable automation.
Day 6: Introducing Mobile Scraping and Mobile Screenshots
Day 6 brought Mobile Scraping and Mobile Screenshots to Firecrawl. With mobile device emulation, you can now interact with sites as if from a mobile device—perfect for testing mobile-specific content and responsive designs.
Day 7: Introducing Faster Markdown Parsing
We wrapped up Launch Week II on Day 7 by unveiling our new HTML to Markdown parser. Rebuilt from scratch, it’s now up to 4x faster, more reliable, and produces cleaner Markdown, enhancing your data processing workflows.
Thank you for joining us during Launch Week II! We hope these new features empower you to build even more powerful and efficient scraping applications.
Happy scraping!
About the Author
Eric Ciarla is the Chief Operating Officer (COO) of Firecrawl and leads marketing. He also worked on Mendable.ai and sold it to companies like Snapchat, Coinbase, and MongoDB. Previously worked at Ford and Fracta as a Data Scientist. Eric also co-founded SideGuide, a tool for learning code within VS Code with 50,000 users.
More articles by Eric Ciarla
How to Create an llms.txt File for Any Website
Learn how to generate an llms.txt file for any website using the llms.txt Generator and Firecrawl.
Cloudflare Error 1015: How to solve it?
Cloudflare Error 1015 is a rate limiting error that occurs when Cloudflare detects that you are exceeding the request limit set by the website owner.
Build an agent that checks for website contradictions
Using Firecrawl and Claude to scrape your website's data and look for contradictions.
Why Companies Need a Data Strategy for Generative AI
Learn why a well-defined data strategy is essential for building robust, production-ready generative AI systems, and discover practical steps for curation, maintenance, and integration.
Getting Started with OpenAI's Predicted Outputs for Faster LLM Responses
A guide to leveraging Predicted Outputs to speed up LLM tasks with GPT-4o models.
How to easily install requests with pip and python
A tutorial on installing the requests library in Python using various methods, with usage examples and troubleshooting tips
How to quickly install BeautifulSoup with Python
A guide on installing the BeautifulSoup library in Python using various methods, with usage examples and troubleshooting tips
How to Use OpenAI's o1 Reasoning Models in Your Applications
Learn how to harness OpenAI's latest o1 series models for complex reasoning tasks in your apps.