Launch Week II - Day 5: Introducing New Actions
Welcome to Day 5 of Firecrawl’s second Launch Week! Today, we’re excited to introduce two powerful new actions that will enhance your web scraping capabilities: Scrape and Wait for Selector.
Introducing the New Actions
Firecrawl allows you to perform various actions on a web page before scraping its content. This is particularly useful for interacting with dynamic content, navigating through pages, or accessing content that requires user interaction.
We’re excited to introduce two powerful new actions:
- Scrape: Capture the current page content at any point during your interaction sequence, returning both URL and HTML.
- Wait for Selector: Wait for a specific element to appear on the page before proceeding, ensuring more reliable automation.
Here’s how you can incorporate these new actions:
actions = [
{"type": "scrape"},
{"type": "wait", "selector": "#my-element"},
]
For more details about the actions parameters, refer to the API Reference.
Why Use These New Actions?
- Flexibility: Capture content at multiple points in your interaction flow.
- Reliability: Ensure elements are loaded before proceeding, reducing errors.
- Efficiency: Automate complex navigation and interactions seamlessly.
What’s Next?
That’s a wrap for Day 5 of Launch Week II! Happy scraping, and stay tuned for more exciting updates from Launch Week II!
Ready to Build?
Start scraping web data for your AI apps today.
No credit card needed.
About the Author
Eric Ciarla is the Chief Operating Officer (COO) of Firecrawl and leads marketing. He also worked on Mendable.ai and sold it to companies like Snapchat, Coinbase, and MongoDB. Previously worked at Ford and Fracta as a Data Scientist. Eric also co-founded SideGuide, a tool for learning code within VS Code with 50,000 users.
More articles by Eric Ciarla
How to Create an llms.txt File for Any Website
Learn how to generate an llms.txt file for any website using the llms.txt Generator and Firecrawl.
Cloudflare Error 1015: How to solve it?
Cloudflare Error 1015 is a rate limiting error that occurs when Cloudflare detects that you are exceeding the request limit set by the website owner.
Build an agent that checks for website contradictions
Using Firecrawl and Claude to scrape your website's data and look for contradictions.
Getting Started with OpenAI's Predicted Outputs for Faster LLM Responses
A guide to leveraging Predicted Outputs to speed up LLM tasks with GPT-4o models.
How to easily install requests with pip and python
A tutorial on installing the requests library in Python using various methods, with usage examples and troubleshooting tips
How to quickly install BeautifulSoup with Python
A guide on installing the BeautifulSoup library in Python using various methods, with usage examples and troubleshooting tips
How to Use OpenAI's o1 Reasoning Models in Your Applications
Learn how to harness OpenAI's latest o1 series models for complex reasoning tasks in your apps.
Introducing Fire Engine for Firecrawl
The most scalable, reliable, and fast way to get web data for Firecrawl.