Firecrawl June 2024 Updates
We are excited to share our latest updates from June!
TLDR:
- New Integrations live with Gamma, Dify, Praison, and Flowise
- Firecrawl Dashboard Launched
- New tutorials and examples out
- Platform Improvements
Integrations
We’ve been busy collaborating with some amazing partners to bring the power of Firecrawl to more platforms and users. Here are all of our current integrations:
New Integrations:
- Gamma’s new Import from URL feature: With this integration, users can generate entire presentations from any website in under a minute ✨
- Firecrawl now integrates with Dify.ai: Our collaboration with this leading open-source LLM development platform is now live on their open-source repo and Dify cloud.
- Integration with FlowiseAI: Flowise users can now easily add clean web data to their drag-and-drop LLM workflows.
New Dashboard Launched
We are excited to launch our brand new dashboard 🔥
Inside you can do things like:
- View and download data from jobs
- See breakdowns and analytics of usage
- Easily access the playground for testing
Try it out today by logging in and clicking Dashboard!
Platform Improvements
We’re constantly working to enhance Firecrawl’s capabilities and performance.
Here are some notable improvements we’ve made:
- Authenticated Web Scraping: One of our most requested features is now live! With the new headers option, you can forward authentication cookies to scrape data behind auth walls. No more barriers to the data you need.
- Improved Metadata for Scraped Pages: We’ve further enriched the metadata returned for each scraped page.
- SDK Support for Local Instances: You can now use Firecrawl’s Python and Node SDKs locally.
Plus way more, follow us at @firecrawl_dev to see everything we launch!
Fresh Tutorials and Examples
Want to see Firecrawl in action? Check out our examples!
We’ve released these new tutorials and examples:
- Chat with websites locally powered by Firecrawl and Ollama
- Tutorial with Weaviate demoing Generative Feedback Loops
- Cluster common topics from any web page with Firecrawl and E2B
That’s all for this update! Stay tuned for the next one 🚀
Ready to Build?
Start scraping web data for your AI apps today.
No credit card needed.
About the Author
Nicolas Camara is the Chief Technology Officer (CTO) at Firecrawl. He previously built and scaled Mendable, one of the pioneering "chat with your documents" apps, which had major Fortune 500 customers like Snapchat, Coinbase, and MongoDB. Prior to that, Nicolas built SideGuide, the first code-learning tool inside VS Code, and grew a community of 50,000 users. Nicolas studied Computer Science and has over 10 years of experience in building software.
More articles by Nicolas Camara
Extract website data using LLMs
Learn how to use Firecrawl and Groq to extract structured data from a web page in a few lines of code.
Firecrawl x Dify.AI: Add web data to your RAG applications
Learn how Firecrawl integrates with Dify.AI to provide web data to AI applications.
Launch Week I / Day 6: LLM Extract (v1)
Extract structured data from your web pages using the extract format in /scrape.
Launch Week I / Day 7: Crawl Webhooks (v1)
New /crawl webhook support. Send notifications to your apps during a crawl.
Build a 'Chat with website' using Groq Llama 3
Learn how to use Firecrawl, Groq Llama 3, and Langchain to build a 'Chat with your website' bot.
Scrape and Analyze Airbnb Data with Firecrawl and E2B
Learn how to scrape and analyze Airbnb data using Firecrawl and E2B in a few lines of code.
Firecrawl June 2024 Updates
Discover the latest features, integrations, and improvements in Firecrawl for June 2024.