Mar 19, 2025Building an Open-Source Project Monitoring Tool with Firecrawl and StreamlitLearn how to create a tool that monitors trending GitHub repositories and sends notifications to Slack using Firecrawl and Streamlit.By Bex TuychievExplore ArticlesAllProduct UpdatesTutorialsCustomer StoriesTips & ResourcesConverting Entire Websites into Agents with Firecrawl's LLMs.txt Endpoint and OpenAI Agents SDKLearn how to transform any website into an interactive conversational agent by combining Firecrawl's LLMs.txt endpoint with OpenAI Agents SDK.By Bex TuychievMar 17, 2025Building a Local Deep Research Application with Firecrawl and StreamlitLearn to build a web research tool that explores sources, synthesizes information, and provides comprehensive answers with citations using Firecrawl's new Deep Research endpoint and Streamlit.By Bex TuychievMarch 12, 2025Modern Tech Stack for Retrieval Augmented Generation (RAG)Learn about the essential components and tools for building effective RAG systems that enhance LLM capabilities with external knowledge retrieval, including when to build from scratch versus using existing solutions.By Bex TuychievMar 10, 2025How to Build a Client Relationship Tree Visualization Tool in PythonBuild an application that discovers and visualizes client relationships by scraping websites with Firecrawl and presenting the data in an interactive tree structure using Streamlit and PyVis.By Bex TuychievMar 7, 2025LLM API Engine: How to Build a Dynamic API Generation Engine Powered by FirecrawlBuild a dynamic API generation engine that transforms web data into structured APIs using natural language instead of code.By Bex TuychievFeb 26, 2025Building a Clone of OpenAI's Deep Research with TypeScript and FirecrawlBuild an open-source alternative to OpenAI's Deep Research using TypeScript, Firecrawl, and LLMs.By Bex TuychievFeb 24, 2025How to Create Custom Instruction Datasets for LLM Fine-tuningA comprehensive guide to creating instruction datasets for fine-tuning LLMs, including best practices and a practical code documentation example.By Bex TuychievFeb 18, 2025Fine-tuning DeepSeek R1 on a Custom Instructions DatasetLearn how to fine-tune DeepSeek R1 language models using custom instruction datasets.By Bex TuychievFeb 18, 2025How Replit Uses Firecrawl to Power Replit AgentDiscover how Replit leverages Firecrawl to keep Replit Agent up to date with the latest API documentation and web content.By Zhen LiFeb 17, 2025Building an Intelligent Code Documentation RAG Assistant with DeepSeek and FirecrawlA guide to building a documentation assistant that uses DeepSeek and RAG to intelligently answer questions about any documentation website.By Bex TuychievFeb 10, 2025Automated Data Collection - A Comprehensive GuideA comprehensive guide to building robust automated data collection systems using modern tools and best practices.By Bex TuychievFeb 2, 2025Building an AI Resume Job Matching App With Firecrawl And ClaudeBuild an AI-powered job matching system that automatically scrapes job postings and matches them to your resume using Claude, Firecrawl, and Streamlit.By Bex TuychievFeb 1, 2025Scraping Company Data and Funding Information in Bulk With Firecrawl and ClaudeLearn how to scrape company and funding data from Crunchbase using Firecrawl and Claude.By Bex TuychievJan 31, 2025Mastering the Extract Endpoint in FirecrawlLearn how to use Firecrawl's extract endpoint to automatically gather structured data from any website using AI.By Bex TuychievJan 23, 2025Introducing /extract: Get structured web data with just a promptOur new /extract endpoint harnesses AI to turn any website into structured data for your applications seamlessly.By Eric CiarlaJanuary 20, 2025How to Build a Bulk Sales Lead Extractor in Python Using AILearn how to build an AI-powered sales lead extraction tool in Python that automatically scrapes company information from websites.By Bex TuychievJan 12, 2025Building a Trend Detection System with AI in TypeScript: A Step-by-Step GuideBuild an automated trend detection system in TypeScript that monitors content, analyzes it with AI, and sends Slack alerts.By Bex TuychievJan 11, 2025How to Build an Automated Competitor Price Monitoring System with PythonLearn how to build an automated price monitoring system in Python to track and compare competitor prices across e-commerce sites.By Bex TuychievJan 6, 2025How Stack AI Uses Firecrawl to Power AI AgentsDiscover how Stack AI leverages Firecrawl to seamlessly feed agentic AI workflows with high-quality web data.By Jonathan KleimanJan 3, 2025BeautifulSoup4 vs. Scrapy - A Comprehensive Comparison for Web Scraping in PythonA comprehensive comparison of BeautifulSoup4 and Scrapy to help you choose the right Python web scraping tool.By Bex TuychievDec 24, 202415 Python Web Scraping Projects: From Beginner to AdvancedA comprehensive guide to 15 Python web scraping projects that progress from beginner to advanced skill levels.By Bex TuychievDec 17, 2024How to Deploy Python Web ScrapersLearn how to deploy Python web scrapers using GitHub Actions, Heroku, PythonAnywhere and more.By Bex TuychievDec 16, 2024Why Companies Need a Data Strategy for Generative AILearn why a well-defined data strategy is essential for building robust, production-ready generative AI systems, and discover practical steps for curation, maintenance, and integration.By Eric CiarlaDec 15, 2024Data Enrichment: A Complete Guide to Enhancing Your Data QualityA comprehensive guide to enriching your data quality using modern tools, best practices, and real-world examples.By Bex TuychievDec 14, 2024A Complete Guide Scraping Authenticated Websites with cURL and FirecrawlLearn how to scrape login-protected websites using cURL and Firecrawl API.By Rudrank RiyamDec 13, 2024Building an Automated Price Tracking ToolLearn how to build an automated price tracker in Python that monitors e-commerce prices and sends alerts when prices drop.By Bex TuychievDec 9, 2024Evaluating Web Data Extraction with CrawlBenchAn in-depth exploration of CrawlBench, a benchmark for testing LLM-based web data extraction.By SwyxDec 9, 2024How Cargo Empowers GTM Teams with FirecrawlSee how Cargo uses Firecrawl to instantly analyze webpage content and power Go-To-Market workflows for their users.By Tariq MinhasDec 6, 2024Web Scraping Automation: How to Run Scrapers on a ScheduleLearn how to automate web scraping in Python using free scheduling tools to run scrapers reliably in 2025.By Bex TuychievDec 5, 2024How to Generate Sitemaps Using Firecrawl's /map Endpoint: A Complete GuideA comprehensive guide to generating XML and visual sitemaps with Firecrawl's /map endpoint.By Bex TuychievNov 29, 2024How to Use Firecrawl's Scrape API: Complete Web Scraping TutorialLearn how to scrape websites using Firecrawl's /scrape endpoint. Master JavaScript rendering, structured data extraction, and batch operations with Python code examples.By Bex TuychievNov 25, 2024How to Create an llms.txt File for Any WebsiteLearn how to generate an llms.txt file for any website using the llms.txt Generator and Firecrawl.By Eric CiarlaNov 22, 2024Mastering Firecrawl's Crawl Endpoint: A Complete Web Scraping GuideLearn how to use Firecrawl's /crawl endpoint for efficient web scraping. Master URL control, performance optimization, and integration with LangChain for AI-powered data extraction.By Bex TuychievNov 18, 2024Getting Started with OpenAI's Predicted Outputs for Faster LLM ResponsesA guide to leveraging Predicted Outputs to speed up LLM tasks with GPT-4o models.By Eric CiarlaNov 5, 2024Launch Week II RecapRecapping all the exciting announcements from Firecrawl's second Launch Week.By Eric CiarlaNovember 4, 2024Launch Week II - Day 7: Introducing Faster Markdown ParsingOur new HTML to Markdown parser is 4x faster, more reliable, and produces cleaner Markdown, built from the ground up for speed and performance.By Eric CiarlaNovember 3, 2024Launch Week II - Day 6: Introducing Mobile Scraping and Mobile ScreenshotsInteract with sites as if from a mobile device using Firecrawl's new mobile device emulation.By Eric CiarlaNovember 2, 2024Launch Week II - Day 5: Introducing New ActionsCapture page content at any point and wait for specific elements with our new Scrape and Wait for Selector actions.By Eric CiarlaNovember 1, 2024Launch Week II - Day 4: Advanced iframe ScrapingWe are thrilled to announce comprehensive iframe scraping support in Firecrawl, enabling seamless handling of nested iframes, dynamically loaded content, and cross-origin frames.By Eric CiarlaOctober 31, 2024Launch Week II - Day 3: Introducing Credit PacksEasily top up your plan with Credit Packs to keep your web scraping projects running smoothly. Plus, manage your credits effortlessly with our new Auto Recharge feature.By Eric CiarlaOctober 30, 2024Launch Week II - Day 2: Introducing Location and Language SettingsSpecify country and preferred languages to get relevant localized content, enhancing your web scraping results with region-specific data.By Eric CiarlaOctober 29, 2024Launch Week II - Day 1: Introducing the Batch Scrape EndpointOur new Batch Scrape endpoint lets you scrape multiple URLs simultaneously, making bulk data collection faster and more efficient.By Eric CiarlaOctober 28, 2024Getting Started with Grok-2: Setup and Web Crawler ExampleA detailed guide on setting up Grok-2 and building a web crawler using Firecrawl.By Nicolas CamaraOct 21, 2024OpenAI Swarm Tutorial: Create Marketing Campaigns for Any WebsiteA guide to building a multi-agent system using OpenAI Swarm and Firecrawl for AI-driven marketing strategiesBy Nicolas CamaraOct 12, 2024Using OpenAI's Realtime API and Firecrawl to Talk with Any WebsiteBuild a real-time conversational agent that interacts with any website using OpenAI's Realtime API and Firecrawl.By Nicolas CamaraOct 11, 2024Scraping Job Boards Using Firecrawl Actions and OpenAIA step-by-step guide to scraping job boards and extracting structured data using Firecrawl and OpenAI.By Eric CiarlaSept 27, 2024Build a Full-Stack AI Web App in 12 MinutesBuild a Full-Stack AI Web App in 12 minutes with Cursor, OpenAI o1, V0, Firecrawl & PatchedBy Dev DigestSep 18, 2024How to Use OpenAI's o1 Reasoning Models in Your ApplicationsLearn how to harness OpenAI's latest o1 series models for complex reasoning tasks in your apps.By Eric CiarlaSep 16, 2024Handling 300k requests per day: an adventure in scalingPutting out fires was taking up all our time, and we had to scale fast. This is how we did it.By Gergő Móricz (mogery)Sep 13, 2024How Athena Intelligence Empowers Enterprise Analysts with FirecrawlDiscover how Athena Intelligence leverages Firecrawl to fuel its AI-native analytics platform for enterprise analysts.By Ben ReillySep 10, 2024Launch Week I RecapA look back at the new features and updates introduced during Firecrawl's inaugural Launch Week.By Eric CiarlaSeptember 2, 2024Launch Week I / Day 7: Crawl Webhooks (v1)New /crawl webhook support. Send notifications to your apps during a crawl.By Nicolas CamaraSeptember 1, 2024Launch Week I / Day 6: LLM Extract (v1)Extract structured data from your web pages using the extract format in /scrape.By Nicolas CamaraAugust 31, 2024Launch Week I / Day 5: Real-Time Crawling with WebSocketsOur new WebSocket-based method for real-time data extraction and monitoring.By Eric CiarlaAugust 30, 2024Launch Week I / Day 4: Introducing Firecrawl /v1Our biggest release yet - v1, a more reliable and developer-friendly API for seamless web data gathering.By Eric CiarlaAugust 29, 2024Launch Week I / Day 3: Introducing the Map EndpointOur new Map endpoint enables lightning-fast website mapping for enhanced web scraping projects.By Eric CiarlaAugust 28, 2024Launch Week I / Day 2: 2x Rate LimitsFirecrawl doubles rate limits across all plans, supercharging your web scraping capabilities.By Eric CiarlaAugust 27, 2024Launch Week I / Day 1: Introducing TeamsOur new Teams feature, enabling seamless collaboration on web scraping projects.By Eric CiarlaAugust 26, 2024How to Use Prompt Caching and Cache Control with Anthropic ModelsLearn how to cache large context prompts with Anthropic Models like Opus, Sonnet, and Haiku for faster and cheaper chats that analyze website data.By Eric CiarlaAug 14, 2024Building Knowledge Graphs from Web Data using CAMEL-AI and FirecrawlA guide on constructing knowledge graphs from web pages using CAMEL-AI and FirecrawlBy Wendong FanAug 13, 2024How Gamma Supercharges Onboarding with FirecrawlSee how Gamma uses Firecrawl to instantly generate websites and presentations to 20+ million users.By Jon NoronhaAug 8, 2024How to Use OpenAI's Structured Outputs and JSON Strict ModeA guide for getting structured data from the latest OpenAI models.By Eric CiarlaAug 7, 2024Introducing Fire Engine for FirecrawlThe most scalable, reliable, and fast way to get web data for Firecrawl.By Eric CiarlaAug 6, 2024Firecrawl July 2024 UpdatesDiscover the latest features, integrations, and improvements in Firecrawl for July 2024.By Eric CiarlaJuly 31, 2024Firecrawl June 2024 UpdatesDiscover the latest features, integrations, and improvements in Firecrawl for June 2024.By Nicolas CamaraJune 30, 2024Scrape and Analyze Airbnb Data with Firecrawl and E2BLearn how to scrape and analyze Airbnb data using Firecrawl and E2B in a few lines of code.By Nicolas CamaraMay 23, 2024Build a 'Chat with website' using Groq Llama 3Learn how to use Firecrawl, Groq Llama 3, and Langchain to build a 'Chat with your website' bot.By Nicolas CamaraMay 22, 2024Using LLM Extraction for Customer InsightsUsing LLM Extraction for Insights and Lead Generation using Make and Firecrawl.By Caleb PefferMay 21, 2024Extract website data using LLMsLearn how to use Firecrawl and Groq to extract structured data from a web page in a few lines of code.By Nicolas CamaraMay 20, 2024Build an agent that checks for website contradictionsUsing Firecrawl and Claude to scrape your website's data and look for contradictions.By Eric CiarlaMay 19, 2024🔥Ready to Build?Start scraping web data for your AI apps today.No credit card needed.Get Started
