Article·npmjs.com
automationdata-pipelinesweb-developmentragllmfirecrawl-clifirecrawl
firecrawl-cli
Scrape and crawl websites directly from your terminal using Firecrawl-cli. Extract structured data for AI models, RAG systems, or data-driven projects, bypassing complex custom scripts for rapid data acquisition.
beginner5 min3 steps
The play
- Install Firecrawl CLIInstall the Firecrawl command-line interface globally using npm.
- Crawl a Target URLExecute the `firecrawl crawl` command, specifying the URL, output file, and desired output mode (e.g., `markdown`).
- Access Extracted DataOpen the generated output file (e.g., `firecrawl_data.json`) to view the structured content extracted from the website.
Starter code
firecrawl crawl --url https://www.firecrawl.dev/ --output firecrawl_data.json --mode markdown
Source