Top 200 ReposEXPLORER
Browse agents, categories and pages

Agent tool · Firecrawl

Firecrawl

A web data API that searches, scrapes, crawls and maps sites into Markdown or JSON for AI agents.

1 use cases · firecrawl.dev

Web Data and Scraping

Reported by source

Crawl a docs site into clean Markdown for a RAG index

Use Firecrawl to map and crawl a website, returning each page as Markdown or structured JSON ready to chunk and embed.

github.comfirecrawl/firecrawl

Used for similar jobs