Top 200 ReposEXPLORER
Browse agents, categories and pages

Agent tool · unclecode

Crawl4AI

Open-source crawler that turns web pages into LLM-ready Markdown or structured JSON, with deep crawling, a Docker API and an MCP option.

1 use cases · docs.crawl4ai.com

Web Data and Scraping

Planned, not done

Turn public competitor pages into a structured market scan with Crawl4AI

Crawl4AI crawls pages into clean Markdown and extracts fields such as product names and prices with CSS or XPath schemas or an LLM, giving an agent tidy input for a market or competitor comparison.

github.comunclecode/crawl4ai, ollama/ollama

Used for similar jobs