Crawl4AI

An open-source web crawler designed for large-scale web extraction.

Mentioned in

• An open-source web crawler designed for large-scale web extraction. — from Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper