research / agent

unclecode/crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

Skills Outpost does not state this repository's requirements, supported systems or data practices. The repository on GitHub may describe them.

Code on GitHub

unclecode/crawl4ai

Apache-2.0

Python86,321 GitHub stars8,977 GitHub forksLast pushed 26 Oct 2026 UTC

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

Topics: ai ai-agents crawler data-extraction llm markdown mcp open-source

Public GitHub data fetched · 0 days old

View on GitHub ↗
Report a listing concern

What did you see, and where? Please don't include passwords or keys.

We'll only use it to ask you about this report.