BjornMelin/crawl4ai-mcp-server

View on GitHub ↗

Pinned, tested distribution of upstream Crawl4AI with MCP client setup and deployment guidance.

29 ★15 forksShellUpdated 1mo ago

What you need to know

MCP server wrapping Crawl4AI for LLM-friendly web crawling and scraping.

Install

pip install crawl4ai, then register the MCP server in your client.

Usage

  • •Ask the assistant to crawl or scrape web pages and return clean, structured content.

Key features

  • ✓Web crawling
  • ✓LLM-friendly content extraction
  • ✓Clean HTML-to-text conversion
  • ✓Crawl4AI integration

Best for

AI workflows needing clean web content.

Caveats

  • ⚠Respect robots.txt and site terms.
Platforms: MacOS · Linux · Windows

Reviewed 2026-08-11

Topics

ai-toolscrawl4aidockermcp-servermodel-context-protocolweb-crawlingweb-scraping
Stars
29★
Forks
15
Language
Shell
License
MIT
Created
2025-05-04
Last push
2026-07-26