olostep/olostep-mcp-server

View on GitHub ↗

MCP server for Olostep — the web scraping, crawling, and search infrastructure used by top AI companies. Gives any MCP-compatible AI agent the ability to scrape, crawl, batch-extract, and search the web in real time.

23 ★9 forksTypeScriptUpdated 1mo ago

What you need to know

The Olostep MCP server integrates with Olostep for web scraping, content extraction and search, offering single and batch scraping of up to 10k URLs, autonomous crawling, site mapping, AI answers with citations and geo-targeted routing.

Install

npx -y olostep-mcp
npm install -g olostep-mcp
docker pull olostep/mcp-server

Key features

  • Scrape to HTML, Markdown, JSON or text
  • Parser-based web search
  • AI answers with citations
  • Batch scraping of up to 10k URLs
  • Autonomous site crawling
  • URL discovery and mapping
  • Country-specific request routing
  • JavaScript rendering with configurable waits

Caveats

  • Requires an Olostep API key
Clients: Cursor · Claude Desktop · Claude Code · Windsurf · VS Code · Metorial

Topics

aiai-agentdata-collectionllm-toolsmcpmcp-scrapermcp-searchmcp-servermodel-context-protocololostep-aiscrapingsearchweb-crawlingweb-scrapingweb-search
Stars
23★
Forks
9
Language
TypeScript
License
MIT
Created
2025-03-11
Last push
2026-07-07