olostep/olostep-mcp-server
View on GitHub ↗MCP server for Olostep — the web scraping, crawling, and search infrastructure used by top AI companies. Gives any MCP-compatible AI agent the ability to scrape, crawl, batch-extract, and search the web in real time.
23 ★9 forksTypeScriptUpdated 1mo ago
What you need to know
The Olostep MCP server integrates with Olostep for web scraping, content extraction and search, offering single and batch scraping of up to 10k URLs, autonomous crawling, site mapping, AI answers with citations and geo-targeted routing.
Install
npx -y olostep-mcp npm install -g olostep-mcp docker pull olostep/mcp-server
Key features
- ✓Scrape to HTML, Markdown, JSON or text
- ✓Parser-based web search
- ✓AI answers with citations
- ✓Batch scraping of up to 10k URLs
- ✓Autonomous site crawling
- ✓URL discovery and mapping
- ✓Country-specific request routing
- ✓JavaScript rendering with configurable waits
Caveats
- ⚠Requires an Olostep API key
Clients: Cursor · Claude Desktop · Claude Code · Windsurf · VS Code · Metorial
Topics
aiai-agentdata-collectionllm-toolsmcpmcp-scrapermcp-searchmcp-servermodel-context-protocololostep-aiscrapingsearchweb-crawlingweb-scrapingweb-search
- Stars
- 23★
- Forks
- 9
- Language
- TypeScript
- License
- MIT
- Created
- 2025-03-11
- Last push
- 2026-07-07