MCP server for Scraping — REST API wrapper for LLM agents.
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"scraping-mcp","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# scraping-mcp MCP (Model Context Protocol) server for [Scraping](https://scraping.io) — lets LLM agents (Cursor, Claude Desktop, Claude Code, Zed) call our scraping tools directly. ## Install ```bash pip install scraping-mcp # or with pipx for isolation: pipx install scraping-mcp ``` Requires Python 3.11+. ## Hosted alternative (no install) If you don't want to install Python locally, point your MCP client at the hosted instance: ```json { "mcpServers": { "scraping": { "url": "https://api.scraping.io/mcp/", "transport": "http", "headers": { "Authorization": "Bearer fc_live_..." } } } } ``` The hosted version exposes the same 7 tools as the stdio package. ## Setup Get an API key at [dashboard/keys](https://api.scraping.io/dashboard/keys). ### Claude Desktop Add to `~/Library/Application Support/Claude/claude_desktop_config.json` (macOS) / `%APPDATA%\Claude\claude_desktop_config.json` (Windows): ```json { "mcpServers": { "scraping": { "command": "scraping-mcp", "env": { "SCRAPING_API_KEY": "fc_live_abc123...", "SCRAPING_BASE_URL": "https://api.scraping.io" } } } } ``` Restart Claude Desktop. Tools will appear as "scraping". ### Cursor Create `.cursor/mcp.json` in the repo root: ```json { "mcpServers": { "scraping": { "command": "scraping-mcp", "env": { "SCRAPING_API_KEY": "fc_live_abc123..." } } } } ``` ### Claude Code Add to `~/.claude.json` (user scope): ```json { "mcpServers": { "scraping": { "command": "scraping-mcp", "env": { "SCRAPING_API_KEY": "fc_live_abc123..." } } } } ``` ## Tools | Tool | Description | |---|---| | `scrape(url, format?, cookies?, timeout_s?)` | Scrape single URL. Returns markdown or `{status:pending, task_id}` on timeout. | | `crawl(urls[], cookies?, timeout_s?)` | Batch-scrape up to 500 URLs. Returns items or `{status:pending, crawl_id}` on timeout. | | `cancel_crawl(crawl_id)` | C…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.