Official Python client for Spider MCP web scraping API
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"spider-mcp-client","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# Spider MCP Client [](https://badge.fury.io/py/spider-mcp-client) [](https://pypi.org/project/spider-mcp-client/) [](https://opensource.org/licenses/MIT) Official Python client for **Spider MCP** - a professional web scraping API with advanced anti-detection capabilities. ## 🚀 Quick Start ### Installation ```bash pip install spider-mcp-client ``` ### Basic Usage ```python from spider_mcp_client import SpiderMCPClient # Initialize client client = SpiderMCPClient( api_key="your-api-key-here", base_url="http://localhost:8003" # Your Spider MCP server ) # Parse a URL result = client.parse_url("https://example.com/article") print(f"Status: {result['status']}") print(f"Title: {result['html_data'].get('title', 'N/A')}") print(f"Parser: {result['status_detail']['parser_used']}") print(f"API Calls: {len(result['api_calls'])}") print(f"Images: {len(result['downloaded_images'])}") ``` ## 📋 Features - ✅ **Simple API** - One method to parse any supported URL - ✅ **Built-in retry logic** - Automatic retries with exponential backoff - ✅ **Rate limiting** - Respectful delays between requests - ✅ **Error handling** - Clear exceptions for different error types - ✅ **Image support** - Optional image download and localization - ✅ **Session isolation** - Multiple isolated browser sessions - ✅ **Type hints** - Full typing support for better IDE experience ## 🔧 API Reference ### SpiderMCPClient ```python client = SpiderMCPClient( api_key="your-api-key", # Required: Your API key base_url="http://localhost:8003", # Spider MCP server URL timeout=30, # Request timeout (seconds) max_retries=3, # Max retry attempts rate_limit_delay=1.0 # Delay between requests (seconds) ) ``` #…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.