Resilient web-fetch MCP server: 3-tier escalation (curl_cffi -> Patchright -> nodriver) that fails honestly, with article-extraction mode and automatic content-type handling (HTML/JSON/PDF/image).
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"web-fetch-mcp-2","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# web-fetch-mcp [](https://pypi.org/project/web-fetch-mcp/) [](https://pypi.org/project/web-fetch-mcp/) [](https://github.com/Dutta-SD/web-fetch-mcp/actions/workflows/ci.yml) [](https://github.com/Dutta-SD/web-fetch-mcp/blob/main/LICENSE) *A Python MCP server using browser fingerprint impersonation, headless Chrome, and multi-tier anti-detection to reliably fetch web pages for AI agents — published on PyPI with CI/CD pipeline and test coverage.* --- ## What is this? `web-fetch-mcp` is an [MCP](https://modelcontextprotocol.io) server that lets AI assistants (like Claude, Cursor, or any MCP-compatible client) fetch web pages **reliably**. ### The problem it solves When an AI agent fetches a web page, many sites return a CAPTCHA, a JavaScript challenge, or a login wall — but still send HTTP status `200 OK`. A naive fetcher hands this garbage to the AI, which then reasons from nonsense. ### How this tool fixes it `web-fetch-mcp` **detects** when a site returns a block page instead of real content, and either: 1. **Escalates** to a stronger fetching strategy (there are 3 tiers), or 2. **Fails loudly** with a clear error (`FetchBlocked`) — never silently returning junk. > **Status:** Alpha. Core logic is tested, but real-world bypass benchmarks are > in progress. --- ## Installation **Requirements:** Python 3.11+ ```bash pip install web-fetch-mcp ``` That's it. This installs the `web-fetch-mcp` command on your system. --- ## Quick Start ### 1. Run the server ```bash web-fetch-mcp ``` This starts the MCP server in the background. It doesn't show anything on its own — your AI client talks to it automatically. ### 2. Register with your MCP client Add this to your MCP client's configuratio…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.