Context-aware web fetching MCP server that respects token limits
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"smart-webfetch-mcp","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# Smart WebFetch MCP Server [](https://pypi.org/project/smart-webfetch-mcp/) [](https://pypi.org/project/smart-webfetch-mcp/) [](https://pypi.org/project/smart-webfetch-mcp/) [](https://opensource.org/licenses/MIT) Context-aware web fetching for LLMs. Prevents context window flooding by checking page size before fetching and providing surgical extraction tools. ## The Problem Standard web fetch tools dump entire pages into the context window, often: - Exceeding token limits - Wasting context on navigation, footers, ads - Flooding the model with irrelevant content ## The Solution Smart WebFetch provides 7 tools for intelligent web fetching: | Tool | Purpose | |------|---------| | `web_preflight` | Check page size before fetching | | `web_smart_fetch` | Fetch with automatic truncation | | `web_fetch_code` | Extract only code blocks | | `web_fetch_section` | Fetch specific heading/section | | `web_fetch_chunked` | Paginated fetching for large docs | | `web_fetch_links` | Extract all links from a page | | `web_fetch_tables` | Extract tables as markdown | ## Installation ```bash # Install from PyPI pip install smart-webfetch-mcp # Or with uvx (recommended for MCP) uvx smart-webfetch-mcp ``` ## Configuration ### Claude Code ```bash claude mcp add --transport stdio smart-webfetch -- uvx smart-webfetch-mcp ``` ### OpenCode Add to your `opencode.json`: ```json { "mcp": { "smart-webfetch": { "type": "local", "command": ["uvx", "smart-webfetch-mcp"], "enabled": true } } } ``` ### Claude Desktop Add to `claude_desktop_config.json`: ```json { "mcpServers": { "smart-webfetch": { "command": "uvx", "args": ["smart-webfetch-mcp"] } } } ``…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.