MCP server for intelligent web content extraction using single-file and trafilatura
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"singlefile-mcp","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# Single-File MCP Server A powerful Model Context Protocol (MCP) server that provides intelligent web content extraction using [single-file](https://github.com/gildas-lormeau/SingleFile) and [trafilatura](https://github.com/adbar/trafilatura). Perfect for AI agents that need to access and analyze web content from JavaScript-heavy sites. **GitHub Repository**: [https://github.com/kwinsch/singlefile-mcp](https://github.com/kwinsch/singlefile-mcp) ## Features ### 🌐 Universal Web Content Access - **JavaScript Support**: Handles modern SPA/React/Vue apps that require browser rendering - **Clean Content Extraction**: Uses Mozilla's Readability algorithm via trafilatura - **Rich Metadata**: Extracts title, author, date, description, and more - **Multiple Output Formats**: Raw HTML or clean markdown-like content ### 📄 Smart Pagination & Token Management - **Flexible Pagination**: Offset/limit system like file reading tools - **Token Limits**: Configurable max tokens (up to 25,000) - **Smart Truncation**: Summary mode shows beginning + end, truncate mode cuts cleanly - **Navigation Hints**: Clear guidance on how to continue reading large documents ### ⚡ Performance & Control - **Selective Loading**: Block images/scripts for faster processing - **Content Compression**: Optional HTML compression - **Timeout Protection**: Configurable timeouts prevent hanging - **Error Handling**: Graceful degradation when extraction fails ## Installation ### Prerequisites - Python 3.8+ - [single-file CLI](https://github.com/gildas-lormeau/SingleFile) - Web page capture tool - Node.js 16+ (for single-file) - A supported browser (Chromium, Chrome, Edge, Firefox, etc.) ### Install single-file CLI The [single-file CLI](https://github.com/gildas-lormeau/SingleFile/tree/master/cli) is essential for this MCP server to work. It uses a real browser engine to accurately capture JavaScript-rendered content. ```bash npm install -g single-file-cli ``` ## Usage with Claude Code ### Quick Ins…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.