remove-paywall-mcp

# remove-paywall-mcp MCP server that removes article paywalls by searching internet archives. Give it a URL, get back the article text. ## How it works 1. You give it a paywalled article URL 2. Tracking params are stripped and the URL is normalized 3. It tries multiple approaches in parallel: - Direct fetch with Googlebot user-agent (FT, WSJ, and many others serve full content to crawlers) - 12ft.io proxy for hard paywalls - iitty textise for plain-text rendering - Wayback Machine CDX API, archive.ph/is mirrors, and Wayback Availability API 4. It extracts the article body with [readability-lxml](https://github.com/buriy/python-readability), stripping navigation, ads, and sidebar cruft 5. Post-extraction check: if the result still contains paywall text (e.g., the snapshot captured the paywall itself), it retries with the next archive 6. It returns clean text with the title and snapshot URL It also learns from every attempt — success rates per domain per archive source are tracked in a local SQLite database, and archive search order is re-ranked automatically using Laplace smoothing. ## Install ```bash # zero-install (recommended — works everywhere uvx is available) uvx remove-paywall-mcp # from PyPI pip install remove-paywall-mcp # from source pip install git+https://github.com/jasval/remove-paywall-mcp.git # Docker docker run -i --rm remove-paywall-mcp docker compose up -d # HTTP mode on port 8000 ``` ## Platform configs Once installed, add this to your MCP client config: ### OpenCode ```json { "mcp": { "remove-paywall": { "type": "local", "command": ["uvx", "remove-paywall-mcp"], "enabled": true } } } ``` ### Claude Desktop ```json { "mcpServers": { "remove-paywall": { "command": "uvx", "args": ["remove-paywall-mcp"] } } } ``` ### LiteLLM ```yaml mcp_tools: remove_paywall: type: "stdio" command: "uvx" args: ["remove-paywall-mcp"] ``` ### Docker (any client) ```json …