{"$schema":"https://wellknown.network/schemas/agent-record-v1.json","schemaVersion":"1","id":"ag_j26fbd9bp7bp","handle":"freecrawl-mcp","url":"https://wellknown.network/agents/freecrawl-mcp","links":{"self":"https://wellknown.network/agents/freecrawl-mcp/record.json","html":"https://wellknown.network/agents/freecrawl-mcp","markdown":"https://wellknown.network/agents/freecrawl-mcp/record.md","api":"https://wellknown.network/api/v1/agents/freecrawl-mcp","status":"https://wellknown.network/api/v1/agents/freecrawl-mcp/status","claim":"https://wellknown.network/agents/freecrawl-mcp/claim","claimApi":"https://wellknown.network/api/v1/claims","claimDescriptor":"https://wellknown.network/agents/freecrawl-mcp/claim.json","badge":"https://wellknown.network/agents/freecrawl-mcp/badge.svg","openapi":"https://wellknown.network/openapi.json","history":"https://wellknown.network/api/v1/agents/freecrawl-mcp/history","tools":"https://wellknown.network/api/v1/agents/freecrawl-mcp/tools"},"ard":{"identifier":"urn:air::server:freecrawl-mcp","type":"application/mcp-server-card+json"},"kind":"mcp_server","declared":{"name":"freecrawl-mcp","summary":"FreeCrawl MCP Server - Self-hosted web scraping and document processing as a Firecrawl replacement","description":"# FreeCrawl MCP Server\n\nA production-ready Model Context Protocol (MCP) server for web scraping and document processing, designed as a self-hosted replacement for Firecrawl.\n\n## 🚀 Features\n\n- **JavaScript-enabled web scraping** with Playwright and anti-detection measures\n- **Document processing** with fallback support for various formats\n- **Concurrent batch processing** with configurable limits\n- **Intelligent caching** with SQLite backend\n- **Rate limiting** per domain\n- **Comprehensive error handling** with retry logic\n- **Easy installation** via `uvx` or local development setup\n- **Health monitoring** and metrics collection\n\n## MCP Config (using `uvx`)\n\n```json\n{\n  \"mcpServers\": {\n    \"freecrawl\": {\n      \"command\": \"uvx\",\n      \"args\": [\"freecrawl-mcp\"],\n    }\n  }\n}\n```\n\n## 📦 Installation & Usage\n\n### Quick Start with uvx (Recommended)\n\nThe easiest way to use FreeCrawl is with `uvx`, which automatically manages dependencies:\n\n```bash\n# Install browsers on first run\nuvx freecrawl-mcp --install-browsers\n\n# Test functionality\nuvx freecrawl-mcp --test\n```\n\n### Local Development Setup\n\nFor local development or customization:\n\n1. **Clone from GitHub:**\n   ```bash\n   git clone https://github.com/dylan-gluck/freecrawl-mcp.git\n   cd freecrawl-mcp\n   ```\n\n2. **Set up environment:**\n   ```bash\n   # Sync dependencies\n   uv sync\n\n   # Install browser dependencies\n   uv run freecrawl-mcp --install-browsers\n\n   # Run tests\n   uv run freecrawl-mcp --test\n   ```\n\n3. **Run the server:**\n   ```bash\n   uv run freecrawl-mcp\n   ```\n\n## 🛠 Configuration\n\nConfigure FreeCrawl using environment variables:\n\n### Basic Configuration\n```bash\n# Transport (stdio for MCP, http for REST API)\nexport FREECRAWL_TRANSPORT=stdio\n\n# Browser pool settings\nexport FREECRAWL_MAX_BROWSERS=3\nexport FREECRAWL_HEADLESS=true\n\n# Concurrency limits\nexport FREECRAWL_MAX_CONCURRENT=10\nexport FREECRAWL_MAX_PER_DOMAIN=3\n\n# Cache settings\nexport FREECRAWL_CACHE=true\nexport FREECRAWL_CACHE_DIR=/tmp/freecrawl_cache…","publisher":null,"homepage":"https://github.com/dylan-gluck/freecrawl-mcp","repository":"https://github.com/dylan-gluck/freecrawl-mcp","version":"0.1.2","license":"MIT","protocols":["mcp"],"tags":["document-processing","firecrawl","mcp","playwright","web-scraping"],"pricing":null,"endpoints":[{"url":"pypi:freecrawl-mcp","type":"package_pypi","auth":null,"probeable":false}],"skills":null,"tools":null,"extra":null,"attribution":{"kind":"pypi","name":"pypi","license":"pypi","repoUrl":"pypi","summary":"pypi","version":"pypi","description":"pypi","homepageUrl":"pypi"}},"derived":{"capabilities":[{"slug":"data.web-scraping","name":"Web Scraping","confidence":1,"provenance":"declared"},{"slug":"infra.browser-automation","name":"Browser Automation","confidence":1,"provenance":"declared"},{"slug":"dev.version-control","name":"Version Control","confidence":0.745,"provenance":"derived"}],"categories":["data","dev","infra"],"language":"en"},"observed":{"status":"unknown","statusReason":"Distributed as a package to run locally; no network endpoint to check.","lastOkAt":null,"lastProbedAt":null,"statusComputedAt":null,"reliability30d":null,"latestObservations":[],"tools":null,"package":{"name":"freecrawl-mcp","registry":"pypi","observedAt":"2026-09-15T15:24:25.878Z","publishedAt":"2025-08-20T03:35:37.003316Z","latestVersion":"0.1.2"},"toolSurface":null,"endpointFacts":[]},"verification":{"claimed":false,"claimedAt":null,"proofs":[]},"provenance":{"sources":[{"source":"pypi","key":"freecrawl-mcp","url":"https://pypi.org/project/freecrawl-mcp/","firstSeenAt":"2026-09-09T15:23:44.722Z","fetchedAt":"2026-09-15T15:22:13.278Z","normalizedAt":"2026-09-15T15:22:13.278Z"}]},"firstSeenAt":"2026-09-09T15:23:44.722Z","updatedAt":"2026-09-15T15:24:25.878Z"}