{"$schema":"https://wellknown.network/schemas/agent-record-v1.json","schemaVersion":"1","id":"ag_u9dc7kw66w39","handle":"crawl4ai-mcp","url":"https://wellknown.network/agents/crawl4ai-mcp","links":{"self":"https://wellknown.network/agents/crawl4ai-mcp/record.json","html":"https://wellknown.network/agents/crawl4ai-mcp","markdown":"https://wellknown.network/agents/crawl4ai-mcp/record.md","api":"https://wellknown.network/api/v1/agents/crawl4ai-mcp","status":"https://wellknown.network/api/v1/agents/crawl4ai-mcp/status","claim":"https://wellknown.network/agents/crawl4ai-mcp/claim","claimApi":"https://wellknown.network/api/v1/claims","claimDescriptor":"https://wellknown.network/agents/crawl4ai-mcp/claim.json","badge":"https://wellknown.network/agents/crawl4ai-mcp/badge.svg","openapi":"https://wellknown.network/openapi.json","history":"https://wellknown.network/api/v1/agents/crawl4ai-mcp/history","tools":"https://wellknown.network/api/v1/agents/crawl4ai-mcp/tools"},"ard":{"identifier":"urn:air::server:crawl4ai-mcp","type":"application/mcp-server-card+json"},"kind":"mcp_server","declared":{"name":"crawl4ai-mcp","summary":"A web crawler using Model Context Protocol (MCP)","description":"# Web Crawler MCP\n\n[![English](https://img.shields.io/badge/lang-en-blue.svg)](README.md) [![中文](https://img.shields.io/badge/lang-zh-blue.svg)](lang/README.zh.md) [![हिंदी](https://img.shields.io/badge/lang-hi-blue.svg)](lang/README.hi.md) [![Español](https://img.shields.io/badge/lang-es-blue.svg)](lang/README.es.md) [![Français](https://img.shields.io/badge/lang-fr-blue.svg)](lang/README.fr.md) [![العربية](https://img.shields.io/badge/lang-ar-blue.svg)](lang/README.ar.md) [![বাংলা](https://img.shields.io/badge/lang-bn-blue.svg)](lang/README.bn.md) [![Русский](https://img.shields.io/badge/lang-ru-blue.svg)](lang/README.ru.md) [![Português](https://img.shields.io/badge/lang-pt-blue.svg)](lang/README.pt.md) [![Bahasa Indonesia](https://img.shields.io/badge/lang-id-blue.svg)](lang/README.id.md)\n\n![Python](https://img.shields.io/badge/Python-3.9%2B-blue)\n![License](https://img.shields.io/badge/License-MIT-green)\n\nA powerful web crawling tool that integrates with AI assistants via the MCP (Machine Conversation Protocol). This project allows you to crawl websites and save their content [...]\n\n## 📋 Features\n\n- Website crawling with configurable depth\n- Support for internal and external links\n- Generation of structured Markdown files\n- Native integration with AI assistants via MCP\n- Detailed crawl result statistics\n- Error and not found page handling\n\n## 🚀 Installation\n\n### Prerequisites\n\n- Python 3.9 or higher\n\n### Installation Steps\n\n1. Clone this repository:\n\n```bash\ngit clone laurentvv/crawl4ai-mcp\ncd crawl4ai-mcp\n```\n\n2. Create and activate a virtual environment:\n\n```bash\n# Windows\npython -m venv .venv\n.venv\\Scripts\\activate\n\n# Linux/MacOS\npython -m venv .venv\nsource .venv/bin/activate\n```\n\n3. Install the required dependencies:\n\n```bash\n# Using pip\npip install -r requirements.txt\n\n# Using UV (recommended)\npip install uv  # If UV is not yet installed\nuv venv\nuv pip install -e .\n```\n\n### Using UV (Modern Python Package Manager)\n\nThis project now supports [UV](https:/…","publisher":null,"homepage":null,"repository":null,"version":"0.1.0","license":"MIT","protocols":["mcp"],"tags":["mcp"],"pricing":null,"endpoints":[{"url":"pypi:crawl4ai-mcp","type":"package_pypi","auth":null,"probeable":false}],"skills":null,"tools":null,"extra":null,"attribution":{"kind":"pypi","name":"pypi","license":"pypi","summary":"pypi","version":"pypi","description":"pypi"}},"derived":{"capabilities":[{"slug":"dev.package-management","name":"Packages & Dependencies","confidence":0.859,"provenance":"derived"},{"slug":"dev.version-control","name":"Version Control","confidence":0.791,"provenance":"derived"},{"slug":"data.web-scraping","name":"Web Scraping","confidence":0.779,"provenance":"derived"}],"categories":["data","dev"],"language":"en"},"observed":{"status":"unknown","statusReason":"Distributed as a package to run locally; no network endpoint to check.","lastOkAt":null,"lastProbedAt":null,"statusComputedAt":null,"reliability30d":null,"latestObservations":[],"tools":null,"package":{"name":"crawl4ai-mcp","registry":"pypi","observedAt":"2026-11-09T02:26:00.945Z","publishedAt":"2025-05-05T13:32:32.086060Z","latestVersion":"0.1.0"},"toolSurface":null,"endpointFacts":[]},"verification":{"claimed":false,"claimedAt":null,"proofs":[]},"provenance":{"sources":[{"source":"pypi","key":"crawl4ai-mcp","url":"https://pypi.org/project/crawl4ai-mcp/","firstSeenAt":"2026-09-09T13:20:41.865Z","fetchedAt":"2026-11-09T02:24:58.715Z","normalizedAt":"2026-11-09T02:24:58.715Z"}]},"firstSeenAt":"2026-09-09T13:20:41.865Z","updatedAt":"2026-11-09T02:26:00.945Z"}