{"$schema":"https://wellknown.network/schemas/agent-record-v1.json","schemaVersion":"1","id":"ag_9w4tn5j77vx9","handle":"iflow-mcp-thewebscrapingclub-ai-cursor-scraping","url":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping","links":{"self":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/record.json","html":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping","markdown":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/record.md","api":"https://wellknown.network/api/v1/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping","status":"https://wellknown.network/api/v1/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/status","claim":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/claim","claimApi":"https://wellknown.network/api/v1/claims","claimDescriptor":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/claim.json","badge":"https://wellknown.network/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/badge.svg","openapi":"https://wellknown.network/openapi.json","history":"https://wellknown.network/api/v1/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/history","tools":"https://wellknown.network/api/v1/agents/iflow-mcp-thewebscrapingclub-ai-cursor-scraping/tools"},"ard":{"identifier":"urn:air::server:iflow-mcp-thewebscrapingclub-ai-cursor-scraping","type":"application/mcp-server-card+json"},"kind":"mcp_server","declared":{"name":"iflow-mcp_thewebscrapingclub-ai-cursor-scraping-assistant","summary":"AI-powered Cursor assistant for web scraping using MCP protocol","description":"# AI-Cursor-Scraping-Assistant\n\nA powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to easily generate web scrapers for various types of websites. This project helps you quickly analyze websites and generate proper Scrapy or Camoufox scrapers with minimal effort.\n\n## Project Overview\n\nThis project contains two main components:\n\n1. **Cursor Rules** - A set of rules that teach Cursor AI how to analyze websites and create different types of Scrapy spiders\n2. **MCP Tools** - A collection of Model Context Protocol tools that enhance Cursor's capabilities for web scraping tasks\n\n## Prerequisites\n\n- [Cursor AI](https://cursor.sh/) installed\n- Python 3.10+ installed\n- Basic knowledge of web scraping concepts\n\n## Installation\n\nClone this repository to your local machine:\n\n```bash\ngit clone https://github.com/TheWebScrapingClub/AI-Cursor-Scraping-Assistant.git\ncd AI-Cursor-Scraping-Assistant\n```\n\nInstall the required dependencies:\n\n```bash\npip install mcp camoufox scrapy\n```\n\nIf you plan to use Camoufox, you'll need to fetch its browser binary:\n\n```bash\npython -m camoufox fetch\n```\n\n## Setup\n\n### Setting Up MCP Server\n\nThe MCP server provides tools that help Cursor AI analyze web pages and generate XPath selectors. To start the MCP server:\n\n1. Navigate to the MCPfiles directory:\n   ```bash\n   cd MCPfiles\n   ```\n\n2. Update the `CAMOUFOX_FILE_PATH` in `xpath_server.py` to point to your local `Camoufox_template.py` file.\n\n3. Start the MCP server:\n   ```bash\n   python xpath_server.py\n   ```\n\n4. In Cursor, connect to the MCP server by configuring it in the settings or using the MCP panel.\n\n### Cursor Rules\n\nThe cursor-rules directory contains rules that teach Cursor AI how to analyze websites and create different types of scrapers. These rules are automatically loaded when you open the project in Cursor.\n\n## Detailed Cursor Rules Explanation\n\nThe `cursor-rules` directory contains a set of MDC (Markdown Configuration) files that guide Cursor's behavior when c…","publisher":null,"homepage":"https://github.com/TheWebScrapingClub/AI-Cursor-Scraping-Assistant","repository":"https://github.com/TheWebScrapingClub/AI-Cursor-Scraping-Assistant","version":"0.1.0","license":null,"protocols":["mcp"],"tags":["mcp"],"pricing":null,"endpoints":[{"url":"pypi:iflow-mcp_thewebscrapingclub-ai-cursor-scraping-assistant","type":"package_pypi","auth":null,"probeable":false}],"skills":null,"tools":null,"extra":null,"attribution":{"kind":"pypi","name":"pypi","repoUrl":"pypi","summary":"pypi","version":"pypi","description":"pypi","homepageUrl":"pypi"}},"derived":{"capabilities":[{"slug":"data.web-scraping","name":"Web Scraping","confidence":1,"provenance":"derived"},{"slug":"dev.version-control","name":"Version Control","confidence":1,"provenance":"derived"},{"slug":"dev.filesystem","name":"Filesystem","confidence":0.802,"provenance":"derived"}],"categories":["data","dev"],"language":"en"},"observed":{"status":"unknown","statusReason":"Distributed as a package to run locally; no network endpoint to check.","lastOkAt":null,"lastProbedAt":null,"statusComputedAt":null,"reliability30d":null,"latestObservations":[],"tools":null,"package":{"name":"iflow-mcp_thewebscrapingclub-ai-cursor-scraping-assistant","registry":"pypi","observedAt":"2026-09-15T20:21:29.260Z","publishedAt":"2026-02-08T22:43:05.125015Z","latestVersion":"0.1.0"},"toolSurface":null,"endpointFacts":[]},"verification":{"claimed":false,"claimedAt":null,"proofs":[]},"provenance":{"sources":[{"source":"pypi","key":"iflow-mcp_thewebscrapingclub-ai-cursor-scraping-assistant","url":"https://pypi.org/project/iflow-mcp_thewebscrapingclub-ai-cursor-scraping-assistant/","firstSeenAt":"2026-09-09T21:24:24.455Z","fetchedAt":"2026-09-15T20:20:07.866Z","normalizedAt":"2026-09-15T20:20:07.866Z"}]},"firstSeenAt":"2026-09-09T21:24:24.455Z","updatedAt":"2026-09-15T20:21:29.260Z"}