We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2439 liveRefine in search →
docsite-ingest-mcpMCP server
Unknown

Scrape documentation websites, index in Chroma, expose retrieval through MCP

Code DocumentationVector SearchWeb Scraping~66%
pypi:docsite-ingest-mcp · local packagepublished 3 mo ago
doc-builder-mcpMCP server
by NeuralCode Team
Unknown

MCP Server for intelligent documentation scraping, vectorization, and semantic search with dynamic ontology extraction

Code DocumentationWeb ScrapingVector SearchKnowledge Graphs
pypi:doc-builder-mcp · local packagepublished 8 mo ago
dhole-mcpMCP server
Unknown

让 AI 代理访问互联网:抓取 · 爬取 · 搜索,内置反爬,$0 无密钥。Web research for AI agents: fetch, crawl & keyless search with anti-bot bypass.

Web ScrapingData Extraction~71%Cloud Platforms~71%
pypi:dhole-mcp · local packagepublished 8 d ago
dawg-mcpMCP server
by DAWG
Unknown

MCP server for the DAWG platform — remote stealth browser, scraping & account usage for AI agents. Built for Runet: Russian residential proxies and geolocation.

Web ScrapingBrowser Automation
pypi:dawg-mcp · local packagepublished 3 mo ago
datacrawl-mcpMCP server
Unknown

MCP server exposing the Datacrawl API (search/fetch/extract) as agent tools over stdio.

Web SearchWeb Scraping
pypi:datacrawl-mcp · local packagepublished 3 mo ago
crawlnest-mcpMCP server
Unknown

CrawlNest MCP server for web scraping, Twitter, Reddit, GitHub, Hacker News, YC directory, Product Hunt, Google Play Store, Apple App Store, Google Maps, IndieHackers, Quora, SERP web search, LinkedIn, AppSumo, Trustpilot, YouTube, video download, image download, and transcription. Use with Claude …

Social MediaSpeech RecognitionWeb ScrapingVersion ControlE-commerce Operations~100%
pypi:crawlnest-mcp · local packagepublished 3 mo ago
crawl-mcpMCP server
by gqy20
Unknown

基于 crawl4ai 和 FastMCP 的 MCP 服务器,提供网页爬取和搜索功能

Web Scraping~69%
pypi:crawl-mcp · local packagepublished 5 mo ago
crawl4ai-mcp-sse-stdioMCP server
by stgmt
Unknown

MCP (Model Context Protocol) server for Crawl4AI - Universal web crawling and data extraction

Data Extraction~100%Web ScrapingBrowser AutomationProduct Analytics~64%
pypi:crawl4ai-mcp-sse-stdio · local packagepublished 14 mo ago
confluence-scraper-mcpMCP server
Unknown

A Model Context Protocol (MCP) server for Confluence RAG with ChromaDB vector search

Vector SearchNotes & DocsWeb Scraping~73%
pypi:confluence-scraper-mcp · local packagepublished 16 mo ago
computer-use-mcpMCP server
Unknown

Production-ready MCP server providing AI-powered web browsing automation using Gemini 2.5 Computer Use API

Browser AutomationDesktop Control~100%Web Scraping
pypi:computer-use-mcp · local packagepublished 13 mo ago
CN Scraper MCPMCP serverMCP
by goesByhc
Unknown

MCP server for AI agents to search major Chinese internet platforms with local-first login support.

Web Scraping
pypi:cn-scraper-mcp · local packagepublished 3 mo ago
cf-browser-mcpMCP server
Unknown

MCP Server with 17 browser tools for Claude Code — powered by Cloudflare Browser Run

Browser Automation~100%Cloud PlatformsWeb Scraping
pypi:cf-browser-mcp · local packagepublished 19 d ago
cc-web-mcpMCP server
by JcDizzy
Unknown

Claude Code MCP web search and fetch tools for third-party models.

Web SearchWeb Scraping~69%
pypi:cc-web-mcp · local packagepublished 6 mo ago
bypassapi-mcpMCP server
by PESARES
Unknown

MCP server for BypassAPI — web scraping + Cloudflare/CAPTCHA bypass for AI agents

Web ScrapingCloud Platforms
pypi:bypassapi-mcp · local packagepublished 4 mo ago
browser-use-cloud-mcpMCP server
by Pranav Prakash
Unknown

Model Context Protocol (MCP) server for Browser Use Cloud API - automate web browsing tasks with AI

Browser AutomationWeb Scraping
pypi:browser-use-cloud-mcp · local packagepublished 17 mo ago
browser-mcp-automationMCP server
Unknown

Browser automation MCP server with triple engine (static + selenium + playwright)

Browser AutomationWeb Scraping
pypi:browser-mcp-automation · local packagepublished 5 mo ago
doc-scraperMCP serverMCP
by Sriram-PR
Unknown

Crawl documentation sites into local corpora agents can search, read, and diff fully offline.

Web Scraping~100%
no endpoint declared
web-intel-mcpMCP serverMCP
by ArceeDev
Unknown

Metered MCP server: web pages to clean Markdown, metadata, links, SEO audits and tech stack. Billed per call with KeyFlint credits.

Payments~100%SEOWeb ScrapingTerminal & Shell~78%
pypi:web-intel-mcp · local packagepublished 3 d ago
surfsky-mcpMCP serverMCP
by Surfsky SDK contributors
Unknown

MCP server for the Surfsky antidetect cloud browser: scrape, browse and automate bot-protected sites from any MCP host.

Browser AutomationWeb Scraping
pypi:surfsky-mcp · local packagepublished 19 d ago
websearchMCP serverMCP
by SK-DEV-AI
Unknown

Multi-engine web search, fetch, browser control. 11 tools, keyless lanes.

Web SearchWeb Scraping
pypi:skdev-websearch-mcp · local packagepublished 15 d ago
← Previouspage 146 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather