We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
seo-audit-mcpMCP server
Unknown

MCP server for SEO auditing — 105+ criteria Technical + UI analysis for Claude Desktop

SEOWeb Scraping
pypi:seo-audit-mcp · local packagepublished 5 mo ago
seleniumbase-mcpMCP server
by Michael Mintz
Unknown

MCP servers exposing SeleniumBase as tools for MCP clients.

Browser AutomationWeb ScrapingTesting
pypi:seleniumbase-mcp · local packagepublished 4 d ago
searxNcrawlMCP serverMCP
by DasDigitaleMomentum
Unknown

Web search via SearXNG and/or You.com, plus clean Markdown crawling via Crawl4AI. Self-hosted.

Web SearchWeb Scraping~66%
pypi:searxncrawl · local packagepublished 3 d ago
search-fusion-mcpMCP server
by sailaoda
Unknown

🔍 High-Availability Multi-Engine Search Aggregation MCP Server with Enhanced Proxy Auto-Detection

Web SearchWeb Scraping
pypi:search-fusion-mcp · local packagepublished 15 mo ago
Screaming Frog SEO Spider MCP Server (headless)MCP serverMCP
by bzsasson
Unknown

Headless Screaming Frog SEO Spider via its CLI: run crawls, export and filter data, no GUI needed.

SEOBrowser Automation~100%Web Scraping
pypi:screaming-frog-mcp · local packagepublished 22 d ago
screamingfrog-audit-mcpMCP server
by Muhammad Shahid
Unknown

Drive the Screaming Frog SEO Spider from any MCP client: headless crawls, a ranked issue register, derived analysis and a shareable report.

Web ScrapingSEO
pypi:screamingfrog-audit-mcp · local packagepublished 2 mo ago
scrapy-mcpMCP server
by Eitan Hadar
Unknown

Headless web-scraping MCP server built on Scrapy: fetch, extract (CSS/XPath), links, tables, sitemaps, robots, and async crawls.

Web Scraping
pypi:scrapy-mcp · local packagepublished 5 mo ago
scraping-mcpMCP server
Unknown

MCP server for Scraping — REST API wrapper for LLM agents.

Web Scraping~100%API Access~86%
pypi:scraping-mcp · local packagepublished 7 mo ago
scraperapi-mcp-serverMCP server
by ScraperAPI
Unknown

ScraperAPI MCP server

Web Scraping
pypi:scraperapi-mcp-server · local packagepublished 4 mo ago
scrape-n-search-mcpMCP server
Unknown

MCP server unifying web-search and scraping providers behind a few agent tools

Web Scraping
pypi:scrape-n-search-mcp · local packagepublished 18 d ago
scrapedatshi-mcpMCP server
Unknown

MCP server for the scrapedatshi RAG pipeline API — use scrapedatshi tools directly from Claude Desktop

Vector SearchWeb ScrapingDatabases~68%
pypi:scrapedatshi-mcp · local packagepublished 4 mo ago
ScrapeBadgerMCP serverMCP
by scrape-badger
Unknown

Twitter/X scraping for AI agents: profiles, tweets, followers, trends, lists and communities.

Social MediaWeb ScrapingWeb Search
pypi:scrapebadger-mcp · local packagepublished 5 d ago
scm-crawler-mcp-serverMCP server
Unknown

中化采购平台公告抓取 MCP 服务

Web Scraping~73%
pypi:scm-crawler-mcp-server · local packagepublished 2 mo ago
scheduler-mcpMCP server
Unknown

MCP server for AVC course scheduling and registration analysis with web scraping, prerequisite validation, and schedule optimization

Web ScrapingCalendar & SchedulingScheduling & Cron~77%Reasoning & Planning~68%
pypi:scheduler-mcp · local packagepublished 5 mo ago
rezvan-linkedin-mcpMCP server
Unknown

MCP server for LinkedIn profile, company, and job scraping with Claude AI integration. Supports direct profile/company/job URL scraping with secure credential storage.

Social MediaWeb Scraping
pypi:rezvan-linkedin-mcp · local packagepublished 7 mo ago
reddit-no-auth-mcp-serverMCP server
Unknown

A Model Context Protocol Server for Reddit — browse, search, and read Reddit from any MCP client, with or without Reddit API credentials.

Web ScrapingIdentity & Access~67%
pypi:reddit-no-auth-mcp-server · local packagepublished 15 d ago
realtimex-web-scraping-mcp-serverMCP server
Unknown

A Model Context Protocol (MCP) server for web scraping using Crawl4AI

Web ScrapingData Extraction~71%
pypi:realtimex-web-scraping-mcp-server · local packagepublished 12 mo ago
pydoll-mcpMCP server
Unknown

Revolutionary Model Context Protocol (MCP) server for PyDoll browser automation with zero-webdriver operation and intelligent captcha bypass

Browser AutomationCloud PlatformsWeb ScrapingTesting
pypi:pydoll-mcp · local packagepublished 16 mo ago
proxyclaw-mcp-serverMCP server
Unknown

ProxyClaw MCP Server — MCP tools for residential proxy fetching, browser rendering, and structured web extraction

Browser Automation~100%Web Scraping
pypi:proxyclaw-mcp-server · local packagepublished 7 mo ago
powersearch-mcpMCP server
Unknown

PowerSearch MCP helps AI agents search and retrieve content from the public web with fewer broken fetches and clean, AI-friendly outputs ready to cite.

Web ScrapingDeep Web Research
pypi:powersearch-mcp · local packagepublished 10 mo ago
← Previouspage 141 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather