We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
webresearcher-mcp-serverMCP server
by Lukasz Kielbus
Unknown

Standalone web-research MCP server: DuckDuckGo search + headless Camoufox page scrape/crawl (zero Firecrawl)

Web Scraping
pypi:webresearcher-mcp-server · local packagepublished 2 mo ago
webread-mcpMCP server
Unknown

MCP server for reading webpages and web search

Web Scraping~66%
pypi:webread-mcp · local packagepublished 9 mo ago
web-mcp-toolsMCP server
Unknown

Firecrawl-backed web fetch MCP server with browser cookie support

Web Scraping~85%
pypi:web-mcp-tools · local packagepublished 7 mo ago
web-fetch-mcpMCP server
Unknown

Resilient web-fetch MCP server: 3-tier escalation (curl_cffi -> Patchright -> nodriver) that fails honestly, with article-extraction mode and automatic content-type handling (HTML/JSON/PDF/image).

Web ScrapingBrowser Automation
pypi:web-fetch-mcp · local packagepublished 4 mo ago
web-explorer-mcpMCP server
by Sergei Konovalov
Unknown

MCP server for web search and content extraction using SearxNG

Web Scraping
pypi:web-explorer-mcp · local packagepublished 13 mo ago
webcrawl-mcpMCP server
by Andy Liszewski
Unknown

Lightweight MCP server for web scraping, search, and crawling — local-first with optional Firecrawl fallback

Web Scraping
pypi:webcrawl-mcp · local packagepublished 7 mo ago
WaveXisMCPMCP serverMCP
by MathiasPaulenko
Unknown

220 browser automation tools for Chrome, Edge, and Firefox via CDP + BiDi. 100% Python.

Browser AutomationWeb Scraping
pypi:wavexis-mcp · local packagepublished 1 mo ago
universal-mcp-scraperMCP server
Unknown

A Universal MCP Application: universal_mcp_scraper

Web Scraping~100%
pypi:universal-mcp-scraper · local packagepublished 15 mo ago
universal-mcp-firecrawlMCP server
Unknown

A Universal MCP Application: universal_mcp_firecrawl

Web Scraping~100%
pypi:universal-mcp-firecrawl · local packagepublished 15 mo ago
unblockapi-mcpMCP server
Unknown

MCP server for UnblockAPI — captcha solving, browser rendering, temp email, SMS verification, screenshots, and web search for AI agents

Browser AutomationWeb ScrapingEmail~100%SMS & Voice~94%
pypi:unblockapi-mcp · local packagepublished 3 mo ago
twscrape Twitter/X (read-only)MCP serverMCP
by jsilets
Unknown

Read-only X/Twitter MCP: posts, threads, replies, search via twscrape. No API key.

Social MediaWeb Scraping
pypi:twscrape-twitter-mcp · local packagepublished 2 mo ago
thordata-mcp-serverMCP server
Unknown

Official MCP Server for Thordata - Give your AI Agents real-time web scraping superpowers.

Web ScrapingBrowser AutomationWeb Search
pypi:thordata-mcp-server · local packagepublished 9 mo ago
tavily-firecrawl-mcpMCP server
by bpzx
Unknown

MCP server for web fetching with Tavily (primary) and Firecrawl (fallback), plus Tavily search.

Web SearchWeb Scraping
pypi:tavily-firecrawl-mcp · local packagepublished 5 mo ago
taiwan-law-history-mcpMCP server
Unknown

Model Context Protocol server for Taiwan law history and article scraping from Legislative Yuan database

Web ScrapingContracts & Legal
pypi:taiwan-law-history-mcp · local packagepublished 1 mo ago
spider-mcp-clientMCP server
by Spider MCP Team
Unknown

Official Python client for Spider MCP web scraping API

Web ScrapingData ExtractionDeep Web Research
pypi:spider-mcp-client · local packagepublished 14 mo ago
spectre-mcpMCP server
by Pranjal Richhariya
Unknown

104 tools for X/Twitter automation — direct GraphQL/REST API, no browser, no API keys, free.

Social MediaWeb ScrapingAPI Access~81%
pypi:spectre-mcp · local packagepublished 5 mo ago
smart-webfetch-mcpMCP server
by Matt Kelly
Unknown

Context-aware web fetching MCP server that respects token limits

Deep Web ResearchWeb Scraping~77%
pypi:smart-webfetch-mcp · local packagepublished 12 mo ago
sitemap-mcp-serverMCP server
Unknown

Sitemap MCP is a Model Context Protocol (MCP) server for fetching, parsing, analyzing, and visualizing website sitemaps

Reporting & DashboardsWeb Scraping
pypi:sitemap-mcp-server · local packagepublished 2 y ago
singlefile-mcpMCP server
Unknown

MCP server for intelligent web content extraction using single-file and trafilatura

Data Extraction~100%Web Scraping
pypi:singlefile-mcp · local packagepublished 17 mo ago
sessemi-mcpMCP server
Unknown

MCP server for Sessemi — scrape anti-bot protected sites from AI agents

Cloud PlatformsWeb Scraping
pypi:sessemi-mcp · local packagepublished 6 mo ago
← Previouspage 140 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather