We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
omni-mcp-serverMCP serverMCP
by bitofacoder
Unknown

All-in-one MCP server: GitHub, Git, Slack, web fetch, memory, and filesystem. Agent Mode opt-in.

Web Scraping~100%Version ControlAgent MemoryTeam ChatFilesystem~88%
npm:@bitofacoder/omni-mcp-server · local package36/wkpublished 5 mo ago
technical-seo-mcpMCP serverMCP
by sourav28
Unknown

MCP server for technical & on-page SEO audits — crawlability, HTTPS, Core Web Vitals, sitemap, robots.txt, structured data, and AI-crawler access. Reports as Markdown, JSON, or a shareable HTML file.

SEOData Extraction~100%Web Scraping
npm:technical-seo-mcp · local package35/wkpublished 22 d ago
@marrowdev/browse-mcpMCP serverMCP
by takaki2
Unknown

Drive your own Chrome from an AI agent, with its logins intact. A local stdio MCP server: it maps what a page affords, acts on it, and hands the keyboard back to you for logins, 2FA and CAPTCHAs instead of solving them.

Browser AutomationWeb Scraping~68%
npm:@marrowdev/browse-mcp · local package35/wkpublished 29 d ago
olx-mcpMCP serverMCP
by l-margiela
Unknown

OLX MCP server that enables Claude Desktop to browse and search OLX listings across multiple domains (PT, PL, BG, RO, UA)

Web Scraping
npm:olx-mcp · local package35/wkpublished 2 mo ago
SEO Tools: A-Parser bridgeMCP serverMCP
by antohins
Unknown

Bridge to a self-hosted A-Parser: SERP, suggests and 150+ parsers via its API (read-only).

SEOWeb SearchWeb Scraping
npm:seo-tools-mcp-aparser · local package35/wkpublished 3 mo ago
llm-crawler-audit-mcpMCP serverMCP
by surendranb85
Unknown

Model Context Protocol (MCP) server for AI & LLM crawler readiness via NPX. Audits robots.txt for AI bots, validates /llms.txt, and verifies markdown mirror content negotiation.

Web Scraping~100%
npm:llm-crawler-audit-mcp · local package34/wkpublished 22 d ago
open-web-bridgeAgent
by woniu9524
Unknown

Drive your real Chrome from any AI agent — logged-in sessions, real fingerprint, live tabs. CLI-based, works with Claude Code, Codex, or any shell.

Browser AutomationWeb Scraping
npm:open-web-bridge · local package34/wkpublished 2 mo ago
@datablue/mcpMCP serverMCP
by datablue
Unknown

Official MCP server for DataBlue web scraping and structured data APIs

Web ScrapingWeb Search
npm:@datablue/mcp · local package32/wkpublished 2 mo ago
@swerverx402/websearch-mcpMCP serverMCP
by swerver
Unknown

MCP server that lets an agent search and scrape the web and pay for it itself — per request in USDC on Base via x402. No API keys.

Web ScrapingBrowser Automation~100%Web Search~79%
npm:@swerverx402/websearch-mcp · local package30/wkpublished 18 d ago
lean-readerMCP serverMCP
by AIMento
Unknown

Token-minimized URL-to-clean-text reader for LLMs, with a token-savings receipt.

Web ScrapingData Extraction~71%
npm:lean-reader · local package30/wkpublished 5 mo ago
mcp-web-toolsMCP serverMCP
by paifas
Unknown

MCP server providing web search tools for AI assistants

Web SearchWeb ScrapingData Extraction~71%
npm:mcp-web-tools · local package30/wkpublished 5 mo ago
@iflow-mcp/jakeliume-webpeelMCP serverMCP
by chatflowdev
Unknown

The web data layer for AI agents — fetch, search, crawl, extract, screenshot, and monitor the web with 55+ domain extractors and MCP.

Data Extraction~100%Web ScrapingBrowser AutomationWeb SearchVector Search
npm:@iflow-mcp/jakeliume-webpeel · local package29/wkpublished 7 mo ago
creatoros-mcpMCP serverMCP
by asvmegh
Unknown

Official Model Context Protocol (MCP) server for CreatorOS — Fast Web-to-Markdown extraction, autonomous agent live web search, and neural text-to-speech for Claude Desktop, Cursor, and Windsurf.

Speech Synthesis~100%Web SearchWeb ScrapingVector Search
npm:creatoros-mcp · local package29/wkpublished 15 d ago
@yansircc/pi-chromeAgent
by yansircc
Unknown

Let Pi use your existing signed-in Chrome profile through Agent-first tools.

Browser AutomationWeb ScrapingDebugging~69%Packages & Dependencies~66%
npm:@yansircc/pi-chrome · local package27/wkpublished 4 mo ago
x402-agent-toolsAgent
by br0ski777
Unknown

102 production-ready AI agent tools with x402 micropayments. Hyperliquid DEX suite, prediction markets, DeFi liquidations, NFT data, trust scoring, B2B enrichment, web scraping, SEO, NLP, Solana, security audits. Pay-per-call USDC on Base L2. Zero API key

Web Scraping~100%PaymentsMarkets & TradingPeople & Company ResearchCI/CD & Deploy~64%
npm:x402-agent-tools · local package27/wkpublished 2 mo ago
@stableproxy/mcpMCP serverMCP
by stableproxy
Unknown

StableProxy MCP server: buy, connect and manage StableProxy proxies from Claude, Cursor, VS Code and other AI assistants.

Web Scraping
npm:@stableproxy/mcp · local package27/wkpublished 1 mo ago
shadowMCP serverMCP
by ryudi84
Unknown

MCP server for CSS box-shadow generation

Web Scraping~66%Version Control~64%Scheduling & Cron~60%SEO~58%
npm:cron-forge-mcp · local package27/wkpublished 9 mo ago
@muxover/js-viewMCP serverMCP
by muxover
Unknown

Render JavaScript-heavy pages in a real browser so AI agents can read them. CLI, MCP server, and HTTP service.

Browser AutomationWeb Scraping
npm:@muxover/js-view · local package27/wkpublished 1 mo ago
mcp-unknowncheatzMCP serverMCP
by amangly
Unknown

MCP server for searching and reading the UnknownCheats forum

Cloud PlatformsBrowser AutomationWeb Scraping
npm:mcp-unknowncheatz · local package27/wkpublished 1 mo ago
@dctwgroo/hybridsearch-mcpMCP serverMCP
by LisonFan
Unknown

Hybrid web search MCP server powered by ChatGPT2API, Tavily, Firecrawl, TinyFish, Exa, and Keenable

Web SearchWeb Scraping
npm:@dctwgroo/hybridsearch-mcp · local package26/wkpublished 2 mo ago
← Previouspage 134 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather