We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
monocrawl-cliMCP serverMCP
by monocrawl
Unknown

Connect Claude Code, Codex, Cursor, VS Code and five more AI agents to Monocrawl in one command, with browser sign-in. Live public data from 70+ platforms, no API key to copy.

Web ScrapingSocial Media~75%
npm:monocrawl-cli · local package15/wkpublished 1 mo ago
@cyanheads/jinaai-mcp-serverMCP serverMCP
by cyanheads
Unknown

A Model Context Protocol (MCP) server that provides intelligent web reading capabilities using the Jina AI Reader API. It extracts clean, LLM-ready content from any URL.

Monitoring & ObservabilityWeb ScrapingData Extraction~71%
npm:@cyanheads/jinaai-mcp-server · local package15/wkpublished 15 mo ago
@x360airuntest/agentAgent
by x360-sputta
Unknown

X360AIRunTest Web Agent

Testing~100%Browser AutomationWeb Scraping
npm:@x360airuntest/agent · local package15/wkpublished 6 mo ago
toolcenter-mcpMCP serverMCP
by chmesa
Unknown

The Swiss-Army MCP server for web tools — one install, 15 LLM-ready tools: web search, scraping, screenshots, SEO/a11y audits, DNS/WHOIS/SSL, and more.

Web SearchWeb ScrapingSEO
npm:toolcenter-mcp · local package15/wkpublished 6 mo ago
ecobrowserMCP serverMCP
by haidare
Unknown

AI-native browser framework — the AI's hands and eyes on the web. Structured (no-pixel) perception, verified self-healing actions, incremental diff perception, a live view — as a TypeScript library and an MCP server.

Browser AutomationWeb Scraping
npm:ecobrowser · local package14/wkpublished 1 mo ago
@crawlmap/mcpMCP serverMCP
by m.tanveer
Unknown

Crawlmap MCP server: give Claude, Cursor and other AI agents tools to crawl sites, read pages as Markdown and extract structured data.

Web Scraping
npm:@crawlmap/mcp · local package14/wkpublished 1 mo ago
@marrowdev/cloud-mcpMCP serverMCP
by takaki2
Unknown

Marrow MCP server — web scrape/search/crawl/screenshot + flat-rate change monitoring, for AI agents. Cheaper and easier than building it yourself.

Web Scraping
npm:@marrowdev/cloud-mcp · local package14/wkpublished 3 mo ago
fearch-mcpMCP serverMCP
by funkyfunc
Unknown

Respectful web search and page reading for AI agents: an MCP server and CLI that identify themselves honestly, honour robots.txt, and treat a refusal as final.

Web SearchBrowser AutomationWeb Scraping~69%
npm:fearch-mcp · local package13/wkpublished 2 mo ago
vaaya-cliMCP serverMCP
by marupelkar
Unknown

Install Vaaya for paid APIs and supported tokenized shares through MCP. Prepaid funding and authorized Instinct Checkout guide: https://vaaya.ai/llms.txt

PaymentsBrowser AutomationImage GenerationVideo GenerationWeb Search
npm:vaaya-cli · local package13/wkpublished 2 mo ago
@joinmassive/mcp-serverMCP serverMCP
by joinmassive
Unknown

Official MCP server for the Massive Web Render API. Real-time web access for AI agents — fetch any URL, search Google, query AI chatbots — with JS rendering, captcha solving, and 195+ country geo-targeting.

Web Scraping
npm:@joinmassive/mcp-server · local package13/wkpublished 5 mo ago
lacspace-mcpMCP serverMCP
by thelacspace
Unknown

MCP server that gives AI agents (Claude Code, Claude Desktop, Cursor, VS Code, Windsurf) the Lacspace tools: fetch and scrape pages, crawl sites, extract PDF/DOCX/PPTX/EPUB, audit SEO, enrich domains, check uptime and TLS, validate emails, find leads. One

Web ScrapingMonitoring & ObservabilityEmail~100%SEO~94%People & Company Research~71%
npm:lacspace-mcp · local package12/wkpublished 1 mo ago
yok-akademikMCP serverMCP
by rasitnarcicek
Unknown

YÖK Akademik — Canlı Akademik Veri Kazıma, AI Agent (MCP) ve Dışa Aktarım Paketi

Academic Research~68%Web Scraping~66%
npm:yok-akademik · local package12/wkpublished 2 mo ago
@0pen1/scrapingdog-mcpMCP serverMCP
by 0pen1
Unknown

MCP server for Scrapingdog — web scraping, screenshots, and Google/Bing/DuckDuckGo/Baidu search tools.

Web ScrapingWeb Search
npm:@0pen1/scrapingdog-mcp · local package12/wkpublished 3 mo ago
opencode-spicrawlMCP serverMCP
by spicrawl
Unknown

Spicrawl plugin for OpenCode: adds the Spicrawl MCP server so agents can scrape web pages to Markdown or JSON

Web ScrapingVector SearchData Extraction~71%
npm:opencode-spicrawl · local package11/wkpublished 3 d ago
@iflow-mcp/cherchyk-mcpbrowserMCP serverMCP
by chatflowdev
Unknown

MCP browser server - fetch web pages using real Chrome/Edge/Brave browser. Handles authentication, SSO, CAPTCHAs, and anti-bot protection. Browser automation for AI assistants.

Web ScrapingBrowser AutomationIdentity & AccessCloud PlatformsVersion Control~64%
npm:@iflow-mcp/cherchyk-mcpbrowser · local package11/wkpublished 7 mo ago
@fredericsuretat/x402-mcpMCP serverMCP
by fredericsuretat
Unknown

MCP server for x402 pay-per-use API services (suretat.com) — USDC micropayments on Base

PaymentsWeb Scraping
npm:@fredericsuretat/x402-mcp · local package11/wkpublished 5 mo ago
x402-mcp-serverMCP serverMCP
by jameswilliamwisdom
Unknown

MCP server for the x402 API Network — screenshot, PDF, crypto sentiment, web scraping, shallow site crawl, file conversion, web search, email, and audio transcription tools with USDC micropayments on Base

Speech RecognitionDocument Conversion~100%Web SearchWeb ScrapingPayments
npm:x402-mcp-server · local package11/wkpublished 7 mo ago
@nxavis/agent-browser-mcpMCP serverMCP
by s991045
Unknown

MCP server integrating with Vercel's agent-browser for AI-driven browser automation

CI/CD & DeployBrowser AutomationWeb Scraping
npm:@nxavis/agent-browser-mcp · local package11/wkpublished 10 mo ago
seaportalMCP serverMCP
by pinchtaborg
Unknown

HTTP-first web content extraction for AI agents: Markdown, accessibility snapshots, sitemap/feed parsing, and an MCP server

Data Extraction~100%Web Scraping
npm:seaportal · local package11/wkpublished 4 mo ago
skillboss-mcp-serverMCP serverMCP
by xiaoyinqu
Unknown

SkillBoss MCP Server — the wallet for AI agents. Access 354+ tools (web scraping, search, image/video/audio generation, email, 100+ LLMs) via Model Context Protocol. Implements Agent Shopping Protocol v0.1 with x402 + MPP payment rails.

Web ScrapingPayments~100%Image GenerationWeb SearchE-commerce Operations~66%
npm:skillboss-mcp-server · local package11/wkpublished 7 mo ago
← Previouspage 136 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather