We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
Fetch URL MCP ServerMCP serverMCP
by j0hanz
Unknown

An MCP server that fetches web pages and converts them to clean, readable Markdown.

Web Scraping~100%Data Extraction~71%
npm:@j0hanz/fetch-url-mcp · local package540/wkpublished 7 mo ago
@tirthlabs/browser-flow-mcpMCP serverMCP
by tirth-parikh
Unknown

Write browser automations in YAML and run them from the CLI, cron, or as MCP tools that AI agents (Claude, Cursor, VS Code) can call. Powered by Playwright.

Browser AutomationWeb ScrapingWorkflow Automation~75%
npm:@tirthlabs/browser-flow-mcp · local package540/wkpublished 22 d ago
Prerender BuddyMCP serverMCP
by kopachlager
Unknown

Crawler diagnostics, AI visibility evidence and article drafts for review in Prerender Buddy.

Web ScrapingSEO~58%
npm:@prerenderbuddy/mcp · local package517/wkpublished 12 d ago
hyperbrowser-mcpMCP serverMCP
by a_harmless_pyro
Unknown

Hyperbrowser Model Context Protocol Server

Web ScrapingData Extraction~71%
npm:hyperbrowser-mcp · local package512/wkpublished 2 y ago
zabreuit-mcpMCP serverMCP
by zabreuit26
Unknown

Universal MCP Server for AI Agents (Claude Desktop, Cursor, Windsurf) - Fast, Zero-Browser Web Extraction & 100 Commercial Presets

Web ScrapingVector SearchE-commerce Operations
npm:zabreuit-mcp · local package510/wkpublished 12 d ago
claude-api-web-search-mcpMCP serverMCP
by dccxx
Unknown

A Model Context Protocol server that provides web search via Claude API and web fetch tools for AI assistants

Web SearchWeb Scraping~100%
npm:claude-api-web-search-mcp · local package509/wkpublished 9 mo ago
puppeteer-mcp-claudeMCP serverMCP
by jaenster
Unknown

Browser automation MCP server for Claude, powered by Puppeteer.

Browser AutomationWeb Scraping
npm:puppeteer-mcp-claude · local package505/wkpublished 6 mo ago
ainative-browser-mcpMCP serverMCP
by AINative-Studio
Unknown

AI-powered browser automation MCP — 6 tools for web interaction, extraction, and validation.

Data Extraction~100%Browser AutomationWeb ScrapingPeople & Company Research~71%Agent Memory~64%
npm:@ainative/browser-mcp · local package503/wkpublished 1 mo ago
@sostag/scraping-bot-mcpMCP serverMCP
by sostag
Unknown

MCP server for ScrapingBot: let Claude, Cursor and other AI agents scrape web pages, products, real estate, travel, search engines and social media.

Web Scraping
npm:@sostag/scraping-bot-mcp · local package502/wkpublished 14 d ago
WebPeelMCP serverMCP
by JakeLiuMe
Unknown

Fetch any web page as clean, AI-ready markdown with smart HTTP-to-browser escalation.

Data Extraction~100%Web ScrapingBrowser AutomationWeb SearchVector Search
npm:webpeel · local package491/wkpublished 8 mo ago
MCP Browser ExtensionMCP serverMCP
by Mehmoodqureshi
Unknown

Drive your real Chrome over MCP: real logins and cookies, multi-tab automation, deny-all by default.

Browser AutomationWeb Scraping
npm:mcp-browser-extension · local package491/wkpublished 3 d ago
crawl-readinessMCP serverMCP
by Grubbomatic
Unknown

Check what AI crawlers may read and what a page permits, generate llms.txt and schema.

Web Scraping~100%Identity & Access~73%
npm:crawl-readiness-mcp · local package460/wkpublished 10 d ago
polite-crawlerMCP serverMCP
by mark1russell7
Unknown

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

Web ScrapingBrowser AutomationDatabases
npm:polite-crawler · local package446/wkpublished 3 d ago
linkedin-relay-mcpMCP serverMCP
by tamas_gabor
Unknown

Deep research over LinkedIn from your own account — CLI (lnrelay) + read-only MCP server + Claude Code skill. No paid API. Reads LinkedIn's private Voyager surface with your own session cookies.

Social MediaWeb Scraping
npm:linkedin-relay-mcp · local package445/wkpublished 10 d ago
mcpMCP serverMCP
by hashscraper
Unknown

Coupang top 30 and public web data bots (Naver, Instagram, Olive Young, maps, reviews) for AI agents

Web Scraping
npm:@hashscraper/mcp · local package443/wkpublished 11 d ago
capskip-mcpMCP serverMCP
by capskip
Unknown

Captcha solver MCP server for AI agents: solve reCAPTCHA v2/v3, Cloudflare Turnstile, GeeTest and image captchas via CapSkip, a local unlimited captcha solver with no per-solve fees.

Browser AutomationCloud Platforms~100%Web ScrapingOCR
npm:capskip-mcp · local package435/wkpublished 4 d ago
neuron-inspectorMCP serverMCP
by rash3ye
Unknown

181 tools for AI agents. Turn Chrome into an MCP server — inspect DOM, automate clicks, audit security, mock APIs, extract data, download videos, schedule agents, monitor pages, self-improving recipes, full API collection management, business intelligence

Browser AutomationWeb ScrapingSEO~58%
npm:neuron-inspector · local package425/wkpublished 9 d ago
@mzxrai/mcp-webresearchMCP serverMCP
by mzxrai
Unknown

MCP server for web research

Web Scraping
npm:@mzxrai/mcp-webresearch · local package418/wkpublished 2 y ago
XActionsMCP serverMCP
by nirholas
Unknown

X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.

Social MediaBrowser AutomationWeb Scraping~66%
npm:xactions · local package412/wkpublished 2 mo ago
Geo402 Geo Web FetchMCP serverMCP
by com.geo402
Unknown

Read any public web page as seen from another country, as clean markdown. Pay per page.

Web SearchWeb Scraping~100%Localization
npm:geo402-mcp · local package409/wkpublished 6 d ago
← Previouspage 125 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather