We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
samarthya-botAgent
by mebishnusahu0595
Unknown

SamarthyaBot — Privacy-First Local Agentic AI Operating System. Self-hosted multi-agent RPA engine with Telegram, Discord, Web Dashboard, Puppeteer browser control, SSH deployment, encrypted memory, voice transcription, and Indian workflow automation (GST

CI/CD & DeployTerminal & ShellTeam Chat~100%SMS & Voice~100%Browser Automation
npm:samarthya-bot · local package110/wkpublished 5 mo ago
mcp-gtm-hiring-signal-scraperMCP serverMCP
by com.mambabuilt
Unknown

Detects GTM hiring activity from company career pages via Greenhouse, Lever, Ashby. Clay-ready.

Web ScrapingHR & Recruiting
npm:@mambalabsdev/mcp-gtm-hiring-signal-scraper · local package107/wkpublished 3 d ago
auxiliar-mcpMCP serverMCP
by Tlalvarez
Unknown

Web access for AI agents — search/scrape/extract/crawl via the auxiliar.ai gateway.

Web ScrapingEvaluation & BenchmarksWeb Search
npm:auxiliar-mcp · local package104/wkpublished 4 mo ago
caishiMCP serverMCP
by ZhongQuinnKing
Unknown

Read Bilibili, Douyin, Xiaohongshu and any web page via your own logged-in Chrome.

Browser AutomationWeb Scraping
npm:caishi-mcp · local package101/wkpublished 21 d ago
markfetchMCP serverMCP
by vasylenko
Unknown

Fetch a URL, return clean markdown. MCP server and CLI for AI agents.

Web Scraping
npm:markfetch · local package99/wkpublished 3 mo ago
domscoutMCP serverMCP
by jkresearch8
Unknown

domscout browser API as MCP tools: screenshots, Markdown, structured data, page automation, crawls.

Web ScrapingBrowser Automation
npm:@domscout/mcp · local package99/wkpublished 1 mo ago
mcp-smart-crawlerMCP serverMCP
by erikloo
Unknown

A command-line tool acting as an MCP (ModelContextProtocol) server, using Playwright to crawl web content for AI models.

Web ScrapingBrowser AutomationDeep Web Research
npm:mcp-smart-crawler · local package99/wkpublished 2 y ago
grok-search-rsMCP serverMCP
by epsiekygrr_zedxx
Unknown

Rust MCP server for Grok Responses web search, Tavily fetch/map, and Firecrawl fallback

Web SearchWeb Scraping
npm:grok-search-rs · local package98/wkpublished 2 mo ago
leapfrogMCP serverMCP
by anthonybono21-cloud
Unknown

Multi-session browser MCP — 15 parallel isolated browsers, 37 tools, stealth, self-improvement.

Browser AutomationWeb Scraping
npm:leapfrog-mcp · local package97/wkpublished 7 mo ago
Unrendered: AI Crawler CheckerMCP serverMCP
by imfurkana
Unknown

AI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.

Web Scraping~100%SEO
npm:unrendered-mcp · local package95/wkpublished 18 d ago
EDDIESMCP serverMCP
by equin001
Unknown

Money for people and machines: pay x402 (ex420) 402s, get paid, find paid services, sell compute.

PaymentsWeb Scraping~62%
npm:eddieseddies · local package93/wkpublished 6 d ago
selenium-mcpMCP serverMCP
by gaforov
Unknown

Selenium MCP server for AI agents — 41 browser automation tools with snapshots and sessions.

TestingBrowser AutomationWeb Scraping
npm:@gaforov/selenium-mcp · local package92/wkpublished 2 mo ago
Tavily MCP ServerMCP serverMCP
by Seey215
Unknown

MCP server for advanced web search using Tavily API.

Web SearchWeb ScrapingData Extraction~71%
npm:@toolsdk.ai/tavily-mcp · local package92/wkpublished 12 mo ago
mcp-fetchMCP serverMCP
by matiasgf
Unknown

A Model Context Protocol server providing tools for HTTP requests, GraphQL queries, WebSocket connections, and browser automation

API AccessBrowser AutomationWeb ScrapingTesting
npm:mcp-fetch · local package91/wkpublished 15 mo ago
scraperMCP serverMCP
by ofershap
Unknown

Web scraping MCP — extract clean markdown, links, and metadata from any URL.

Web ScrapingData Extraction~71%
npm:mcp-server-scraper · local package89/wkpublished 8 mo ago
deepseek-websearch-mcpMCP serverMCP
by zengzoxiong
Unknown

DeepSeek 官方 Search/Fetch API 的 MCP server(官方 SDK 构建,webSearch/webFetch 双工具,支持时效过滤与结构化输出)

Web SearchWeb Scraping~100%
npm:deepseek-websearch-mcp · local package87/wkpublished 22 d ago
SvipallMCP serverMCP
by dev.ilien.svipall
Unknown

Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally

Web ScrapingBrowser Automation
npm:svipall · local package87/wkpublished 1 mo ago
WickMCP serverMCP
by myleshorton
Unknown

Browser-grade web access for AI agents. Fetches any webpage, returns clean markdown.

Browser AutomationWeb Scraping~69%
npm:wick-mcp · local package86/wkpublished 6 mo ago
mcpMCP serverMCP
by crawlbrulee
Unknown

EU-native web scraping for AI agents. scrape pages, map sites, run background jobs, check usage.

Web ScrapingVector Search
npm:@crawlbrulee/mcp · local package85/wkpublished 2 d ago
browse-mcpMCP serverMCP
by That1Drifter
Unknown

Headless-browser MCP server for any MCP-capable agent (Claude, Codex, Gemini CLI, Cursor, ...). Playwright-based, with accessibility-tree refs, Readability, search, annotated screenshots, and a self-improvement feedback loop. Windows, Linux, and macOS.

Browser AutomationWeb Scraping
npm:browse-mcp · local package85/wkpublished 5 mo ago
← Previouspage 129 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather