wellknown
SearchCapabilitiesReliabilityJournalSourcesDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • Search
  • Capabilities
  • Reliability report
  • Journal
  • Sources & freshness
  • Network status
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.v0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

213 records58 liveRefine in search →
@xenarch/agent-mcpMCP serverMCP
by emdevries
Unknown

Non-custodial x402 MCP server for AI agents. Lets Claude, Cursor, LangChain and CrewAI pay for HTTP 402–gated APIs with USDC micropayments on Base L2. Unlike Cloudflare Pay-Per-Crawl, works on any host and settles agent-to-publisher direct.

PaymentsCloud Platforms~100%Web Scraping~100%
npm:@xenarch/agent-mcp · local package76/wkpublished 2 mo ago
gate402-mcpMCP serverMCP
by pgalyen
Unknown

MCP server for Gate402 — pay-per-call agent APIs over x402: GPU/CPU compute, open-model LLM inference, crypto/finance data, and web tools. Free tier, no signup.

Markets & TradingPaymentsWeb Scraping
npm:gate402-mcp · local package76/wkpublished 1 mo ago
lean-readerMCP serverMCP
by aimento
Unknown

Token-minimized URL-to-clean-text reader for LLMs, with a token-savings receipt. MCP server + library.

Web ScrapingData Extraction~71%
npm:lean-reader · local package75/wkpublished 2 mo ago
@thunderbit/mcp-serverMCP serverMCP
by yuchen-hyy
Unknown

Thunderbit MCP Server — AI-powered web scraping and structured data extraction for Claude, ChatGPT, and other MCP-compatible AI assistants.

Data Extraction~100%Web Scraping
npm:@thunderbit/mcp-server · local package75/wkpublished 3 mo ago
nexus-mcp-agentMCP serverMCP
by black_shadow
Unknown

Agentic OS MCP Server — 150+ tools with on-demand loading (26 core), Streamable HTTP transport, background task engine, browser automation, TF-IDF semantic memory, multi-agent orchestration. Zero API keys.

Web ScrapingVersion ControlFilesystemAgent MemoryKnowledge Graphs
npm:nexus-mcp-agent · local package73/wkpublished 1 mo ago
sociavault-mcpMCP serverMCP
by olamsco
Unknown

Model Context Protocol (MCP) server for SociaVault — query TikTok, Instagram, YouTube, Twitter/X, LinkedIn, Facebook, Reddit, Threads, Pinterest, Twitch, TikTok Shop, and ad libraries from any AI assistant.

Social MediaWeb Scraping
npm:sociavault-mcp · local package72/wkpublished 3 mo ago
linkedin-mcp-toolsMCP serverMCP
by devag7
Unknown

LinkedIn MCP server — structured LinkedIn data via a real stealth-browser session. Profiles, search, jobs, companies, messaging, network. Works with Claude, Cursor, and any MCP client.

Social MediaBrowser AutomationHR & RecruitingWeb ScrapingCRM & Sales
npm:linkedin-mcp-tools · local package72/wkpublished 3 mo ago
netlens-mcpMCP serverMCP
by pzalutski
Unknown

Zero-dependency MCP server for unobstructed web reading: browser-header fetch past robots.txt/bot blocks, full-page HTML->Markdown with ad stripping, plus web search

Web SearchWeb ScrapingDeep Web Research
npm:netlens-mcp · local package72/wkpublished 1 mo ago
@mseep/mcp-smart-crawlerMCP serverMCP
by skydeckai
Unknown

A command-line tool acting as an MCP (ModelContextProtocol) server, using Playwright to crawl web content for AI models.

Web ScrapingBrowser AutomationDeep Web Research
npm:@mseep/mcp-smart-crawler · local package69/wkpublished 17 mo ago
scrapercityMCP serverMCP
by scrapercity
Unknown

ScraperCity CLI & MCP Server - B2B lead generation for AI agents

Web ScrapingMaps & Places~73%Email~62%
npm:scrapercity · local package67/wkpublished 4 mo ago
cron-forge-mcpMCP serverMCP
by sovereigntaylor2
Unknown

MCP server for cron expression parsing, validation, human-readable explanation, and next run calculations.

Scheduling & Cron~100%Web Scraping~66%Version Control~64%SEO~58%
npm:cron-forge-mcp · local package66/wkpublished 6 mo ago
browser-use-mcpMCP serverMCP
by larsen-bowser-use
Unknown

Official Browser Use MCP server for real-time web data access via the Browser Use API.

Browser Automation~100%Web SearchWeb Scraping~68%
npm:browser-use-mcp · local package66/wkpublished 13 mo ago
@agenson-horrowitz/web-content-extractor-mcpMCP serverMCP
by agenson-horrowitz
Unknown

Agent-optimized MCP server for extracting clean, structured content from web pages - built specifically for AI agents that need LLM-friendly web data

Data Extraction~100%Web ScrapingDocument Conversion~71%
npm:@agenson-horrowitz/web-content-extractor-mcp · local package64/wkpublished 5 mo ago
merch-connectorMCP serverMCP
by grahamton
Unknown

MCP server that gives merchandising agents eyes on any storefront — scrape, audit, compare, roundtable analysis, and eval tracking via 11 tools.

Browser AutomationWeb ScrapingE-commerce Operations
npm:merch-connector · local package63/wkpublished 5 mo ago
clawpage-mcpMCP serverMCP
by clawpage
Unknown

MCP server for ClawPage web extraction API. Extract and structure any web page into clean JSON.

Data Extraction~100%Web ScrapingPayments
npm:clawpage-mcp · local package61/wkpublished 7 mo ago
broke2built-skills-mcpMCP serverMCP
by anthonysnider
Unknown

MCP server: 29 live data skills for AI agents — email/DNS/domain intelligence, SEO & security audits, content extraction, EVM on-chain reads. Free tier included, no signup.

Web ScrapingNews & FeedsEmail~100%SEO~94%
npm:broke2built-skills-mcp · local package61/wkpublished 2 mo ago
web-tools-mcpMCP serverMCP
by mlawsonking
Unknown

MCP server: 10 deterministic web utility tools for AI agents: read URLs as Markdown, unfurl metadata, validate email, scrape with CSS, parse feeds, DNS/RDAP/SSL/HTTP/structured-data.

Deep Web ResearchWeb ScrapingSecrets ManagementPackages & DependenciesNews & Feeds
npm:agent-firewall-mcp · local package59/wkpublished 24 d ago
mcp-web-engineMCP serverMCP
by arbolencio
Unknown

Privacy-First, Self-Hostable & SSRF-Hardened MCP Server & Web Engine for AI Agents

Web SearchWeb Scraping~66%
npm:mcp-web-engine · local package59/wkpublished 17 d ago
spa-reader-mcpMCP serverMCP
by oowoo
Unknown

MCP Server that renders JavaScript SPA pages and extracts LLM-ready Markdown content

Browser AutomationWeb Scraping
npm:spa-reader-mcp · local package57/wkpublished 6 mo ago
@cyanheads/jinaai-mcp-serverMCP serverMCP
by cyanheads
Unknown

A Model Context Protocol (MCP) server that provides intelligent web reading capabilities using the Jina AI Reader API. It extracts clean, LLM-ready content from any URL.

Monitoring & ObservabilityWeb ScrapingData Extraction~71%
npm:@cyanheads/jinaai-mcp-server · local package55/wkpublished 13 mo ago
← Previouspage 7 of 11Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather