We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2439 liveRefine in search →
TrafficPaywallAPIHTTP
by MB Skydis
Unavailable

Pay-per-request access for AI crawlers and agents to a network of publisher sites. One prepaid credit balance works on every site; autonomous USDC top-up on Base via x402; RSL 1.0 licensing.

Web Scraping~100%Pricing & Quotes~86%
https://trafficpaywall.com/api/v1/buyer/topup/x402/quote
Johto DataAgentA2A
by Johto Data
Unavailable

Valuable data for agents, paid per call in USDC on Base via x402. No API key or signup. Sample at no charge on every route with ?sample=1. Not charged if the fetch fails or nothing matches.

Deep Web ResearchPaymentsHR & RecruitingWeb ScrapingMarkets & Trading
https://johto-x402-api.johtodata.workers.dev/a2aok 10 d ago
Site SEO & AI Crawler AuditMCP serverMCP
by app.openkrill
Unavailable

Check public pages for SEO tags, AI crawler rules, AI citation signals and landing page conversion.

SEO~100%Web Scraping~100%Document Conversion~99%
https://sitecheck.openkrill.app/mcpok 27 d ago
x402-scraper-apiMCP serverMCP
by ihen404
Unavailable

Programmatic web-scraping MCP server powered by x402 micro-transactions on Base.

Web Scraping~100%
https://x402-scraper-api-production-67a4.up.railway.app/mcpok 15 d ago
G Maps CrawlMCP serverMCP
Unavailable

Search Google Maps businesses by keyword and location through a remote MCP server. Receive up to 20 businesses per search using an API workspace key.

Maps & PlacesData Extraction~71%Web Scraping~69%
https://gmapscrawl.com/api/mcp
Evercraft WebMCP serverMCP
by jgaethle10
Unavailable

Read public web content with Evercraft; search and browser automation stay behind safety gates.

Browser Automation~100%Secrets Management~57%Data Extraction~55%Web Search~55%Web Scraping~54%
https://base44.app/api/apps/692b4178919afe7d08c4d2b8/functions/evercraftWebMcpok 22 d ago
DexL AgentsAgentA2A
by DexL
Unavailable

One API. Every AI. Pay per call. Chat completions across GPT-5.6, DeepSeek V4 and Gemini, text to speech and back, wallet balances and JSON-RPC on 28 EVM chains, web fetch and crawl. Plus paid data: US grid demand and fuel mix from EIA open data, CVE lookup and OFAC sanctions screening, ECB foreign…

Code ExecutionWriting & Editing~100%Data Extraction~100%Invoice Processing~100%Web Scraping~100%
https://agents.dexl.iook 15 d ago
AttestPage (Quoteproof)AgentA2A
by AttestPage
Unavailable

Checks what an agent quotes and cites before the answer goes out: a quote is matched word for word against the live page, and a web page is fetched as clean text with a signed receipt. Pay per call.

Web ScrapingPackages & DependenciesAcademic ResearchMonitoring & ObservabilityInvoice Processing
https://vehcdj664efetfrsolne5umanq.srv.us/v1ok 23 d ago
ZadenWorksMCP serverMCP
by ZadenGG
Unavailable

Read, screenshot, diff, verify and audit any URL: SEO, links, sitemaps, schema, a11y.

Browser Automation~100%SEO~81%Data Extraction~58%Web Search~58%Social Media~51%
https://x402-zadenworks.zaden-gaming.workers.dev/mcpok 25 d ago
SteadyFetchMCP serverMCP
by carsonroell-debug
Unavailable

Reliable web fetching for AI agents with retry, circuit breaker, caching, and anti-bot bypass

Monitoring & Observability~55%Web Scraping~54%Testing~51%
https://steadyfetch-production.up.railway.app/mcppublished 7 mo agook 1 mo ago
agentsvc.ioAgentA2A
by agentsvc.io
Unavailable

Pay-per-call web services for AI agents (70 tools: scraping, screenshots, PDF, OCR, search, news, weather, prices, validation, codes). Paid per request with USDC on Base or Solana via x402. No account or API key.

Deep Web ResearchDocument ConversionWeb ScrapingNews & Feeds~100%Weather
https://agentsvc.io/api/v1/proxyok 29 d ago
MESSORAMCP serverMCP
by dev.messora
Unavailable

Scrape, crawl and search the web for AI agents via MCP.

Web Search~100%Web Scraping~86%Terminal & Shell~53%
https://mcp.messora.dev/mcpok 1 mo ago
GoAI Moat Web ScrapeMCP serverMCP
by com.goaimoat
Unavailable

Scrape any URL into clean LLM-ready Markdown, or crawl a whole site.

Web Scraping~86%
https://scrape.mcp.goaimoat.com/mcpok 1 mo ago
Money Mind — Verified ExtractionAgentA2A
by Money Mind
Unavailable

Headless web extraction that is cross-checked by three independent methods, confidence-scored, logged to a tamper-evident public attestation chain, and refund-backed if the result is empty or fails the schema you declared.

Data Extraction~100%Browser Automation~100%Web ScrapingTesting~66%
https://money-mind-extract.onrender.com/v1/extractok 11 d ago
Wodan PostureMCP serverMCP
by com.goedvps.app.wodan-posture
Unavailable

Access-posture reports for agent data sourcing: robots, bot wall, licensing. Paid per call via x402.

Web Scraping~99%Reporting & Dashboards~89%Payments~51%
https://wodan-posture.app.goedvps.com/mcp
kdata-gateMCP serverMCP
by loved0543-dotcom
Unavailable

Korean market data for AI agents: K-beauty/K-food products, Naver trends, stocks, real estate.

Weather~100%Markets & Trading~100%E-commerce Operations~94%HR & Recruiting~55%Evaluation & Benchmarks~54%
https://kdata-gate.vercel.app/mcp
web-scraperMCP serverMCP
by com.agishub
Unavailable

10 pay-per-call web tools: markdown, CSS scrape, links, crawl, screenshot, PDF, browser.

Web Scraping~100%
https://api.agishub.com/mcp/web
Autonomy x402 ToolsMCP serverMCP
by Autonomy-Labs-Tech
Unavailable

Pay-per-call agent tools over x402: site audits, llms.txt generation, wallet watch, catalog.

E-commerce Operations~100%Markets & Trading~100%Payments~89%Banking~58%Web Scraping~54%
https://www.autonomylabsweb.tech/api/mcp
xpay Web ScrapingMCP serverMCP
by xpaysh
Unavailable

35+ web scraping tools. Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, Riveter.

Web Scraping~100%
https://scraping.mcp.xpay.sh/mcp?key={api_key}
NM Signals: AI crawler auditMCP serverMCP
by newmediamadman
Unavailable

Audit webpage access for AI crawlers. API key and Premium or Partner plan required.

Web Scraping~100%
https://app.nyman.media/api/mcp
← Previouspage 153 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather