We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2433 liveRefine in search →
AI Visibility CheckerMCP serverMCP
by work.agentexchange.aivisibility
Live

Free, no signup. Check if ChatGPT, Perplexity & Google AI recommend a brand in 15 markets (GEO/AEO).

Data Extraction~58%Pricing & Quotes~53%Web Scraping~51%
https://aivisibility.agentexchange.work/mcpok 7 h ago
Agent WeatherMCP serverMCP
by io.agentweather
Live

Pay per call, solves one question. Raw public readings on AI agents and x402.

Weather~100%Filesystem~54%Agent Discovery~54%Calendar & Scheduling~53%Identity & Access~53%
https://mcp.agentweather.io/mcpok 7 h ago
PagewatchMCP serverMCP
by dev.pagelens
Live

Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

Web ScrapingDeep Web ResearchBrowser Automation~51%
https://pagelens.dev/mcppublished 4 mo agook 7 h ago
DACIX — The Store for AI AgentsMCP serverMCP
by store.dacix
Live

AI-agent marketplace: agent templates, web search & crawl, SEO audit, RO company data, city info.

Web Search~100%Web Scraping~100%Payments~100%E-commerce Operations~100%Prompt Management~94%
https://dacix.store/mcpok 7 h ago
SnoopScanMCP serverMCP
by com.snoopscan
Live

Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.

Social Media~100%Web Scraping~100%News & Feeds~100%HR & Recruiting~100%E-commerce Operations~100%
https://api.snoopscan.com/mcpok 2 h ago
AstraVerify Domain Trust CheckMCP serverMCP
by com.astraverify
Live

Email security and AI discoverability scores for any domain, with the exact record or tag to fix.

Email~100%Web Scraping~99%Web Search~58%
https://astraverify.com/mcpok 7 h ago
mcp-toolbeltMCP serverMCP
by com.papacasper
Live

29 DNS, SEO, SSL, security, WHOIS & mail tools for AI agents. Pay per call (x402) or card API key.

Security Review~100%Databases~100%Version Control~100%Cloud Platforms~100%Identity & Access~100%
https://papacasper.com/mcpok 7 h ago
AI Visibility Audit — Can AI crawlers read and cite your site?MCP serverMCP
by app.rowb.ai-visibility
Live

One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus fixes.

Web Scraping~100%
https://ai-visibility.rowb.app/mcpok 7 h ago
search-mcpMCP serverMCP
by Anon2052
Live

Web search and clean-text fetch MCP server (Tavily-powered, SSRF-guarded).

Web Search~100%Web Scraping~54%
https://search-mcp-tgsn.onrender.com/mcpok 7 h ago
Lead IntelligenceMCP serverMCP
by com.timzinin.api
Live

Pay-per-call lead intelligence tools with free MCP discovery and x402 payments.

Payments~100%People & Company Research~55%Web Scraping~51%Pricing & Quotes~51%Travel & Booking~51%
https://api.timzinin.com/mcp/lead-intelligenceok 7 h ago
Desvela ARD Registry — free preflight(domain)MCP serverMCP
by dev.desvela
Live

What a domain publishes for AI agents: ai-catalog.json, llms.txt, agents.md, robots.txt rules. Free.

E-commerce Operations~91%Web Scraping~51%Notifications~51%
https://registry.desvela.dev/mcpok 7 h ago
Crawler Log TriageMCP serverMCP
by dev.workers.pathwren.www
Live

{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

Web Scraping~100%Writing & Editing~54%
https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/triageok 7 h ago
CricsheetMCP serverMCP
by pipeworx-io
Live

cricsheet -- ball-by-ball cricket data collapsed to match / player / team questions (fleet #2975).

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/cricsheet/mcpok 7 h ago
x402-alphaMCP serverMCP
by io.911fund.x402
Live

Pay-per-call crypto intelligence: 19 tools over 10+ live sources, USDC via x402.

Web Search~100%Payments~100%Markets & Trading~100%Web Scraping~54%Deep Web Research~54%
https://x402.911fund.io/mcpok 7 h ago
TunnelMind Data APIMCP serverMCP
by ai.tunnelmind
Live

Tracker / Sigil / Cross-lens — every TunnelMind Data API operation as one MCP surface.

API Access~100%E-commerce Operations~100%Knowledge Graphs~100%Web Scraping~99%Identity & Access~99%
https://mcp-data.tunnelmind.ai/mcpok 8 h ago
LLMS-GENERATOR — Automated /llms.txt & Agent Documentation Context Compiler (llms-generator.agentdiet.dev)AgentA2AMCPverified owner
by AgentDiet B2A Infrastructure
Live

Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live A2A v0.3, MCP & x402 v2 node at https://llms-generator.agentdiet.dev)

Code Documentation~100%PaymentsWeb Scraping~86%
https://llms-generator.agentdiet.devok 49 min ago
Agent Harbor pay-per-call toolsMCP serverMCP
by yandyman
Live

Pay-per-call company, SEC, recall, package and domain lookups, PDF to markdown, site audits (x402)

Security Review~100%Packages & Dependencies~100%Agent Memory~89%E-commerce Operations~53%Markets & Trading~53%
https://x402.agentharbor.agency/mcpok 8 h ago
AgentRead — bounded web contextMCP serverMCP
by site.chatgpt.army20160422.agentread-json-api
Live

Free HTML parsing; static web context at 0.01 USDC via x402. Paid reads need a wallet adapter.

Payments~90%Web Scraping~54%
https://agentread-json-api.army20160422.chatgpt.site/agent/mcpok 8 h ago
mcpMCP serverMCP
by net.barchin
Live

Web scraping and Iranian-web data tools for AI agents: JS rendering, proxies, Markdown output.

Web Scraping~92%Web Search~58%Maps & Places~57%Social Media~54%Browser Automation~51%
https://barchin.net/mcpok 8 h ago
SEO ToolsMCP serverMCP
by com.timzinin.api
Live

5 pay-per-call SEO tools over MCP. Free discovery, tool calls settle in USDC on Base via x402.

SEO~100%Social Media~100%SMS & Voice~100%Team Chat~99%Web Scraping~51%
https://api.timzinin.com/mcp/seo-toolsok 8 h ago
← Previouspage 105 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather