We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2433 liveRefine in search →
X1-BaaS Scraping APIMCP serverMCP
by com.tazpal
Live

Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.

Web Scraping~100%Payments~100%Pricing & Quotes~51%Browser Automation~51%
https://api.tazpal.com/mcpok 3 h ago
Domain HealthMCP serverMCP
by com.modernmustardseed
Live

Domain checks: SPF, DKIM, DMARC, BIMI, MTA-STS, SSL/TLS and HTTP security headers.

Identity & Access~100%Email~96%Web Scraping~53%Browser Automation~51%
https://mcp.modernmustardseed.com/domain-healthok 3 h ago
CitehoundMCP serverMCP
by andacuzel
Live

Scan any domain for AI readiness and generate llms.txt, robots.txt and schema. Free, read-only.

Web Scraping~99%Data Extraction~58%Evaluation & Benchmarks~54%Security Scanning~51%
https://getcitehound.com/api/mcpok 3 h ago
mcpMCP serverMCP
by nl.getapi
Live

Nederlandse overheids- en registerdata via MCP: KVK, BAG, energielabel, kenteken, DSO en meer.

Web Scraping~53%
https://api.getapi.nl/mcpok 3 h ago
agentsvc.ioMCP serverMCP
by io.agentsvc
Live

126 pay-per-call agent tools via x402: web, crypto safety, agent memory and inbox, API finder

Speech Recognition~100%News & Feeds~100%Email~100%Markets & Trading~92%Translation~54%
https://agentsvc.io/mcpok 3 h ago
Fourward AI visibility toolsMCP serverMCP
by com.fourwardhq
Live

Score any website's AI search visibility out of 100 and see which of 20 AI crawlers can read it.

Web Scraping~91%Web Search~58%
https://www.fourwardhq.com/mcpok 3 h ago
found-by-ai-monitorMCP serverMCP
by huxleypeckham
Live

Live AI visibility measurements from Are you found by AI?, queryable by your own AI.

Data Extraction~58%Evaluation & Benchmarks~54%Web Scraping~51%Browser Automation~51%
https://areyoufoundbyai.com/mcp/demook 3 h ago
Grandranker Free AI SEO ToolsMCP serverMCP
by com.grandranker
Live

Free, no signup: AI crawler check, llms.txt validator, ChatGPT/Perplexity/Gemini citation check.

Web Scraping~91%SEO~65%Academic Research~54%
https://grandranker.com/mcp/freeok 3 h ago
rust.wikiMCP serverMCP
by wiki.rust
Live

Live data for the game Rust: skin prices and history, items, item store, loot tables, servers.

Notes & Docs~100%E-commerce Operations~100%News & Feeds~93%Marketing~53%Knowledge Graphs~53%
https://rust.wiki/mcpok 3 h ago
AIReadyMCP serverMCP
by everyai-com
Live

Scan and fix your site's AI discoverability: crawler access, llms.txt, JSON-LD. Free.

Web Scraping~100%Web Search~58%Documentation Lookup~54%Writing & Editing~51%
https://ai-ready.magicteams.ai/mcpok 3 h ago
A.U.G.U.R Synapse · Web & ResearchMCP serverMCP
by art.maddegen.agent
Live

Read the web (page text, DNS, WHOIS, TLS, uptime) + research (Wikipedia, arXiv, GitHub, packages).

News & Feeds~100%Version Control~100%Packages & Dependencies~100%Academic Research~100%Web Scraping~99%
https://agent.maddegen.art/hub/mcp/webok 3 h ago
horizon-pulseMCP serverMCP
by horizon-pulse
Live

28 agent tools via x402: crypto data, tx checks, web fetch. MCP pays Base USDC; HTTP adds 3 rails.

Web Scraping~100%Weather~100%Payments~100%Markets & Trading~100%News & Feeds~93%
https://horizonpulse.dev/mcpok 3 h ago
Not Human SearchMCP serverMCP
by ai.nothumansearch
Live

Search the agentic web. 4,100+ sites, 11 tools incl. check_url + verify_mcp for probe-before-use.

Web Scraping~99%API Access~51%
https://nothumansearch.ai/mcpok 3 h ago
SiteizMCP serverMCP
by com.siteiz
Live

Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.

Web Scraping~91%
https://siteiz.com/mcpok 3 h ago
mifactory-scraping-apiMCP serverMCP
by mifactory-bot
Live

Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.

Web Scraping~100%
https://scraping-api-alpha.vercel.app/mcpok 3 h ago
TapMCP serverMCP
by LeonTing1010
Live

Browser MCP for logged-in tasks. Uses your Chrome — credentials stay local. Zero-token replay.

Browser AutomationWeb Scraping
https://mcp.taprun.dev/mcppublished 32 h agook 3 h ago
Riley Craig x402 Agent StoreMCP serverMCP
by rccola990-cloud
Live

AI brand/token visibility, prediction-market odds & cheap x402 data feeds for AI agents.

Contracts & Legal~100%Web Search~100%Web Scraping~100%Databases~100%News & Feeds~100%
https://store.agentexchange.work/mcpok 3 h ago
Course Drift OracleMCP serverMCP
by 710git
Live

Signed drift reports for the ai-agents-for-beginners course. Free summary; $0.25 full report.

Writing & Editing~91%Reporting & Dashboards~89%Data Extraction~58%Web Scraping~51%Packages & Dependencies~51%
https://signetworks.atelieri.workers.dev/mcpok 3 h ago
AgentwatchMCP serverMCP
by lighting.comiza
Live

Check if ChatGPT, Claude and Perplexity can reach, read and quote a website.

Web Scraping~51%
https://comiza.lighting/agentwatch/mcpok 3 h ago
CrawlCheckMCP serverMCP
by emmanuelorta
Live

Verification layer for the agentic web: a signed answer about any site before an agent acts.

Cloud Platforms~55%Writing & Editing~54%Video Editing~53%Knowledge Graphs~53%Identity & Access~53%
https://crawlcheck.io/mcpok 3 h ago
← Previouspage 101 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather