We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2435 liveRefine in search →
Shopee Brasil Scraper — Produtos, Preços, Vendidos e LojasMCP serverMCP
by paulovitorti
Live

Produtos da Shopee Brasil por busca ou loja: preço, Pix, nota, cidade, loja e vendidos

Web Scraping~73%
https://mcp.apify.com/?tools=paulovitor18/shopee-brasil-produtosok 3 h ago
Depop Scraper & Monitor: New Listings, Price & Sold AlertsMCP serverMCP
by Nero-Engine
Live

Depop listings for searches or URLs, with alerts on new listings, price drops and sales.

Notifications~100%Web Scraping~73%
https://mcp.apify.com/?tools=nerolabs/depop-marketplace-monitorok 3 h ago
Oya BrowserAgentA2A
Live

Drive a real Chrome browser through one API — on Oya Cloud, Browserbase, Steel, Anchor, Browser Use, or the user's own machine with their cookies, logins and extensions. Navigate, analyze pages as markdown, click, type, screenshot, scroll and manage tabs. Personas keep a logged-in identity stable a…

Browser AutomationWeb ScrapingDeep Web Research
https://browser.getoya.aiok 2 h ago
ZAP Imóveis Scraper — Anúncios de Venda e AluguelMCP serverMCP
by paulovitorti
Live

Extrai anúncios do ZAP Imóveis: venda e aluguel com preço, área, quartos e localização.

Web Scraping~73%
https://mcp.apify.com/?tools=paulovitor18/zap-imoveis-scraperok 7 h ago
Reclame Aqui Scraper — Reputação de Empresas BRMCP serverMCP
by paulovitorti
Live

Reputação de empresas no Reclame Aqui: nota, índice de solução e total de reclamações.

Web Scraping~73%
https://mcp.apify.com/?tools=paulovitor18/reclameaqui-scraperok 12 h ago
iFood Scraper Brasil: Leads de Restaurantes com CNPJMCP serverMCP
by paulovitorti
Live

Extrai restaurantes do iFood no Brasil com endereço, categoria e CNPJ da Receita Federal.

Web Scraping~73%CRM & Sales~69%
https://mcp.apify.com/?tools=paulovitor18/ifood-brasil-restaurantes-cnpjok 21 h ago
Google News Scraper — Real Publisher URLs, MCP-ReadyMCP serverMCP
by paulovitorti
Live

Scrapes Google News and returns the real publisher URLs, not redirect links.

News & Feeds~100%Web Scraping~73%
https://mcp.apify.com/?tools=paulovitor18/google-news-scraper-real-urlsok 3 h ago
MCP Endpoint Score Card — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that scores an MCP endpoint out of 100 in one call — handshake 30, tool schemas 30, error conformance 25, discovery 15 — with a letter grade, every finding by severity and the full per-section detail. Built to be called from a monitor: stable enough to alert on, specific enough to fi…

Web Scraping~100%
https://www.pathwren.workers.dev/a2a/scoreok 5 h ago
Discovery and Auth-Posture Probe — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that reads the discovery and auth-posture documents a client looks for before it dials: oauth-protected-resource in both the root and the RFC 9728 §3.1 insertion form, oauth-authorization-server, .well-known/mcp, .well-known/mcp.json, /mcp.json and /llms.txt — each with the status, a…

Web Scraping~100%Identity & Access~100%
https://www.pathwren.workers.dev/a2a/discoveryok 5 h ago
MCP Endpoint Conformance — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that lints an MCP endpoint you name: initialize and version negotiation including a repeated byte-identical handshake, JSON-Schema validation of every tool the endpoint advertises, and JSON-RPC error conformance for the five malformed requests clients actually send. Reports what your…

Web Scraping~100%
https://www.pathwren.workers.dev/a2a/lintok 4 h ago
Agent Discovery Doctor — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that audits which agent-discovery documents a host actually serves — robots.txt, llms.txt, openapi.json, the .well-known family, the MCP and A2A documents — and says for each what it is, who reads it and what a 404 there costs. It also validates a pasted llms.txt or A2A agent card ag…

Web Scraping~100%Agent Discovery~100%
https://www.pathwren.workers.dev/a2a/doctorok 3 h ago
Crawler Log Triage — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that turns pasted access-log lines into who crawled you: every line classified by operator and category, a rollup with hits and bytes per operator, the lines whose user-agent claims an operator from an address outside every range that operator publishes, and — from the file you actua…

Web Scraping~100%
https://www.pathwren.workers.dev/c/ard/a2a/triage/.well-known/agent-card.jsonok 3 h ago
robots.txt Policy Lint — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that reads a robots.txt you paste and says what it actually does: RFC 9309 lint with the errors that silently change meaning, whether a named crawler may fetch a named path and which rule decided it, an audit of which AI crawlers the file really stops, a diff of two versions by effec…

Web Scraping~100%
https://www.pathwren.workers.dev/a2a/robotsok 5 h ago
Crawler IP Verifier — AI Crawler IndexAgentA2A
by www.pathwren.workers.dev
Live

A2A v1.0 agent that checks crawler IP addresses against the ranges the operators themselves publish: up to 500 addresses per call with the matching prefix, source and mirror time for each, CIDR containment lookups both ways, paste-ready allowlists for nginx, apache, haproxy, Cloudflare, ipset and c…

Web Scraping~100%
https://www.pathwren.workers.dev/a2a/netcheckok 4 h ago
AI Visibility CheckerAgentA2A
by AI Visibility Checker
Live

Provides free, read-only representative brand-visibility estimates and public-site AI-agent readiness audits.

Web ScrapingSEO
https://aivisibility.agentexchange.workok 2 h ago
Web2MDAgentA2A
by Web2MD
Live

Convert any webpage to clean, AI-ready Markdown. 16 smart extractors for Reddit, YouTube, GitHub, and more.

Document ConversionWeb ScrapingDeep Web Research
https://web2md.orgok 4 h ago
smart-crawlerMCP serverMCP
by shulex-voc
Live

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

Web Scraping~73%
https://smartcrawler.io/mcpok 9 h ago
Google Trends Scraper (orbots) - Apify ActorMCP serverMCP
by orbotshq
Live

Google Trends trending searches, volume estimates & trend duration. Not affiliated with Google LLC.

Web Scraping~73%
https://mcp.apify.com/?tools=orbots/google-trends-scraperok 7 h ago
Google Ads Transparency Center Scraper (orbots) - Apify ActorMCP serverMCP
by orbotshq
Live

Every ad an advertiser runs on Google, from the public Ads Transparency Center. Unofficial tool.

Marketing~100%Web Scraping~73%
https://mcp.apify.com/?tools=orbots/google-ads-transparency-scraperok 19 h ago
AgentScrapeAgentA2A
by HSH Intelligence
Live

Pay-per-call web scraping for AI agents via x402 v2 on Base USDC. No signup, no API keys — agents pay autonomously per call.

Data Extraction~100%Web ScrapingSEOKnowledge Graphs~62%Browser Automation~51%
https://agent-scrape.healingsunhaven.workers.devok 5 h ago
← Previouspage 121 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather