We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2434 liveRefine in search →
Greenhouse Job Board Scraper — Open Jobs, Live, Any CompanyMCP serverMCP
by kriton-dev
Live

Get every open job from any company's Greenhouse job board, fetched live

Web Scraping~73%
https://mcp.apify.com/?tools=hermeskd/greenhouse-jobsok 12 h ago
Broken Links Checker — Crawl Pages, Assets & Redirect ChainsMCP serverMCP
by kriton-dev
Live

Find broken links on a website: crawls its pages and reports 404s, errors and redirect chains

Web Scraping~100%
https://mcp.apify.com/?tools=hermeskd/broken-linksok 10 h ago
NanoParseAgentA2A
by NanoParse
Live

Parse any public URL into clean Markdown plus Litmus — 20 machine-readable trust signals (source authority, freshness, TL;DR, key figures, structural trust). $0.005 USDC per successful parse via x402 on Base. 10 free parses a month with no account and no API key; a signed wallet claims the same 10 …

Data ExtractionWeb Scraping
https://nanoparse.app/fetchok 3 h ago
AI Crawler Access CheckerMCP serverMCP
by Nero-Engine
Live

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

Web Scraping~100%
https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checkerok 12 h ago
Google Maps Reviews ScraperMCP serverMCP
by NadaHo
Live

Google Maps reviews of any place: stars, text, date, photos, owner reply. Links, place IDs or names.

Code Review~100%Maps & Places~100%Web Scraping~73%
https://mcp.apify.com/?tools=plainrows/google-maps-reviewsok 11 h ago
ChatGPT Search Scraper: Answers, Citations & SourcesMCP serverMCP
by NadaHo
Live

ChatGPT answers with web search as JSON: citations, sources, brands and products. Bulk prompts.

Academic Research~100%Web Scraping~73%
https://mcp.apify.com/?tools=plainrows/chatgpt-search-scraperok 10 h ago
x402-scraper-apiAgentA2A
by x402-scraper-api
Live

Paid web extraction API powered by x402 with strict safety guardrails.

Web Scraping~73%
https://scraper-production-6a87.up.railway.app/v1/scrape/markdownok 3 h ago
Google Trends ScraperMCP serverMCP
by CleanData-Labs
Live

Google Trends for agents: interest over time, by region, rising queries, Trending Now. No API key.

Web Scraping~73%
https://mcp.apify.com/?tools=cleandata-labs/google-trends-explorerok 4 h ago
Google Ads Transparency ScraperMCP serverMCP
by CleanData-Labs
Live

Competitor ads from Google Ads Transparency Center by brand or domain: ad text, YouTube IDs.

Marketing~100%Web Scraping~73%
https://mcp.apify.com/?tools=cleandata-labs/google-ads-transparency-explorerok 2 h ago
Zomato Restaurant Scraper - City, Cuisine, ContactMCP serverMCP
by AnshumanAtrey
Live

Zomato Restaurant Scraper - City, Cuisine, Phone

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/zomato-restaurant-scraperok 11 h ago
Telegram Channel Scraper - Posts, Media & Buttons | No LoginMCP serverMCP
by AnshumanAtrey
Live

Telegram Channel Scraper - No Login, $0.30 per 1K Posts

Social Media~100%Web Scraping~100%Team Chat~100%SMS & Voice~100%
https://mcp.apify.com/?tools=anshumanatrey/telegram-channel-scraperok 12 min ago
Instagram Profile Scraper No Login - Bio + Emails + 25 FieldsMCP serverMCP
by AnshumanAtrey
Live

Instagram Scraper No Login - Bio Emails + 25 Fields | Bulk

Social Media~100%Web Scraping~100%Email~100%
https://mcp.apify.com/?tools=anshumanatrey/instagram-profile-intel-no-loginok 17 h ago
Google Trends Scraper API - Interest Over Time, Related QueriesMCP serverMCP
by AnshumanAtrey
Live

Google Trends Scraper API: Interest and Trending Now

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/google-trends-api-scraperok 8 h ago
Facebook/Meta Ads Library Scraper API - Winning Ads, Scam CheckMCP serverMCP
by AnshumanAtrey
Live

Facebook/Meta Ads Library Scraper - Winning Ads

Marketing~100%Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/facebook-ads-library-apiok 13 h ago
web-scrapingMCP serverMCP
by com.superagnt
Live

superagnt: marketing plugin for Claude and ChatGPT. Know your market: scrape and search the web.

Web Scraping~75%
https://mcp.superagnt.com/mcp/web-scrapingok 7 h ago
ContrastAPIAgentA2A
by ContrastCyber
Live

Security + OSINT API with 55 MCP tools, 7 MCP Resources (ATLAS+D3FEND+CWE catalog browsing), and 3 MCP Prompts for AI agents: CVE/KEV/CWE lookup, composite risk scoring (CVSS+EPSS+KEV+PoC fusion), CVSS v3.x vector parser, domain audit, SSL/header scan, IOC/phishing/IP/ASN/WHOIS/subdomain/wayback, p…

Security ReviewEmailSMS & VoicePackages & DependenciesSecrets Management
https://api.contrastcyber.comok 2 h ago
Atlas Data: Ad Library, Jobs & Trends ScrapersMCP serverMCP
by com.getatlasdata
Live

Google, Meta, LinkedIn & TikTok ad libraries, Indeed, Google Jobs, Glassdoor and Google Trends data.

Social Media~80%Web Scraping~73%
https://mcp.apify.com/?tools=atlasdata/google-ads-transparency-scraper-reliable,atlasdata/facebook-ad-library-scraper-reliable,atlasdata/linkedin-ad-library-scraper-reliable,atlasdata/tiktok-ad-library-scraper-reliable,atlasdata/indeed-jobs-scraper-reliable,atlasdata/google-jobs-scraper-reliable,atlasdata/glassdoor-jobs-scraper-reliable,atlasdata/google-trends-scraper-reliableok 18 h ago
AEO Auditor AgentAgentA2A
by AEO Auditor (CodeWays)
Live

Autonomous Answer Engine Optimization (AEO), Generative Engine Optimization (GEO), JSON-LD Schema Graph, and AI Crawler Diagnostic Agent for websites and digital agencies.

Web Scraping~100%Knowledge GraphsSEO
https://aeoauditing.comok 12 min ago
YouTube ScraperMCP serverMCP
by sumitrmardy
Live

Public YouTube search, channel videos, Shorts and optional video metadata. No API key.

Web Scraping~73%
https://mcp.apify.com/?tools=sumitr_mardy/youtube-scraperok 12 h ago
YouTube Comments ScraperMCP serverMCP
by sumitrmardy
Live

Public YouTube comments and linked replies, Top/Newest sorting, likes and video metadata.

Web Scraping~73%
https://mcp.apify.com/?tools=sumitr_mardy/youtube-comments-scraperok 12 h ago
← Previouspage 114 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather