We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2434 liveRefine in search →
402registryAgentA2A
by 402registry
Live

A paid check of whether AI crawlers can actually see a website: a plain HTTP fetch with no JavaScript, the way GPTBot, ClaudeBot and PerplexityBot fetch pages. A check costs $0.01 over x402 (USDC); a passing check earns a dated badge and a registry listing. Over A2A this agent is a receptionist: ev…

Web Scraping~100%SEO
https://402registry.com/a2aok 5 h ago
Naukri Jobs Scraper (Apify) - Naukri.com jobs with salary in LPAMCP serverMCP
by datadmon
Live

Naukri jobs as JSON: salary in LPA, skills, applicants, full JD, whole-board daily feed. $0.80/1k

Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/naukri-jobs-scraperok 17 h ago
IIMJobs Jobs Scraper (Apify) - India MBA, finance & management jobsMCP serverMCP
by datadmon
Live

IIMJobs MBA/finance jobs JSON, full JD. $2/1k + $0.001/run. Apify Bearer token required.

Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/iimjobs-jobs-scraperok 19 h ago
AgentX Micro-ServicesAgentA2A
by NEMO AI Solutions
Live

Thirty-four pay-per-call agent micro-services at agentx.sale, listed in the catalogue and settled on-chain via x402 (USDC on Base + Solana) or the IETF Machine Payments Protocol (MPP): crypto ticker / gas / Fear&Greed, weather, site health, security headers check, KEV/CVE check & SEO, full Polymark…

SEOWeb Scraping~100%WeatherMonitoring & ObservabilityPayments
https://agentx.saleok 5 h ago
FineDataAgentA2A
by FineData
Live

Retrieve web pages for AI agents. Reads one public URL per call, through FineData's rendering and proxy pipeline, and returns the page as markdown or JSON.

Web Scraping
https://finedata.aiok 6 h ago
RankRootAgentA2A
by RankRoot
Live

Audits how visible a website is to AI answer engines and AI agents, checks AI crawler access, validates and generates llms.txt, and returns RankRoot pricing with checkout links. Send a message containing a URL; optionally name a skill in a data part ({"skill": "audit_site", "url": "https://example.…

Web Scraping~100%PaymentsPricing & QuotesSEO
https://getrankroot.comok 4 h ago
YouTube Channel Scraper & TrackerMCP serverMCP
by akhilrajesh213
Live

YouTube channels for AI agents, no API key: exact views, subscribers, videos, playlists, hashtags.

Team Chat~100%Web Scraping~73%
https://akhil-rajesh--youtube-channel-scraper.apify.actor/mcpok 9 h ago
Telegram Channel Scraper & Keyword SearchMCP serverMCP
by akhilrajesh213
Live

Telegram for AI agents, no login: keyword search, channel posts, comments, username lookup.

Team Chat~100%SMS & Voice~100%Web Scraping~73%
https://akhil-rajesh--telegram-channel-scraper.apify.actor/mcpok 4 h ago
Kijiji Scraper & Tracker (listings, price drops)MCP serverMCP
by akhilrajesh213
Live

Kijiji listings for AI agents: search by keyword, city and category; price drops, cars, rentals.

Web Scraping~73%
https://akhil-rajesh--kijiji-scraper.apify.actor/mcpok 9 h ago
Google Trends Scraper & APIMCP serverMCP
by akhilrajesh213
Live

Google Trends for AI agents, no key: Trending Now, interest over time, rising searches, Pinterest.

Web Scraping~73%
https://akhil-rajesh--google-trends-scraper.apify.actor/mcpok 9 h ago
Google Ads Transparency Scraper & MonitorMCP serverMCP
by akhilrajesh213
Live

Google Ads Transparency Center for AI agents: brands' ads, ad copy, political ad spend, removed ads.

Marketing~100%Web Scraping~73%
https://akhil-rajesh--google-ads-transparency-scraper.apify.actor/mcpok 2 h ago
Craigslist Scraper & Tracker (cars, housing)MCP serverMCP
by akhilrajesh213
Live

Craigslist listings for AI agents: search by keyword, city, state and category; cars, rentals.

Web Scraping~73%
https://akhil-rajesh--craigslist-scraper.apify.actor/mcpok 32 min ago
ManyLivesAgentA2A
by ManyLives
Live

Pay-per-call tools for people building AI agents: live web search and page contents, prompt-injection checks, market data and risk sizing for trading agents, company profiles and quick AI. Ask us to turn a public website into a JSON endpoint. Pay per call, no account, free trial. Also an open marke…

TranslationSpeech RecognitionTeam ChatMarkets & TradingSecurity Scanning~100%
https://manylives.me/a2aok 33 min ago
A.U.G.U.R ForesightAgentA2A
by MAD (augur-trade.com) — operated by A.L.F
Live

Tool exchange for AI agents run by A.L.F: 79 tools — crypto markets and DeFi on every chain (prices, TVL, yields, stablecoins, perps funding, order books, gas, EVM contracts and token security), Solana and pump.fun intelligence from our own live recording of every bonding-curve trade, launch bundle…

Deep Web ResearchWeb ScrapingWeatherPayments~100%Markets & Trading
https://augur-trade.com/hub/api/v1ok 3 h ago
CrawlKit ScrapersMCP serverMCP
by CrawlKit560
Live

58 scrapers via Apify MCP: Booking, Airbnb, Amazon, Google, Zillow, Indeed, Yelp, Reddit, Vinted

Web Scraping~100%Travel & Booking~79%
https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/wayfair-scraper,sweet_stickball/bestbuy-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/grubhub-scraper,sweet_stickball/offerup-scraper,sweet_stickball/vinted-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp,sweet_stickball/airbnb-reviews-scraper,sweet_stickball/amazon-bestsellers-scraper,sweet_stickball/amazon-product-scraper,sweet_stickball/app-store-reviews-scraper,sweet_stickball/ats-jobs-scraper,sweet_stickball/bluesky-scraper,sweet_stickball/booking-reviews-scraper,sweet_stickball/contact-details-scraper,sweet_stickball/eventbrite-scraper,sweet_stickball/glassdoor-scraper,sweet_stickball/google-ads-transparency-scraper,sweet_stickball/google-hotels-scraper,sweet_stickball/google-images-scraper,sweet_stickball/google-maps-scraper,sweet_stickball/google-patents-scraper,sweet_stickball/google-play-apps-scraper,sweet_stickball/google-play-reviews-scraper,sweet_stickball/google-trends-scraper,sweet_stickball/investing-scraper,sweet_stickball/realtor-scraper,sweet_stickball/remote-jobs-scraper,sweet_stickball/resy-scraper,sweet_stickball/sec-edgar-yahoo-finance,sweet_stickball/seek-job-scraper,sweet_stickball/spotify-scraper,sweet_stickball/substack-scraper,sweet_stickball/tech-stack-scanner,sweet_stickball/ted-tenders-scraper,sweet_stickball/thefork-scraper,sweet_stickball/thumbtack-scraper,sweet_stickball/ticketmaster-scraper,sweet_stickball/trustpilot-reviews,sweet_stickball/walmart-scraper,sweet_stickball/youtube-channel-scraper,sweet_stickball/youtube-comments-scraper,sweet_stickball/youtube-search-scraper,sweet_stickball/youtube-shorts-scraper,sweet_stickball/youtube-transcripts
Workday Jobs Scraper & API - All Companies, Last 24 HoursMCP serverMCP
by AnshumanAtrey
Live

Workday Jobs Scraper - Search Every Company

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/workday-job-searchok 17 h ago
Workable Jobs Scraper & API - All Companies, Remote, 24 HoursMCP serverMCP
by AnshumanAtrey
Live

Workable Jobs Scraper - Every Workable Career Page

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/workable-job-searchok 14 h ago
SmartRecruiters Jobs Scraper & API - Remote, Last 24 HoursMCP serverMCP
by AnshumanAtrey
Live

SmartRecruiters Jobs Scraper - 2,900+ Career Sites

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/smartrecruiters-jobs-searchok 15 h ago
Lever Jobs Scraper & API - Salary, Remote, Last 24 HoursMCP serverMCP
by AnshumanAtrey
Live

Lever Jobs Scraper - jobs.lever.co, 2,300+ Companies

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/lever-jobs-searchok 14 h ago
Greenhouse Jobs Scraper & API - All Companies, Last 24 HoursMCP serverMCP
by AnshumanAtrey
Live

Greenhouse Jobs Scraper - Every Greenhouse Job Board

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/greenhouse-jobs-searchok 14 h ago
← Previouspage 112 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather
ok 11 h ago