We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2435 liveRefine in search →
AgentDiet B2A Semantic Distillation AgentAgentA2Averified owner
by AgentDiet B2A Infrastructure
Live

Autonomous Token Diet & Semantic De-bloater Agent. Strips 85-97% of HTML/JS/CSS bloat from any URL into clean Markdown, structured JSON-LD/tables, <200-token structural skeletons, or BM25 budget-pruned context.

Data Extraction~100%Web ScrapingVector SearchDeep Web Research
https://agentdiet-72343955726.us-central1.run.appok 31 min ago
YouTube Transcript ScraperMCP serverMCP
by edtool79-collab
Live

Transcripts of YouTube videos and Shorts in bulk, with timestamps. Runs on Apify.

Web Scraping~73%
https://mcp.apify.com/?tools=hirepulse/youtube-transcript-scraperok 17 h ago
Google Jobs Scraper: Jobs, Salaries & Apply LinksMCP serverMCP
by edtool79-collab
Live

Google Jobs listings for any role and city: company, salary, job type, apply link. Runs on Apify.

Web Scraping~73%
https://mcp.apify.com/?tools=hirepulse/google-jobs-scraperok 6 h ago
Google Ads Transparency Scraper: Competitor Ads by DomainMCP serverMCP
by edtool79-collab
Live

Every Google ad a company runs, by domain: advertiser, format, dates. Runs on Apify.

Web Scraping~73%Marketing~65%
https://mcp.apify.com/?tools=hirepulse/google-ads-transparency-scraperok 12 h ago
AliExpress Search Scraper: Products, Prices & SalesMCP serverMCP
by edtool79-collab
Live

AliExpress search results as JSON: price, discount, rating, units sold. Runs on Apify.

E-commerce Operations~75%Web Scraping~73%CRM & Sales~69%
https://mcp.apify.com/?tools=hirepulse/aliexpress-search-scraperok 10 h ago
Adaga solutions — Data APIs (Travel Monitor Lab)AgentA2A
by Adaga solutions
Live

Atelier logiciel luxembourgeois (Veysel Artur Rodrigues Adaga). 12 APIs de donnees publiques pay-per-event exposees en MCP sur mcp.apify.com et payables en x402/USDC : scraping Google Maps, TikTok, Instagram, YouTube, LinkedIn, RAG web browser, radar de breaking changes d'APIs, alertes avis Google,…

Social Media~100%Travel & Booking~100%Maps & Places~100%Team Chat~99%Web Scraping~92%
https://adagasolutions.luok 8 h ago
CrawlCheckAgentA2A
by CrawlCheck
Live

The verification layer for the agentic web. Fetches a website from outside its network as each named AI and search crawler and reports what each one actually received - status, bytes, content type and whether a 200 carried the file or a challenge page - as a signed answer an agent can verify before…

Web Scraping~100%SEO
https://crawlcheck.io/api/scanok 4 h ago
Google Trends ScraperMCP serverMCP
by RalfIJ
Live

Google Trends for any number of keywords on one scale: interest over time, regions, rising queries.

Web Scraping~73%
https://mcp.apify.com/?tools=ralfij/google-trends-scraperok 5 h ago
Google Jobs ScraperMCP serverMCP
by RalfIJ
Live

Google Jobs listings with parsed salaries and direct apply links, more than 10 per search.

Web Scraping~73%
https://mcp.apify.com/?tools=ralfij/google-jobs-scraperok 18 h ago
Google Hotels ScraperMCP serverMCP
by RalfIJ
Live

Google Hotels prices for any city and dates: nightly and total price with taxes, ratings, amenities.

Travel & Booking~100%Web Scraping~73%
https://mcp.apify.com/?tools=ralfij/google-hotels-scraperok 21 h ago
TikTok ScraperMCP serverMCP
by saulius876-lgtm
Live

TikTok videos with exact views, likes, comments, shares from profiles, hashtags, search, links.

Social Media~100%Web Scraping~73%
https://mcp.apify.com/?tools=sauliusautomatesit/tiktok-scraper-apiok 5 h ago
Google Maps ScraperMCP serverMCP
by saulius876-lgtm
Live

Google Maps places and leads: phone, website, address, rating, reviews, hours, emails.

Maps & Places~100%Web Scraping~73%
https://mcp.apify.com/?tools=sauliusautomatesit/google-maps-scraper-apiok 18 h ago
YouTube Transcript ScraperMCP serverMCP
by fernandoguiraud16-coder
Live

Transcripts of YouTube videos, channels, playlists and searches; AI transcription when no captions.

Web Scraping~73%
https://mcp.apify.com/?tools=fguiraud/youtube-transcript-scraperok 10 h ago
Google Jobs ScraperMCP serverMCP
by fernandoguiraud16-coder
Live

Job listings from Google Jobs with salary ranges, highlights, descriptions and apply links.

Web Scraping~73%
https://mcp.apify.com/?tools=fguiraud/google-jobs-scraperok 5 h ago
Google Hotels ScraperMCP serverMCP
by fernandoguiraud16-coder
Live

Hotel prices, ratings, reviews and amenities from Google Hotels for any city, dates and guests.

Travel & Booking~100%Web Scraping~73%
https://mcp.apify.com/?tools=fguiraud/google-hotels-scraperok 8 h ago
Telegram Channel ScraperMCP serverMCP
by brenton-keller
Live

Public Telegram channel posts, views, reactions, media and subscriber counts. No login needed.

Team Chat~100%SMS & Voice~100%Web Scraping~73%
https://mcp.apify.com/?tools=brenton8907/telegram-channel-scraperok 18 h ago
Google Ads Transparency Center ScraperMCP serverMCP
by bkeller-research
Live

Google Ads by domain or brand: creatives, formats, dates; or bulk-check which domains advertise.

Marketing~100%Web Scraping~73%
https://mcp.apify.com/?tools=brenton8907/google-ads-transparency-centerok 20 h ago
YouTube Scraper: Comments, Dislike Estimates, No API KeyMCP serverMCP
by ArpitGandhi1934
Live

YouTube videos and channels with top comments in the same row, plus dislike estimates. No API key.

Pricing & Quotes~100%Web Scraping~73%
https://mcp.apify.com/?tools=fetch-actor-details,yugenox/youtube-scraperok 21 h ago
Instagram Scraper: Reels to Text, Posts, Comments, No LoginMCP serverMCP
by ArpitGandhi1934
Live

Public Instagram reels, posts, profiles and comments, plus reel-to-text transcripts. No login.

Social Media~100%Web Scraping~73%
https://mcp.apify.com/?tools=fetch-actor-details,yugenox/instagram-scraperok 14 h ago
Instagram Comments Scraper: All Comments, No LoginMCP serverMCP
by ArpitGandhi1934
Live

Public comments on any Instagram post or reel, newest or top first, with keyword filters. No login.

Social Media~100%Web Scraping~73%
https://mcp.apify.com/?tools=fetch-actor-details,yugenox/instagram-comments-scraperok 2 h ago
← Previouspage 117 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather