We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2435 liveRefine in search →
Google Hotels Scraper (Ctrio Lab)MCP serverMCP
by com.ctriolab
Live

Google Hotels prices via Apify: price per booking site, rating, reviews and class for your dates.

Travel & Booking~100%Web Scraping~73%
https://mcp.apify.com/?tools=ctriolab/google-hotels-scraperok 7 h ago
OverwingAgentA2A
by Overwing
Live

Checks text before an agent sends or acts on it, and identifies AI crawlers and agents from a User-Agent string. Send a message with the text and get back a verdict and one recommended action: block, redact, review or allow. Answers at once; it is a service, not a conversation. Overwing also makes …

Web Scraping~100%Identity & Access~60%
https://overwing.ai/a2aok 11 min ago
YouTube Transcript Scraper (Apify)MCP serverMCP
by harshmaur
Live

YouTube transcripts with timestamps, SRT/VTT and translation. No YouTube login. From $4/1k

Web Scraping~73%
https://mcp.apify.com/?tools=harshmaur/youtube-transcript-scraperok 18 h ago
TikTok Scraper (Apify) – videos, profiles, comments, transcriptsMCP serverMCP
by harshmaur
Live

TikTok videos, profiles, hashtags, search, comments and followers as JSON. No login. $0.35/1k videos

Social Media~100%Web Scraping~73%
https://mcp.apify.com/?tools=harshmaur/tiktok-scraperok 17 h ago
LinkedIn Jobs Scraper (Apify) – salary, recruiter and company dataMCP serverMCP
by harshmaur
Live

LinkedIn job listings as JSON: salary, recruiter, applicants, company data. No login. From $0.40/1k

Social Media~100%Web Scraping~73%
https://mcp.apify.com/?tools=harshmaur/linkedin-jobs-scraperok 17 h ago
Facebook Ads Library Scraper (Apify)MCP serverMCP
by harshmaur
Live

Export Meta ads with copy, media, dates and audience data. No Facebook login. From $0.40/1k

Marketing~100%Web Scraping~73%
https://mcp.apify.com/?tools=harshmaur/facebook-ads-library-scraperok 16 h ago
Oracle Recruiting Cloud Jobs Scraper (Apify) - any company career siteMCP serverMCP
by datadmon
Live

Oracle Recruiting Cloud (HCM) career-site jobs as JSON for any company: full JD, dates. $2/1k

HR & Recruiting~100%Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/oracle-hcm-jobs-scraperok 13 min ago
Luma Events Scraper (Apify) - lu.ma events by city, category or calendarMCP serverMCP
by datadmon
Live

Luma (lu.ma) events as JSON by city, category or calendar: date, venue, hosts, tickets. $1.50/1k

Calendar & Scheduling~100%Product Analytics~100%Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/luma-events-scraperok 17 h ago
Instahyre Jobs Scraper (Apify) - India startup and product-company tech jobsMCP serverMCP
by datadmon
Live

Instahyre India startup tech jobs as JSON: full JD, skills, company size. $0.80/1k

Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/instahyre-jobs-scraperok 4 h ago
Hirist Jobs Scraper (Apify) - India IT and tech jobsMCP serverMCP
by datadmon
Live

Hirist India tech jobs as JSON: full JD, skills, salary when disclosed, applicants. $2/1k

Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/hirist-jobs-scraperok 17 h ago
Foundit Jobs Scraper (Apify) - foundit.in / Monster India jobsMCP serverMCP
by datadmon
Live

foundit (Monster India) jobs as JSON: any function, full JD, salary, apply link. $0.80/1k

Web Scraping~73%
https://mcp.apify.com/?tools=data_daemon/foundit-jobs-scraperok 6 h ago
AgentDiet B2A Semantic Distillation Agent (rag-diet.agentdiet.dev)AgentA2Averified owner
by AgentDiet B2A Infrastructure
Live

Autonomous Token Diet & Semantic De-bloater Agent. Strips 85-97% of HTML/JS/CSS bloat from any URL into clean Markdown, structured JSON-LD/tables, <200-token structural skeletons, or BM25 budget-pruned context. (Live A2A v0.3, MCP & x402 v2 node at https://rag-diet.agentdiet.dev)

Data Extraction~100%Vector SearchWeb ScrapingDeep Web Research
https://rag-diet.agentdiet.devok 13 min ago
AgentDiet B2A Semantic Distillation Agent (docs.agentdiet.dev)AgentA2Averified owner
by AgentDiet B2A Infrastructure
Live

Autonomous Token Diet & Semantic De-bloater Agent. Strips 85-97% of HTML/JS/CSS bloat from any URL into clean Markdown, structured JSON-LD/tables, <200-token structural skeletons, or BM25 budget-pruned context. (Live A2A v0.3, MCP & x402 v2 node at https://docs.agentdiet.dev)

Data Extraction~100%Documentation Lookup~100%Web ScrapingVector SearchDeep Web Research
https://docs.agentdiet.devok 13 min ago
Enrichment Crawlers MCP by InsightfulPipeMCP serverMCP
by com.insightfulpipe
Live

Hosted Enrichment Crawlers MCP server, with each action switched on or off per account.

Web Scraping~100%People & Company Research~100%
https://enrichment-crawlers.insightfulmcp.comok 10 min ago
Web Crawler MCP by InsightfulPipeMCP serverMCP
by com.insightfulpipe
Live

Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.

Web Scraping~100%
https://crawler.insightfulmcp.comok 1 h ago
Creator Desk Machine ProductsAgentA2A
by Creator Desk AI
Live

Free A2A capability discovery for Creator Desk's x402-paid HTTP APIs. Returns catalog, schemas, prices and purchase URLs; paid execution stays on the returned x402 HTTP or MCP routes.

E-commerce OperationsDocument ConversionWeb ScrapingDeep Web ResearchTeam Chat~51%
https://creator-desk-x402-isolated.onrender.comok 8 h ago
SEC, Treasury & Agent UtilitiesAgentA2A
by SEC, Treasury & Agent Utilities
Live

Pay-per-call HTTP API: SEC EDGAR filings, US Treasury yield curve, Stablecoin supply, Entity and compliance lookups, Agent utilities, x402 seller checks and agent demand index. Each paid route answers 402 with an x402 V2 challenge (USDC on base, eip155:8453); pay and retry. No account and no API ke…

Web ScrapingProduct Analytics~64%Contracts & Legal~62%
https://x402.donnyautomation.comok 5 h ago
QuanticData Data APIAgentA2A
by QuanticData
Live

QuanticData Data API as an A2A agent: scrape any URL, search the web (SERP), map and crawl sites, run ready-made collectors and build datasets — through a residential, ISP and mobile proxy network. Every skill is a direct, deterministic call to the Data API with the same parameters and the same pay…

Web SearchWeb ScrapingCI/CD & DeployDeep Web ResearchMaps & Places
https://quanticdata.iook 7 h ago
QuantumProxies.io Data APIAgentA2A
by QuantumProxies.io
Live

QuantumProxies.io Data API as an A2A agent: scrape any URL, search the web (SERP), map and crawl sites, run ready-made collectors and build datasets — through a residential, ISP and mobile proxy network. Every skill is a direct, deterministic call to the Data API with the same parameters and the sa…

Web SearchWeb ScrapingCI/CD & DeployDeep Web ResearchMaps & Places
https://quantumproxies.iook 2 h ago
Website Contact ScraperMCP serverMCP
by fernandoguiraud16-coder
Live

Company role emails, phones, address and social profiles from websites. No personal emails.

Web Scraping~73%
https://mcp.apify.com/?tools=fguiraud/website-contact-scraperok 5 h ago
← Previouspage 116 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather