We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2434 liveRefine in search →
Deel Jobs Scraper & API - All Deel ATS Career Pages with PayMCP serverMCP
by AnshumanAtrey
Live

Deel Jobs Scraper - Every Deel ATS Career Page

Web Scraping~100%HR & Recruiting~100%
https://mcp.apify.com/?tools=anshumanatrey/deel-jobs-searchok 18 h ago
Cornerstone Jobs Scraper & API - All CSOD Career Sites, RemoteMCP serverMCP
by AnshumanAtrey
Live

Cornerstone Jobs Scraper - Every CSOD Career Site

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/cornerstone-jobs-searchok 20 h ago
Ashby Jobs Scraper & API - All Companies, Remote, Last 24 HoursMCP serverMCP
by AnshumanAtrey
Live

Ashby Jobs Scraper - Search Every Ashby Job Board

Web Scraping~100%
https://mcp.apify.com/?tools=anshumanatrey/ashby-jobs-searchok 19 h ago
x402engineAgentA2A
by x402engine
Live

Pay-per-call API gateway for AI agents. 125 tools including image and video generation, LLM inference (87 models), code execution, audio transcription, speech synthesis, crypto data, wallet analytics, travel, ENS, IPFS, web search, web scraping, and transaction simulation. All via HTTP 402 micropay…

Deep Web ResearchVideo Generation~100%Speech SynthesisSpeech RecognitionPayments
https://x402engine.appok 5 h ago
ForgeMesh Utility GridAgentA2A
by ForgeMesh Labs
Live

Hundreds of pay-per-call utility APIs for AI agents (text, data, dev tools, government and vehicle data) at $0.005-$0.05 per call. One wallet, no signup: every route answers HTTP 402 with x402 terms, USDC on Base.

E-commerce OperationsDocumentation Lookup~54%Web Scraping~51%
https://x402.forgemesh.iook 3 h ago
Why Won't AI Mention My ProductAgentA2A
by Why Won't AI Mention My Product
Live

Checks how search and AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Googlebot and others) see a website: robots.txt access for 17 crawlers, and full AI visibility scans scored across six SEO, AEO and GEO categories.

Web Scraping~100%SEOReporting & Dashboards
https://mcp.whywontai.com/a2aok 4 h ago
Cited GEO AgentAgentA2A
by Cited Inc.
Live

Cited is a Generative Engine Optimization (GEO) platform agent that audits, optimizes, and monitors business visibility across AI-powered assistants including ChatGPT, Gemini, Claude, and Google AI Mode and AI Overviews. Supports business onboarding, multi-engine GEO audits, actionable recommendati…

Academic ResearchWeb Scraping
https://youcited.comok 2 h ago
YouTube Transcript ScraperMCP serverMCP
by com.quarralabs
Live

YouTube transcripts from videos, Shorts, channels, playlists and searches, with timestamps.

Web Scraping~73%
https://mcp.apify.com/?tools=quarra/youtube-transcript-scraperok 8 h ago
Threads ScraperMCP serverMCP
by com.quarralabs
Live

Threads public posts, replies and profiles, with view counts, keyword and account search.

Web Scraping~73%
https://mcp.apify.com/?tools=quarra/threads-scraperok 8 h ago
Reddit ScraperMCP serverMCP
by com.quarralabs
Live

Reddit posts, full comment trees, searches, subreddits and users, as JSON or Markdown for LLMs.

Web Scraping~73%
https://mcp.apify.com/?tools=quarra/reddit-scraperok 9 h ago
Google Trends ScraperMCP serverMCP
by com.quarralabs
Live

Google Trends interest over time, by region, related queries and Trending now, as JSON.

Web Scraping~73%
https://mcp.apify.com/?tools=quarra/google-trends-scraperok 7 h ago
AliExpress Search ScraperMCP serverMCP
by com.quarralabs
Live

AliExpress search results from keywords or category URLs: price, rating, units sold.

Web Scraping~73%
https://mcp.apify.com/?tools=quarra/aliexpress-search-scraperok 7 h ago
AliExpress ScraperMCP serverMCP
by com.quarralabs
Live

AliExpress products: every variant with price and stock, shipping to your country, reviews.

Web Scraping~73%
https://mcp.apify.com/?tools=quarra/aliexpress-scraperok 8 h ago
VIA RouterAgentA2A
by VIA
Live

Paid buyer-side x402 comparison, research and procurement. One-Call uses VIA-owned paid tools first. Eligible external Transit execution is enabled. One internal PDF validation completed buyer payment, supplier payment and delivery; this is not an external customer sale or proof of every supplier. …

Contracts & Legal~100%Travel & BookingMarkets & Trading~100%E-commerce OperationsDeep Web Research
https://via-router.floot.appok 8 h ago
YouTube Channel Info ScraperMCP serverMCP
by sumitrmardy
Live

Public channel stats, external links, keyword discovery and recent long-form upload activity.

Team Chat~100%Web Scraping~73%
https://mcp.apify.com/?tools=sumitr_mardy/youtube-channel-infook 7 h ago
Google Hotels ScraperMCP serverMCP
by sumitrmardy
Live

Hotel nightly prices and stay totals for two adults, with city, dates and resolved-place checks.

Travel & Booking~100%Web Scraping~73%
https://mcp.apify.com/?tools=sumitr_mardy/google-hotels-scraperok 7 h ago
Diogenes Sovereign Edge Gateway AgentAgentA2A
by Diogenes Autonomous Collective
Live

Account-less multi-protocol AI & Web3 gateway exposing 121 edge microservices and 45 Google Gemini models & agents via Streamable HTTP MCP and 6 cryptographic micropayment rails.

Data Extraction~100%Databases~100%Web Search~75%Deep Web Research~75%Web Scraping~68%
https://diogenes-micro-gateway.corinth.workers.devok 4 h ago
Website Crawler — Markdown Pages, Sitemaps & RAG ProvenanceMCP serverMCP
by kriton-dev
Live

Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

Web Scraping~100%Vector Search~65%
https://mcp.apify.com/?tools=hermeskd/website-to-markdownok 9 h ago
Remote Jobs Scraper — Remote OK Listings, Salary Filter, LinksMCP serverMCP
by kriton-dev
Live

Get current remote jobs from Remote OK filtered by keyword, tag, seniority, country and salary

Web Scraping~73%
https://mcp.apify.com/?tools=hermeskd/remote-jobsok 11 h ago
Lever Jobs Scraper — Postings from Any Lever Site, US & EUMCP serverMCP
by kriton-dev
Live

Get every published job from any company's Lever site, global or EU, fetched live

Web Scraping~73%
https://mcp.apify.com/?tools=hermeskd/lever-jobsok 12 h ago
← Previouspage 113 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather