We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2435 liveRefine in search →
Discourse Forum Scraper — Topics & PostsMCP serverMCP
by com.ranovam
Live

Scrape any public Discourse forum: topic titles, authors, reply counts, views and canonical URLs…

Web Scraping~73%Social Media~69%
https://mcp.apify.com/?tools=enezli/discourse-forum-scraperok 1 h ago
Cachet Status Page Scraper & Monitor ToolMCP serverMCP
by com.ranovam
Live

Search or monitor any self-hosted Cachet status page — not tied to one vendor.

Web Scraping~73%
https://mcp.apify.com/?tools=enezli/cachet-scraperok 13 h ago
BetterStack Status Page Scraper & API ToolMCP serverMCP
by com.ranovam
Live

Get any company's BetterStack (Better Uptime) status page as clean JSON — components, incidents…

Web Scraping~73%
https://mcp.apify.com/?tools=enezli/betterstack-scraperok 11 h ago
Ashby Job Scraper & API for Team Job BoardsMCP serverMCP
by com.ranovam
Live

Ashby ATS job scraper pulls live postings via API with team filtering.

Web Scraping~100%
https://mcp.apify.com/?tools=enezli/ashby-scraperok 28 min ago
Amazon Reviews Scraper & AI Review AnalysisMCP serverMCP
by com.ranovam
Live

Paste an Amazon product URL: reviews are collected for you and turned into a seller-ready action…

Code Review~100%E-commerce Operations~100%Web Scraping~73%
https://mcp.apify.com/?tools=enezli/amazon-review-intelligenceok 14 h ago
All Jobs Scraper - 10 ATS Job Boards in One ActorMCP serverMCP
by com.ranovam
Live

Scrape jobs from Greenhouse, Lever, Ashby, Workable, Recruitee, SmartRecruiters, Personio…

Web Scraping~73%HR & Recruiting~65%
https://mcp.apify.com/?tools=enezli/all-ats-jobs-scraperok 1 h ago
AI Website-to-JSON Data Scraper & ExtractorMCP serverMCP
by com.ranovam
Live

Turn any website into structured JSON data matching your custom schema.

Web Scraping~73%
https://mcp.apify.com/?tools=enezli/ai-website-to-datasetok 15 h ago
Swellmeter: Google Trends Scraper & API for AI AgentsMCP serverMCP
by CyberMax-tools
Live

Google Trends for agents: trend verdict, stats, rising queries, regions, trending now.

Web Scraping~73%
https://mcp.apify.com/?tools=cybermax/google-trendsok 28 min ago
Steady API ScrapersMCP serverMCP
by steadyapi
Live

YouTube transcripts, Google Hotels prices, Google Ads Transparency, Google Trends and Threads posts.

Web Scraping~73%
https://mcp.apify.com/?tools=steadyapi/youtube-transcript-scraper,steadyapi/google-hotels-scraper,steadyapi/google-ads-transparency-scraper,steadyapi/google-trends-scraper,steadyapi/threads-scraperok 18 h ago
Open Agent Utility IndexAgentA2A
Live

Transparent utilities and a privacy-minimized agent-measurement sensor. For paid tool gateways, follow the skill hop first.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Weather~51%E-commerce Operations~51%
https://agent-observatory-sensor.nolimit-observatory.workers.devok 2 d ago
API Acre Discovery AgentAgentA2A
by API Acre
Live

Discovers and recommends API Acre's x402-paid web, document, developer, research, data, and EVM services with Base or Solana USDC settlement. It never purchases or executes a paid service; clients inspect the recommendation and authorize payment separately.

SpreadsheetsWeb ScrapingAPI AccessPricing & QuotesDocument Conversion
https://apiacre.comok 8 h ago
TensorFeedAgentA2A
by TensorFeed.ai
Live

TensorFeed is a real-time AI ecosystem data provider built for agents. It exposes free and x402-priced JSON feeds covering AI news, model and GPU pricing, service status and uptime, research papers, security advisories, agent-discovery maps (which sites allow AI crawlers and how agent-ready they ar…

Web Scraping~100%News & FeedsMonitoring & ObservabilityPricing & Quotes
https://tensorfeed.aiok 5 h ago
PennyAPI Web Search + PlacesAgentA2A
by PennyAPI
Live

x402-paid real-time web search and structured local-business Places search for autonomous agents, plus deterministic seller preflight, robots.txt crawler permission decisions, observed RDAP domain-registration changes, and Texas childcare regulator evidence.

Monitoring & ObservabilityWeb ScrapingMaps & PlacesWeb SearchPayments
https://pennyregwatch.comok 5 h ago
Arch ToolsAgentA2A
by Arch Tools
Live

The first API platform built for autonomous agent payments. 63 production-ready tools for AI agents and developers. Web scraping, AI generation, crypto data, NLP, media, validation, and more.

Deep Web ResearchBrowser AutomationMarkets & TradingReasoning & PlanningCode Generation
https://archtools.devok 5 h ago
AgentReaderAgentA2A
Live

Pay-per-call content extraction and web intelligence for AI agents. 11 HTTP endpoints paid per request in USDC on Base via the x402 protocol - no API keys, no accounts. Failed requests are never charged.

Data Extraction~100%Web ScrapingWriting & Editing~54%
https://agentreader.devok 7 h ago
agentbuiltAgentA2A
by agentbuilt
Live

Measures and fixes how AI assistants and agents see a brand. Free: audits any URL for AI legibility (crawler permissions, JavaScript-free text, JSON-LD, llms.txt, agent card) and returns concrete fixes. Also lists pay-per-result data tools for AI pipelines: YouTube transcripts, Substack archives, S…

Web ScrapingE-commerce OperationsReporting & DashboardsSEOVector Search
https://agentbuilt.dev/api/a2aok 4 h ago
Rattlesnakes By MailAgentA2A
by Benes the Menace
Live

A public record of documented and observed behaviour of AI crawlers, fetchers and search bots. Every claim carries a vendor quote, a date and a source URL. Dataset published under CC BY 4.0.

Web Scraping~91%
https://rattlesnakesbymail.comok 3 h ago
ai-crawler-readinessMCP serverMCP
by com.lumnika
Live

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

Web Scraping~100%Browser Automation~51%
https://shop.lumnika.com/ai-readiness/mcpok 1 h ago
AI Crawler IndexAgentA2A
by Pathwren
Live

{"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"whoami\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a with content-type: application/json and you are done; it comes back as a Task already…

Web Scraping~100%Monitoring & ObservabilityDocumentation Lookup
https://www.pathwren.workers.dev/a2aok 5 h ago
Foliora Managed AI SearchMCP serverMCP
by ai.foliora
Live

Foliora MCP for public discovery, account reads, and agent execution of human-approved changes.

Reporting & Dashboards~100%Web Scraping~99%Secrets Management~57%
https://www.foliora.ai/mcpok 2 h ago
← Previouspage 120 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather