We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2435 liveRefine in search →
reddit-scraperMCP serverMCP
by fashionmascherine-svg
Live

Reddit MCP server: search posts, subreddit feeds, comments & user profiles as JSON. No API key.

Web Scraping~73%
https://opportunity-biz--reddit-scraper.apify.actor/mcpok 6 h ago
tiktok-transcript-scraperMCP serverMCP
by deapi-ai
Live

AI speech-to-text for public TikTok videos: SRT, VTT, word timings, speaker labels, 90+ languages.

Social Media~100%Web Scraping~73%
https://mcp.apify.com/?tools=deapi/tiktok-transcript-scraperok 12 h ago
ApexApiAgentA2A
by Nitrotech Inc.
Live

Unified AI gateway with live web context for agents. One API key (prefix `ak-`) and one OpenAI-compatible base URL (https://api.apexapi.dev/v1) to call 120+ models from OpenAI, Anthropic, Google, Alibaba (Qwen), DeepSeek, Mistral, and more, billed by usage from a credit balance — plus web scrape, c…

Speech SynthesisWeb ScrapingE-commerce OperationsPricing & QuotesTeam Chat
https://apexapi.devok 2 h ago
shopify-app-store-scraperMCP serverMCP
by PrometheusAgency
Live

Scrape Shopify App Store apps, full review histories and catalog. E-commerce market research.

E-commerce Operations~100%Web Scraping~73%
https://mcp.apify.com/?actors=prometheusagency/shopify-app-store-scraperok 17 h ago
bluesky-scraperMCP serverMCP
by PrometheusAgency
Live

Scrape Bluesky posts, profiles, followers, threads and keyword search. Clean JSON, pay per result.

Web Scraping~73%
https://mcp.apify.com/?actors=prometheusagency/bluesky-scraperok 1 h ago
Brainiall WebMCP serverMCP
by com.brainiall
Live

Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.

Web Scraping~88%Code Documentation~58%
https://api.brainiall.com/mcp/web/mcpok 8 h ago
bluesky-profile-scraperMCP serverMCP
by Cookient16
Live

Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay per record.

Web Scraping~73%
https://mcp.apify.com/?actors=cooki/bluesky-profile-scraperok 15 h ago
bluesky-mentions-scraperMCP serverMCP
by Cookient16
Live

Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per result.

Web Scraping~73%
https://mcp.apify.com/?actors=cooki/bluesky-mentions-scraperok 12 h ago
llms.txt Generator Agent ToolsAgentA2A
by track by track GmbH
Live

Read-only tools for generating, validating and checking llms.txt files and their Lighthouse Agentic Browsing structure.

Monitoring & ObservabilityWeb Scraping~62%
https://www.llms-txt-generator.deok 1 h ago
agent-web-readerAgentA2A
by Charlie Morrison
Live

Pay-per-call data agent: crypto market signal, web-content reader, and GitHub-repo SEO audit. Each skill is settled per call via x402 (USDC on Base) — no API key, no signup.

SEOVersion ControlMarkets & TradingWeb ScrapingVector Search
https://x402.charliemorrison.devok 8 h ago
Ultimate Web ScraperMCP serverMCP
by com.ultimatewebscraper
Live

Scrape and crawl websites into queryable tables: products, leads, Shopify catalogs, real estate.

Web Scraping~100%E-commerce Operations~100%
https://mcp.ultimatewebscraper.com/mcpok 9 h ago
Scraper APIMCP serverMCP
by com.scraper-api
Live

One API for public web data across social, directories and real estate, as clean JSON.

Web Scraping~73%
https://api.scraper-api.com/mcpok 9 h ago
Google Maps ScraperMCP serverMCP
by com.gmapsextractor
Live

Live Google Maps business search, review, and photo data for AI agents over MCP.

Maps & Places~100%Web Scraping~73%
https://cloud.gmapsextractor.com/api/mcpok 4 h ago
Crimson CrawlerMCP serverMCP
by com.crimsoncrawler
Live

Enrich, search, assess, and manage threat intelligence through 80+ typed MCP tools.

Web Scraping~73%
https://crimsoncrawler.com/mcp/v1ok 3 h ago
webclawAgentA2A
by webclaw
Live

Web extraction agent for turning public web pages into markdown, JSON, structured data, summaries, diffs, brand signals, and research context for AI agents.

Writing & EditingData Extraction~100%Web ScrapingMonitoring & ObservabilityDeep Web Research
https://webclaw.iook 8 h ago
MercadopleisMCP serverMCP
by castiquark
Recently observed

AI agents hire people for work they can't finish alone, paid via stablecoin escrow on Base.

E-commerce Operations~100%Speech Recognition~58%Banking~58%SEO~53%Contracts & Legal~53%
https://mercadopleis.club/mcp134/wkpublished 15 d agook 3 d ago
Freedom Engine M2M Gateway & Task ClearinghouseMCP serverMCP
by m2mfreedom
Recently observed

Zero-reg HTTP 402 M2M Gateway, AI Worker Directory & Escrow Task Clearinghouse (L402/x402).

Vector Search~100%Filesystem~96%Agent Discovery~96%Reasoning & Planning~54%Code Execution~51%
https://m2mfreedom.com/mcpok 9 h ago
AEO LookupMCP serverMCP
by com.aeolookup
Recently observed

Free AI crawler, schema, llms.txt and answer-readiness checks for public web pages. No API key.

Invoice Processing~100%Pricing & Quotes~100%Web Scraping~91%Data Extraction~58%Calendar & Scheduling~55%
https://aeolookup.com/mcpok 25 h ago
robotbase-contentMCP serverMCP
by wygogogo19
Recently observed

Agent MCP: 35 tools — social hot lists, attention trends, 80k+ books, 17 web tools.

Web Scraping~100%Vector Search~100%News & Feeds~100%Reporting & Dashboards~100%Social Media~99%
https://content.robotbase.cc/mcpok 2 d ago
robotbase-web3MCP serverMCP
by wygogogo19
Recently observed

Agent MCP: 65 tools — 5-chain verification, risk, prediction & crypto trends, 17 web tools.

Web Scraping~100%Databases~100%News & Feeds~100%Monitoring & Observability~100%Payments~100%
https://web3.robotbase.cc/mcpok 2 d ago
← Previouspage 122 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather