wellknown
SearchCapabilitiesReliabilityJournalSourcesDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • Search
  • Capabilities
  • Reliability report
  • Journal
  • Sources & freshness
  • Network status
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.v0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

285 records102 liveRefine in search →
Arch ToolsAgentA2A
by Arch Tools
Unknown

The first API platform built for autonomous agent payments. 63 production-ready tools for AI agents and developers. Web scraping, AI generation, crypto data, NLP, media, validation, and more.

Deep Web ResearchBrowser AutomationMarkets & TradingReasoning & PlanningCode Generation
https://archtools.dev
Scrapling MCP ServerMCP serverMCP
by D4Vinci
Unknown

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

Web ScrapingBrowser AutomationData Extraction~71%
oci:ghcr.io/d4vinci/scrapling · local packagepublished 13 d ago
eyebrowseMCP serverMCP
by Evil-Bane
Unknown

Stealthy, LLM-drivable browser engine — a Python library + 85-tool MCP server on stealth Chromium.

Browser AutomationWeb Scraping
pypi:eyebrowse · local packagepublished 3 mo ago
DLBrowserMCP serverMCP
by DekryptLabs
Unknown

Self-healing web access for AI agents — recovers through bot blocks, captchas and JS pages.

Web ScrapingBrowser AutomationCloud Platforms~71%
pypi:dlbrowser · local packagepublished 2 mo ago
AiPayGen — 65+ AI Tools as an MCP ServerMCP serverMCP
by Damien829
Unknown

65+ AI tools as MCP: research, write, code, scrape, translate, RAG, agent memory, workflows

TranslationWeb ScrapingCode Generation~75%
https://mcp.aipaygen.com/mcppublished 5 mo ago
bluesky-profile-scraperMCP serverMCP
by Cookient16
Unknown

Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay per record.

Web Scraping~73%
https://mcp.apify.com/?actors=cooki/bluesky-profile-scraper
bluesky-mentions-scraperMCP serverMCP
by Cookient16
Unknown

Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per result.

Web Scraping~73%
https://mcp.apify.com/?actors=cooki/bluesky-mentions-scraper
Amazon Scraper APIMCP serverMCP
by ChocoData-com
Unknown

Scrape Amazon products, search, and async batch ASIN lookups across 20 marketplaces

E-commerce Operations~100%Web Scraping~73%
npm:amazon-scraper-api-mcp · local package
OmniSeekMCP serverMCP
by Battam1111
Unknown

Your agent seeks what search can't find. A self-hosted perception MCP server.

Speech RecognitionWeb ScrapingVector SearchKnowledge Graphs~62%
oci:ghcr.io/battam1111/omniseek:v0.2.0 · local packagepublished 20 d ago
MarkGrabMCP serverMCP
by ArkNill
Unknown

Universal web content extraction — any URL to LLM-ready markdown. HTML, YouTube, PDF, DOCX.

Data Extraction~100%Web ScrapingVector Search
pypi:markgrab · local packagepublished 5 mo ago
B4n1WebMCP serverMCP
by B4N1-com
Unknown

Ultra-lightweight browser engine for AI agents. 33 MCP tools, 4 SDKs, cross-platform.

Browser AutomationWeb Scraping
npm:b4n1-web · local packagepublished 4 d ago
Web Scraper to Markdown APIMCP serverMCP
by Br0ski777
Unknown

Extract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402.

Web Scraping~73%
https://web-scraper.api.klymax402.com/mcp
Twitter Scraper APIMCP serverMCP
by Br0ski777
Unknown

Scrape Twitter/X profiles, tweets, search. No API key. Structured JSON. x402 pay-per-call.

Social Media~100%Web Scraping~73%
https://twitter-scraper.api.klymax402.com/mcp
AmalgixAgentA2AMCP
by Amalgix
Unknown

Cross-model evidence pipeline for AI agents. Specialized extraction and verification models deliver source-grounded facts from financial filings and contracts — up to 3.8x cheaper than calling frontier models directly. Public paid workflows: analyze_public_filing, review_contract_risks, and analyze…

TranslationLocalizationWriting & EditingCode Review~100%Data Extraction
https://amalgix.io/mcp
spotifyscraperMCP serverMCP
by AliAkhtari78
Unknown

Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.

Web ScrapingMusic & Audio
pypi:spotifyscraper · local packagepublished 2 mo ago
stagenth · 网页数据MCP serverMCP
by com.stagenth
Unknown

Web scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.

Web Scraping~79%
https://stagenth.com/mcp/web
Kiprio MCP ServerMCP serverMCP
by com.kiprio
Unknown

23 API tools for Claude Code — email, DNS, SSL, NLP, scraping. Free tier included.

Web ScrapingEmail~100%API Access~75%
pypi:kiprio-mcp · local packagepublished 1 mo ago
Google Maps ScraperMCP serverMCP
by com.gmapsextractor
Unknown

Live Google Maps business search, review, and photo data for AI agents over MCP.

Maps & Places~100%Web Scraping~73%
https://cloud.gmapsextractor.com/api/mcp
ActableSite AI Crawler MonitorMCP serverMCP
by com.actablesite
Unknown

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Web Scraping~100%
https://actablesite.com/mcp
WebRunAgentA2A
by WebRun
Unknown

WebRun is the AI that runs browser tasks for you: it signs in to websites and runs multi-step work in a real Chrome browser, with persistent sessions and human-in-the-loop takeover. It also exposes a library of 8,000+ ready-made automation templates.

Browser AutomationPrompt Management~100%Web ScrapingDeep Web Research
https://api.webrun.ai
← Previouspage 14 of 15Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather