We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2439 liveRefine in search →
ADA · 艾达MCP serverMCP
by ai.hengyu.group
Unknown

全国 agent 的公共仓库:谁加工过一份,存回库里;要用同一份的人直接取 —— 同一件事,全国只干一次。查 find/取 get/存 put 三条命令;另有网页正文解析(全站共享缓存、省 token)、长文本检索、标准时间、Ed25519 验签、1MB 键值存储。取用免密钥。

Agent MemoryIdentity & AccessWeb Scraping~69%
no endpoint declared
Open SEO CrawlerMCP serverMCP
by puneetindersingh
Unknown

Self-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.

SEO~100%Web Scraping~100%
no endpoint declared
KitchenSink4WebMCP serverMCP
by KitchenSink4AI
Unknown

Browser MCP server: budgeted page reads, honest unread accounting, structured extraction.

Browser AutomationWeb ScrapingDeep Web Research
pypi:kitchensink4web · local packagepublished 26 d ago
B4n1WebMCP serverMCP
by B4N1-com
Unknown

Ultra-lightweight browser engine for AI agents. 33 MCP tools, 4 SDKs, cross-platform.

Browser AutomationWeb Scraping
npm:b4n1-web · local packagepublished 25 d ago
SmartCLI — drive terminal TUIsMCP serverMCP
by dwgx
Unknown

Let agents drive vim, htop, lazygit: send keys, wait on screen state, read the rendered cell grid.

Terminal & ShellWeb Scraping~68%
pypi:smartcli-toolkit · local packagepublished 28 d ago
veddataMCP serverMCP
by SanZiNEO
Unknown

MCP server for AI agents: discover a web page's data sources and drive the page to reach them.

Browser AutomationWeb ScrapingData Extraction~71%
pypi:veddata · local packagepublished 28 d ago
Scrawly MCP ServerMCP serverMCP
by IliasSami
Unknown

MCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.

Web Scraping~100%SEO
pypi:sentinelseo · local packagepublished 1 mo ago
NanoParse MCP serverMCP serverMCP
by nanoparse.app
Unknown

MCP server that reads a URL into clean Markdown with source-intelligence signals. Pay-per-parse ($0.005 USDC on Base via x402); no account or API key.

Web Scraping~54%
no endpoint declared
fortressMCP serverMCP
by tiliondev
Unknown

Stealth browser for AI agents: fetch pages behind Cloudflare/DataDome/CAPTCHA, extract clean data.

Browser AutomationCloud PlatformsWeb Scraping
pypi:tilion · local packagepublished 1 mo ago
Flyto CoreMCP serverMCP
by flytohub
Unknown

Execution engine for AI agents. 412 modules: browser, file, Docker, data, crypto.

Browser AutomationWeb Scraping
pypi:flyto-core · local packagepublished 1 mo ago
SiftdogMCP serverMCP
by khsarvar
Unknown

Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.

Web SearchWeb ScrapingVector Search
pypi:siftdog · local packagepublished 1 mo ago
SluicerMCP serverMCP
by Gi0tto
Unknown

The data a web page declares, with where each value came from. No model, no API key.

Data ExtractionWeb Scraping
pypi:sluicer · local packagepublished 1 mo ago
@mseep/puppeteer-mcp-claudeMCP serverMCP
by skydeckai
Unknown

Browser automation MCP server for Claude, powered by Puppeteer.

Browser AutomationWeb Scraping
npm:@mseep/puppeteer-mcp-claude · local package0/wkpublished 5 mo ago
PageMapMCP serverMCP
by Retio-ai
Unknown

Structured web intelligence for AI agents. 5x fewer tokens than Playwright/Firecrawl, 84.7% accuracy

Web ScrapingBrowser Automation
oci:docker.io/retio1001/pagemap:0.7.3 · local packagepublished 6 mo ago
unbrowser by UnchainedMCP serverMCP
by protostatis
Unknown

Chrome-free MCP web access for agents with low-token page maps and browser escalation hints.

Browser AutomationWeb Scraping
pypi:pyunbrowser · local packagepublished 3 mo ago
maccydee/cute-web-scraperMCP serverMCP
by maccydee
Unknown

[![maccydee/cute-web-scraper MCP server](https://glama.ai/mcp/servers/maccydee/cute-web-scraper/badges/score.svg)](https://glama.ai/mcp/servers/maccydee/cute-web-scraper) - Web scraping with escalating fetch tiers on detected blocks, returning clean Markdown or saving large scrapes to SQLite f…

Web Scraping~100%Browser AutomationDatabases~75%
no endpoint declared
PyreCrawlMCP serverMCP
by SanggonBoy
Unknown

Web scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.

Web ScrapingBrowser AutomationVector Search
pypi:pyrecrawl · local packagepublished 2 mo ago
aparajithn/agent-scraper-mcpMCP serverMCP
by aparajithn
Unknown

[![agent-scraper-mcp MCP server](https://glama.ai/mcp/servers/@aparajithn/agent-scraper-mcp/badges/score.svg)](https://glama.ai/mcp/servers/@aparajithn/agent-scraper-mcp) - Web scraping: clean content extraction, CSS-selector scraping, Playwright screenshots, link and metadata extraction, and Goo…

Web Scraping~100%Browser Automation
no endpoint declared
ami-guru/x402-scraper-engineMCP serverMCP
by ami-guru
Unknown

[![ami-guru/x402-scraper-engine MCP server](https://glama.ai/mcp/servers/ami-guru/x402-scraper-engine/badges/score.svg)](https://glama.ai/mcp/servers/ami-guru/x402-scraper-engine) - Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.

Web Scraping~100%Browser Automation
no endpoint declared
WebReaperMCP serverMCP
by alex-on-ai
Unknown

AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.

Browser AutomationWeb Scraping~78%
no endpoint declared
← Previouspage 148 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather