We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2437 liveRefine in search →
@houndmcp/hound-mcp-piMCP serverMCP
by dondai1234
Unknown

Hound web research for Pi agent - keyless search, anti-bot fetch, deep crawl, screenshot, Internet Archive dead-link recovery. Free, MIT, no API key.

Web ScrapingDeep Web ResearchPackages & Dependencies~66%
npm:@houndmcp/hound-mcp-pi · local package84/wkpublished 4 mo ago
deepseek-search-mcpMCP serverMCP
by caelix
Unknown

Local MCP server for DeepSeek web search

Web SearchWeb Scraping~69%
npm:deepseek-search-mcp · local package83/wkpublished 22 d ago
search-mcp-rotatorMCP serverMCP
by sahilchouksey
Unknown

Transparent API key rotation proxy for MCP search providers — Exa, Firecrawl, Tavily, Linkup, Bright Data, Olostep, Dappier, Parallel

Web SearchWeb Scraping
npm:search-mcp-rotator · local package82/wkpublished 1 mo ago
BitBooth Agent ToolsMCP serverMCP
by Drock91
Unknown

Discover BitBooth APIs for free, then buy capped x402 fetch, PageDelta, and wallet checks.

Payments~100%Browser AutomationMarkets & TradingWeb Scraping
npm:@bitbooth/mcp-fetch · local package80/wkpublished 2 mo ago
create-webclawMCP serverMCP
by 0xmassii
Unknown

Set up webclaw MCP server for AI agents (Claude, Cursor, Windsurf, OpenCode, Codex, Antigravity)

Web ScrapingCloud Platforms~71%
npm:create-webclaw · local package79/wkpublished 2 mo ago
web-content-extractorMCP serverMCP
by agenson-horrowitz
Unknown

Extract and process web content into clean, structured formats optimized for LLMs.

Data Extraction~100%Web ScrapingDocument Conversion~71%
npm:@agenson-horrowitz/web-content-extractor-mcp · local package78/wkpublished 7 mo ago
deep-research-mcp-serverMCP serverMCP
by Perufitlife
Unknown

Web search, clean page reading & one-call research dossiers for AI agents. No API key.

Web SearchWeb ScrapingDeep Web Research~100%Vector Search
npm:deep-research-mcp-server · local package78/wkpublished 5 mo ago
@spicrawl/cliMCP serverMCP
by spicrawl
Unknown

Spicrawl CLI: scrape any URL to Markdown or JSON, batch crawl URLs and extract structured data from your terminal. Built for LLM and AI agent workflows.

Data Extraction~100%Web ScrapingTerminal & Shell
npm:@spicrawl/cli · local package78/wkpublished 1 mo ago
taskfleet-mcpMCP serverMCP
by BFAI-1
Unknown

Pay-per-call MCP tools: web search, scraping, on-chain wallet intel, extraction. x402 USDC on Base.

Code Review~100%Data Extraction~100%Web SearchWeb ScrapingTranslation
npm:taskfleet-mcp · local package77/wkpublished 3 mo ago
agentql-mcpMCP serverMCP
by tinyfish-io
Unknown

Model Context Protocol (MCP) server that integrates AgentQL data extraction capabilities.

Data Extraction~100%Web Scraping
npm:agentql-mcp · local package77/wkpublished 9 mo ago
@xbrowser/cliAgent
by dyyz1993
Unknown

Browser automation CLI for web scraping, headless browsing, SEO analysis, and AI agent workflows. A command-line alternative to Playwright, Puppeteer, and Selenium.

Web ScrapingTerminal & ShellBrowser AutomationSEOWeb Search~75%
npm:@xbrowser/cli · local package74/wkpublished 13 d ago
NetLensMCP serverMCP
by pzalutski-pixel
Unknown

Read any web page as clean, ad-stripped Markdown past robots.txt and bot blocks, plus web search.

Web SearchWeb ScrapingDeep Web Research
npm:netlens-mcp · local package74/wkpublished 4 mo ago
cashclawAgent
by ertugrulakben
Unknown

The Agent Economy Layer — agents earn, agents spend, Guard protects. 13 skills with runtime cost cap, recursive kill, tool firewall.

Web ScrapingPaymentsEmail~62%
npm:cashclaw · local package73/wkpublished 6 mo ago
x402-url-to-markdownMCP serverMCP
by agentgate-builder
Unknown

URL to Markdown for AI agents and LLMs: turn any public web page into clean Markdown (HTML to Markdown, SSRF-safe, robots.txt-aware). MCP server (stdio + remote), zero-dependency library and x402 pay-per-call API ($0.002 USDC on Base).

Web ScrapingVector Search
npm:x402-url-to-markdown · local package72/wkpublished 18 d ago
sitemothMCP serverMCP
by recurpost
Unknown

Sitemoth: desktop-class SEO crawler engine, CLI and MCP server (crawl, 180 checks, exports, Search Console, GA4, PageSpeed, spelling, accessibility).

Web ScrapingSEO
npm:sitemoth · local package71/wkpublished 18 d ago
vinted-mcp-serverMCP serverMCP
by kazkn
Unknown

MCP Server for Vinted marketplace — search items, compare prices, analyze sellers across 19 countries. Works with Claude Desktop, Cursor, and any MCP client.

Web Scraping
npm:vinted-mcp-server · local package71/wkpublished 9 mo ago
cockroach-crawlerMCP serverMCP
by AjnasNB
Unknown

Give AI agents superpowers on the web: crawl, render, map, extract, and verify evidence through one governed Node.js crawler.

Web ScrapingCloud Platforms~100%Social MediaData Extraction~71%Browser Automation~66%
npm:cockroach-crawler · local package71/wkpublished 3 mo ago
llm-crawler-auditMCP serverMCP
by surendranb85
Unknown

Model Context Protocol (MCP) server for AI & LLM crawler readiness via NPX. Audits robots.txt for AI bots, validates /llms.txt, and verifies markdown mirror content negotiation.

Web Scraping~100%
npm:llm-crawler-audit · local package71/wkpublished 22 d ago
aethyn-browser-mcpMCP serverMCP
by aethynio
Unknown

Local Playwright browser through residential proxies — agent picks country + sticky identity

Browser AutomationWeb Scraping
npm:aethyn-browser-mcp · local package71/wkpublished 4 mo ago
AnakinMCP serverMCP
by io.anakin
Unknown

Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation

Web ScrapingBrowser Automation~86%
npm:@anakin-io/mcp · local package71/wkpublished 2 mo ago
← Previouspage 130 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather