We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2439 liveRefine in search →
SifthoundMCP serverMCP
by khsarvar
Unknown

Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.

Web SearchWeb ScrapingVector Search
pypi:sifthound · local packagepublished 1 mo ago
LionScraper MCP + CLI + HTTP API (Python)MCP serverMCP
by dowant
Unknown

LionScraper Python: MCP stdio + CLI + HTTP API bridging AI to LionScraper browser extension.

Browser Automation~100%Web Scraping
pypi:lionscraper · local packagepublished 7 mo ago
PyScrappyMCP serverMCP
by mldsveda
Unknown

Web-scraping toolkit with 22 tools for structured web data as JSON for AI agents.

Web ScrapingBrowser AutomationData Extraction~71%
pypi:pyscrappy · local packagepublished 1 mo ago
CRW Web ScraperMCP serverMCP
by us
Unknown

Open-source web scraper for AI agents with scrape, crawl, and map tools

Web Scraping~100%
oci:ghcr.io/us/crw:latest · local package
Robot Resources ScraperMCP serverMCP
by robot-resources
Unknown

Token compression for web content — 70-80% reduction from HTML to clean markdown

Web Scraping~73%
npm:@robot-resources/scraper-mcp · local package
apify-scrapersMCP serverMCP
by jlucasmcrell
Unknown

40 Apify public-data tools for leads, news, SEO, jobs, SEC, procurement, and registries.

Workflow AutomationWeb Scraping~73%
pypi:apify-data-scrapers · local packagepublished 2 mo ago
OmniSeekMCP serverMCP
by Battam1111
Unknown

Your agent seeks what search can't find. A self-hosted perception MCP server.

Speech RecognitionWeb ScrapingVector SearchKnowledge Graphs~62%
oci:ghcr.io/battam1111/omniseek:v0.2.0 · local packagepublished 2 mo ago
CrawlEyes MCP ServerMCP serverMCP
by waiky-github
Unknown

Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.

Web ScrapingVector Search
pypi:crawleyes · local packagepublished 2 mo ago
tierproxyMCP serverMCP
by tierproxy
Unknown

Multi-provider proxy infrastructure for AI/ML. Geo, sessions, cost-aware routing, usage tools.

Web Scraping
pypi:tierproxy · local packagepublished 6 mo ago
myfigurecollection-apiMCP serverMCP
by ssskay
Unknown

Read MyFigureCollection.net: search figures, JAN barcode lookup, shop prices, collections and clubs.

Web Scraping
pypi:myfigurecollection-api · local packagepublished 3 mo ago
CloakMCPMCP serverMCP
by overtimepog
Unknown

Stealth browser MCP server — anti-detection Chromium with snapshot-first agent interface

Browser AutomationCloud PlatformsWeb Scraping
pypi:cloakbrowsermcp · local packagepublished 7 mo ago
telegram-channel-scraper-mcpMCP serverMCP
by khadinakbaronline
Unknown

Scrape messages, extract leads from public Telegram channels. No login required.

Team Chat~100%SMS & Voice~100%Web Scraping~73%
npm:telegram-channel-scraper-mcp-server · local package
Web SearchMCP serverMCP
by hec-ovi
Unknown

Keyless multi-engine web search, fetch, and clean-Markdown read for AI agents. No API keys.

Web SearchWeb Scraping~69%
pypi:websearch-skill · local packagepublished 3 mo ago
seo-crawler-mcpMCP serverMCP
by houtini-ai
Unknown

Crawl and analyse websites for SEO errors using Crawlee with SQLite storage

SEO~100%Web Scraping~100%
npm:@houtini/seo-crawler-mcp · local package
webfetchMCP serverMCP
by firish
Unknown

Self-hosted web search for LLM agents: search -> fetch -> rank pipeline with semantic caching

Web SearchVector SearchWeb Scraping~77%
pypi:webfetch-llm · local packagepublished 4 mo ago
webfetchMCP serverMCP
by ashlrai
Unknown

License-first federated image search with attribution, dimensions, and download tooling.

Web Scraping~77%
npm:getwebfetch-mcp · local package
KloaktMCP serverMCP
by KultMember6Banger
Unknown

Cloaked headless browser for AI agents — stealth TLS, smart extraction, SPA fallback

Browser Automation~100%Web Scraping
pypi:kloakt · local packagepublished 6 mo ago
web-fetch-mcpMCP serverMCP
by KylinMountain
Unknown

MCP server for web content fetching, summarizing, comparing, and extracting information

Web Scraping~77%
npm:web-fetch-mcp · local package
eyebrowseMCP serverMCP
by Evil-Bane
Unknown

Stealthy, LLM-drivable browser engine — a Python library + 85-tool MCP server on stealth Chromium.

Browser AutomationWeb Scraping
pypi:eyebrowse · local packagepublished 5 mo ago
DLBrowserMCP serverMCP
by DekryptLabs
Unknown

Self-healing web access for AI agents — recovers through bot blocks, captchas and JS pages.

Web ScrapingBrowser AutomationCloud Platforms~71%
pypi:dlbrowser · local packagepublished 4 mo ago
← Previouspage 149 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather