We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2439 liveRefine in search →
atlas-browser-mcpMCP server
by NotLing
Unknown

Visual browser MCP server with Set-of-Mark labeling and humanized interactions

Browser AutomationWeb Scraping
pypi:atlas-browser-mcp · local packagepublished 11 mo ago
article-scraper-mcpMCP server
Unknown

MCP server that fetches article data (title, text, author, date) from a URL using newspaper3k

Web ScrapingNews & FeedsData Extraction~71%
pypi:article-scraper-mcp · local packagepublished 15 mo ago
anthology-mcpMCP server
by r10cube
Unknown

MCP server for Anthology — scrape documentation sites into AI-ready Markdown

Code DocumentationWeb Scraping
pypi:anthology-mcp · local packagepublished 8 mo ago
alltrails-mcpMCP server
by Srinath Srinivasan
Unknown

A Model Context Protocol (MCP) server for accessing AllTrails hiking trail data

Web Scraping
pypi:alltrails-mcp · local packagepublished 11 mo ago
crawlengine-mcpMCP serverMCP
by Johann Schiffer
Unknown

HTTP web extraction, browser header rotation, proxy pool management, and clean Markdown MCP server for AI agents

Web Scraping
pypi:crawlengine-mcp · local packagepublished 11 d ago
CartScoutMCP serverMCP
by Veselin15
Unknown

Live product prices, stock, variants and deal ratings from Shopify, Walmart, eBay and more.

E-commerce OperationsWeb Scraping
pypi:cartscout-mcp · local packagepublished 2 mo ago
AI-First ScraperMCP serverMCP
by yubinkim444
Unknown

Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.

Web ScrapingVector Search
pypi:ai-first-scraper-mcp · local packagepublished 2 mo ago
agentfetchMCP serverMCP
by bch1212
Unknown

Token-budgeted web fetch for AI agents — auto-routes Jina, FireCrawl, Trafilatura, PDF.

Web ScrapingBrowser Automation
pypi:agentfetch-mcp · local packagepublished 6 mo ago
Scrapling MCP ServerMCP serverMCP
by D4Vinci
Unknown

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

Web ScrapingBrowser AutomationData Extraction~71%
oci:ghcr.io/d4vinci/scrapling · local packagepublished 4 d ago
Andi Web Search MCP serverMCP serverMCP
by andiai.com
Unknown

Real-time web search and page fetching for AI agents, built on Andi's own index of tens of billions of pages. Returns ranked, deduplicated results as LLM-ready markdown.

Web Search~100%Web Scraping~54%
no endpoint declared
crawlportMCP serverMCP
by CloudCorpRecords
Unknown

Firecrawl web data: scrape, map, search, crawl, extract, research, and llms.txt.

Web Scraping~80%
npm:@reneturcios/crawlport · local package
mcp-substack-scraperMCP serverMCP
by com.mambabuilt
Unknown

Substack publications, posts, subscriber counts, and keyword search.

Web Scraping~73%
npm:@mambalabsdev/mcp-substack-scraper · local package
mcp-reddit-search-thread-scraperMCP serverMCP
by com.mambabuilt
Unknown

Reddit posts and comments by keyword, subreddit, or thread URL, no Reddit login or API key

Web Scraping~73%
npm:@mambalabsdev/mcp-reddit-search-thread-scraper · local package
openrolesMCP serverMCP
by aranculleton
Unknown

Open roles from employers' own job boards: Greenhouse, Lever, Ashby, Workday and 12 more.

HR & RecruitingWeb Scraping~66%
pypi:openroles · local packagepublished 14 d ago
DeepcrawlMCP serverMCP
by com.soflution
Unknown

Clone websites, scrape pages to markdown and crawl whole sites. A free Firecrawl alternative.

Web Scraping~80%
no endpoint declared
proxy-scraperMCP serverMCP
by maximilianfeix
Unknown

Free proxies that actually work: checked HTTP/SOCKS proxies, and pages fetched through them

Web Scraping~100%
pypi:proxy-scraper-cli · local packagepublished 16 d ago
FrankenSurfMCP serverMCP
by yail259
Unknown

Read any web page and search the web: 28 tools, cheapest first, every page checked.

Web ScrapingBrowser AutomationDeep Web Research
pypi:frankensurf · local packagepublished 16 d ago
GenPark Bloom Filter URL Dedup CrawlerMCP serverMCP
by alphaparkinc
Unknown

In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler inge

Web Scraping~100%
no endpoint declared
RAG Documentation ScraperMCP serverMCP
by LernowaAdmin
Unknown

Crawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata.

Code Documentation~100%Web Scraping~100%Vector Search~65%
npm:rag-docs-scraper-mcp-server · local package
ghostfoxMCP serverMCP
by autokeren
Unknown

Self-hosted stealth browser for AI agents: Firefox engine + Rust MCP runtime.

Browser AutomationDebuggingWeb Scraping
npm:ghostfox · local packagepublished 22 d ago
← Previouspage 147 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather