We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2433 liveRefine in search →
ForagerMCP serverMCP
by pipeworx-io
Live

Forager MCP — wraps the Forager person-phone-lookup API (forager.ai)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/forager/mcpok 15 h ago
Dwd ClimateMCP serverMCP
by pipeworx-io
Live

DWD Climate Data Center — daily station observations for Germany.

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/dwd-climate/mcpok 15 h ago
usgswaterMCP serverMCP
by pipeworx-io
Live

USGS Water MCP — wraps USGS National Water Information System (NWIS) REST services (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/usgswater/mcpok 16 h ago
URL NormalizeMCP serverMCP
by sadri-dridi
Live

Return origin, host, and path. Query and fragment are dropped.

Browser Automation~100%Databases~86%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/url-normalize/mcpok 17 h ago
IcypeasMCP serverMCP
by pipeworx-io
Live

Icypeas MCP — wraps the Icypeas email-search API (icypeas.com)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/icypeas/mcpok 18 h ago
ClimateMCP serverMCP
by pipeworx-io
Live

Climate MCP — wraps Open-Meteo Climate API (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/climate/mcpok 18 h ago
Scout Intel MCP — The Google for AI AgentsMCP serverMCP
by omniologynow-rgb
Live

The Google for AI agents — company intel, competitor tracking, market research via MCP. JSON output

Data Extraction~100%Web ScrapingPeople & Company Research~75%
https://scout-intel.mcpize.runpublished 7 mo agook 6 h ago
Website to Markdown CrawlerMCP serverMCP
by prometheus-maker
Live

Crawl a website into clean Markdown for LLMs/RAG: main content only, linked docs converted.

Web Scraping~100%
https://mcp.apify.com/?tools=prometheus-maker/website-to-markdown-crawlerok 4 h ago
CatfactsMCP serverMCP
by pipeworx-io
Live

Cat Facts MCP — wraps Cat Facts API (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/catfacts/mcpok 19 h ago
WikifeedMCP serverMCP
by pipeworx-io
Live

Wikifeed MCP — wraps Wikimedia Feed API (free, no auth)

News & Feeds~100%Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%
https://gateway.pipeworx.io/wikifeed/mcpok 32 h ago
Agent Ready Website CheckMCP serverMCP
by sadri-dridi
Live

Check whether a website is readable by AI agents: robots, llms.txt, sitemap, HTML. Bounded.

Web Scraping~100%Browser Automation~100%People & Company Research~58%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-ready-website-check/mcpok 20 h ago
FastAFAgentA2A
by FastAF
Live

FastAF: Web data for AI agents, pay per call in USDC via x402, no account: Google search, Maps, Patents, Flights, News, Shopping, Scholar, Jobs, AI Mode, Amazon, eBay, Walmart, Zillow, YouTube transcripts, public LinkedIn/X profiles, scraping and screenshots. Use REST with a bearer API key or x402 …

Social MediaData ExtractionWeb SearchWeb ScrapingNews & Feeds
https://fastaf.cook 2 h ago
NewtonMCP serverMCP
by pipeworx-io
Live

Newton MCP — wraps the Newton math solver API (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/newton/mcpok 26 h ago
Govcon IntelMCP serverMCP
by pipeworx-io
Live

GovCon Intel MCP — Compound tools that chain SAM.gov, USAspending,

Contracts & Legal~100%Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%
https://gateway.pipeworx.io/govcon-intel/mcpok 21 h ago
Agent Visibility CheckMCP serverMCP
by sadri-dridi
Live

Is this website visible to AI agents? Robots, llms.txt, sitemap, extraction, then placement.

Browser Automation~100%Data Extraction~99%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-visibility-check/mcpok 21 h ago
List API For AgentsMCP serverMCP
by sadri-dridi
Live

List a public API where AI agents discover tools, after a bounded readiness check.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/list-api-for-agents/mcpok 21 h ago
Agent Traffic For StartupsMCP serverMCP
by sadri-dridi
Live

Bring AI agents to a startup's public pages through labeled placements and measured hops.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-traffic-for-startups/mcpok 21 h ago
UUID MintMCP serverMCP
by sadri-dridi
Live

Mint a random UUID v4.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/uuid-mint/mcpok 21 h ago
Sponsored Agent PlacementMCP serverMCP
by sadri-dridi
Live

Sponsored, labeled placements on agent-discovery surfaces we operate. Never impersonation.

Browser Automation~100%Agent Discovery~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/sponsored-agent-placement/mcpok 21 h ago
Advertise To AgentsMCP serverMCP
by sadri-dridi
Live

Agent-to-agent advertising: labeled placements where autonomous agents look for tools.

Marketing~100%Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/advertise-to-agents/mcpok 22 h ago
← Previouspage 109 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather