We count page visits with Google Analytics to see which pages are read. Nothing is stored until you accept, and we never store search queries. Privacy.

wellknown
SearchCapabilitiesReachabilityReliabilityJournalBlogSourcesPricingDocs
/mcpAdd to your agentSign in
wellknown

A live, machine-queryable index of AI agents, MCP servers and tools. Every record separates what publishers declare from what we observed.

Product
  • About
  • Search
  • Capabilities
  • Reachability
  • Reliability report
  • Journal
  • Blog
  • Sources & freshness
  • Network status
  • Pricing
  • Sponsor
Developers
  • Documentation
  • HTTP API
  • MCP server
  • Claim an agent
  • Dashboard
For machines
  • llms.txt
  • openapi.json
  • agent-card.json
  • sitemap.xml
  • About our crawler
Records are indexed from public sources and attributed to them. Observed data is ours; declared data is theirs.PrivacyTermsv0.1 · early network
Capabilities/Data & Search/data.web-scraping

Web Scraping

Fetch and extract web page content.

3.1k records2433 liveRefine in search →
Product For Agents IndexMCP serverMCP
by sadri-dridi
Live

Index for products built for agents: readiness, placement, client center, 7-day trial.

E-commerce Operations~100%Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/product-for-agents-index/mcpok 22 h ago
Get Agent CustomersMCP serverMCP
by sadri-dridi
Live

Place a product where AI agents discover tools; their operators become customers. 7-day trial.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/get-agent-customers/mcpok 22 h ago
Agent First ListingMCP serverMCP
by sadri-dridi
Live

Agent-first product listing: JSON catalog, agent card, MCP door, hops, measured landings.

Browser Automation~100%E-commerce Operations~91%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-first-listing/mcpok 23 h ago
Agent Channel PlacementMCP serverMCP
by sadri-dridi
Live

Placement across agent channels: MCP, Cursor, Claude, ChatGPT, npm, docs, Smithery, Glama.

Team Chat~100%Browser Automation~100%Documentation Lookup~83%Packages & Dependencies~81%People & Company Research~58%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-channel-placement/mcpok 23 h ago
Agent Audience IndexMCP serverMCP
by sadri-dridi
Live

Who the audience is when your customers are agents, and how to be found by them.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-audience-index/mcpok 23 h ago
AI Agent CustomersMCP serverMCP
by sadri-dridi
Live

Reach AI agents that need a tool, and the humans who run them. Measured placements.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/ai-agent-customers/mcpok 23 h ago
Pharma IntelMCP serverMCP
by pipeworx-io
Live

Pharma Intel MCP — Compound tools that chain ClinicalTrials.gov,

Weather~100%CRM & Sales~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%
https://gateway.pipeworx.io/pharma-intel/mcpok 24 h ago
BoredMCP serverMCP
by pipeworx-io
Live

Bored MCP — wraps Bored API (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/bored/mcpok 24 h ago
ChessMCP serverMCP
by pipeworx-io
Live

Chess.com MCP — wraps the Chess.com public API (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/chess/mcpok 24 h ago
Agent Lead GenerationMCP serverMCP
by sadri-dridi
Live

Leads from agents: hops attributed with a per-hop utm_id from discovery to trial to invoice.

Browser Automation~100%Invoice Processing~91%CRM & Sales~86%People & Company Research~58%Web Scraping~54%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-lead-generation/mcpok 24 h ago
MCP Listing For ProductsMCP serverMCP
by sadri-dridi
Live

Give a product an MCP door and hops so agents on MCP registries can reach it.

E-commerce Operations~100%Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/mcp-listing-for-products/mcpok 24 h ago
Trade IntelMCP serverMCP
by pipeworx-io
Live

Trade Intel MCP — Compound tools that chain Comtrade, Census, Treasury,

Weather~100%Markets & Trading~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%
https://gateway.pipeworx.io/trade-intel/mcpok 24 h ago
ChucknorrisMCP serverMCP
by pipeworx-io
Live

Chuck Norris MCP — wraps chucknorris.io (free, no auth)

Weather~100%Web Scraping~99%Agent Memory~99%Packages & Dependencies~96%News & Feeds~93%
https://gateway.pipeworx.io/chucknorris/mcpok 24 h ago
Agent Placement TrialMCP serverMCP
by sadri-dridi
Live

Start a 7-day placement trial: card on file, cancel anytime, measured agent hops.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-placement-trial/mcpok 24 h ago
llms.txt ReadinessMCP serverMCP
by sadri-dridi
Live

Does a site publish llms.txt, robots permissions and a sitemap agents can use? Bounded check.

Browser Automation~100%Identity & Access~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/llms-txt-readiness/mcpok 24 h ago
Agent Hops For Your SiteMCP serverMCP
by sadri-dridi
Live

Hops are 302s an agent followed to your site. Count them, attribute them, grow them.

Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%Weather~51%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-hops-for-your-site/mcpok 24 h ago
Agent Marketing IndexMCP serverMCP
by sadri-dridi
Live

How to market a product to AI agents: readiness, placement, measurement, 7-day trial.

Marketing~100%Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-marketing-index/mcpok 25 h ago
Agent Acquisition DeskMCP serverMCP
by sadri-dridi
Live

See what agents do on a page: hops, agents, doors, channels. Then place the product.

Browser Automation~100%Team Chat~91%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-acquisition-desk/mcpok 25 h ago
Agent Facing CatalogMCP serverMCP
by sadri-dridi
Live

Machine catalog for products that want agent clients: surfaces, hops, discovery paths.

E-commerce Operations~100%Browser Automation~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-facing-catalog/mcpok 25 h ago
Agent Discovery PlacementMCP serverMCP
by sadri-dridi
Live

Labeled placement in agent discovery indexes, measured with daily HMAC nicknames.

Browser Automation~100%Agent Discovery~100%People & Company Research~58%Web Scraping~54%Prompt Management~53%
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-discovery-placement/mcpok 25 h ago
← Previouspage 110 of 154Next →
Machine query
GET /api/v1/search?capability=data.web-scraping&status=live
Aliases

scraping, scraper, crawl, crawler, fetch url, web fetch, firecrawl, extract from website

Also in Data & Search
  • Web Search
  • Databases
  • Vector Search
  • API Access
  • News & Feeds
  • Weather