Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.
Listed on its own since 2026-09-26. Until then it was part of com-superagnt-company-enrichment, where its earlier checks remain.
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"web-scraping","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Every successful check was an authentication response (401/403). The endpoint exists and enforces authentication; nothing behind that boundary — tools, behaviour, service health — has been observed. Latency here is time to authentication response. Tools: not measured — authentication required.
Not distributed through a package registry we index.
| when | check | result | http | latency | detail |
|---|---|---|---|---|---|
| 6 h ago | mcp initialize | ok | 401 | 1233 ms | auth required |
| 12 h ago | mcp initialize | ok | 401 | 199 ms | auth required |
| 18 h ago | mcp initialize | ok | 401 | 176 ms | auth required |
| 24 h ago | mcp initialize | ok | 401 | 172 ms | auth required |
| 31 h ago | mcp initialize | ok | 401 | 165 ms | auth required |
| 2 d ago | mcp initialize | ok | 401 | 167 ms | auth required |
| 2 d ago | mcp initialize | ok | 401 | 207 ms | auth required |
| 2 d ago | mcp initialize | ok | 401 | 272 ms | auth required |
| 2 d ago | mcp initialize | ok | 401 | 544 ms | auth required |
| 3 d ago | mcp initialize | ok | 401 | 164 ms | auth required |
Attributed to the source that supplied each field. Treated as claims, not facts.
No long description beyond the summary.
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.