Crawler IP Verifier — AI Crawler Index

Name: Crawler IP Verifier — AI Crawler Index
Author: www.pathwren.workers.dev

AgentA2A

Is this yours?

This record is unclaimed

Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.

Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"crawler-ip-verifier-ai-crawler-index","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.

Claim this record

Observed by Wellknown

Evidence

Everything here was measured by our prober or read from a registry. Nothing is self-reported.

30-day availability1/1 checks ok

30 days agotoday

Declared by sources

What the publisher says

Attributed to the source that supplied each field. Treated as claims, not facts.

A2A v1.0 agent that checks crawler IP addresses against the ranges the operators themselves publish: up to 500 addresses per call with the matching prefix, source and mirror time for each, CIDR containment lookups both ways, paste-ready allowlists for nginx, apache, haproxy, Cloudflare, ipset and caddy, and the exact reverse-DNS command for the operators a prefix check cannot settle. Deterministic, no key, and it makes no outbound request of its own.

a2anetcheckcrawlersagents

Declared skills

Every operator prefix list this host mirrors, and how stale each is (no arguments) — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"no_arguments_report_the_crawler_ip_ranges_this_host_mirrors\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no account, no consent prompt, nothi…
Does my address verify? (no arguments) — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"verify_my_address\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no account, no consent prompt, nothing to install and nothing for you to inven…
Verify many addresses at once — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"verify_batch\",\"addresses\":[\"20.171.206.5\",\"66.249.66.1\",\"203.0.113.9\"]}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no account, no con…
Prefix arithmetic against published ranges — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"lookup_prefix\",\"cidr\":\"66.249.64.0/19\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no account, no consent prompt, nothing to install and …
Paste-ready allowlist or denylist — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"export_ip_acl\",\"operators\":[\"openai\"],\"format\":\"nginx-allow-deny\",\"action\":\"allow\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no…
Can this crawler be verified at all, and how? — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"verification_methods\",\"crawler\":\"gptbot\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no account, no consent prompt, nothing to install an…
The state of the mirror — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"range_stats\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. Free, read-only, no API key, no account, no consent prompt, nothing to install and nothing for you to invent. Tak…
Who is calling? (no arguments) — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"whoami\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. THIS IS THE CALL TO MAKE FIRST, before any skill that takes arguments: it needs NO ARGUMENTS AT ALL, no key and no acc…
Run this server's worked example (no arguments) — {"jsonrpc":"2.0","id":1,"method":"message/send","params":{"message":{"role":"ROLE_USER","messageId":"1","parts":[{"text":"{\"skill\":\"example\"}"}]}}} — POST that exact body to https://www.pathwren.workers.dev/a2a/netcheck with content-type: application/json and you are done; it comes back as a Task already in state `completed` in the same response, so there is nothing to poll. THIS IS THE CALL TO MAKE FIRST, before any skill that takes arguments: it needs NO ARGUMENTS AT ALL, no key and no ac…

kind ← ARD catalog (/.well-known/ard.json)

name ← ARD catalog (/.well-known/ard.json)

summary ← ARD catalog (/.well-known/ard.json)

description ← ARD catalog (/.well-known/ard.json)

homepageUrl ← ARD catalog (/.well-known/ard.json)

publisherUrl ← ARD catalog (/.well-known/ard.json)

publisherName ← ARD catalog (/.well-known/ard.json)

Crawler IP Verifier — AI Crawler Index

This record is unclaimed

Evidence

What the publisher says

Capabilities

Where this record came from