Robots.txt Policy Lint

Name: Robots.txt Policy Lint
Author: dev.workers.pathwren.www

MCP serverMCP

{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

by dev.workers.pathwren.wwwhomepage ↗v1.2.0

Is this yours?

This record is unclaimed

Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.

Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"robots-txt-policy-lint","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.

Claim this record

Observed by Wellknown

Evidence

Everything here was measured by our prober or read from a registry. Nothing is self-reported.

30-day availability1/1 checks ok

30 days agotoday

Tools observed via MCP handshake

no_arguments_lint_this_hosts_robots_txt — TAKES NO ARGUMENTS. POST {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} to https://ww
am_i_allowed — {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"am_i_allowed","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/ro
whoami — {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} — POST that to https://www.pathwren.workers.dev/mcp/robots and the answ
example — {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"example","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/robots
lint_robots_txt — FIRST CALL, needs nothing: {"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}} — Parse a robots.txt you paste and report every fault that makes it
check_path_allowed — FIRST CALL, needs nothing: {"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}} — Evaluate a pasted robots.txt for one crawler and one or more path
audit_ai_access — FIRST CALL, needs nothing: {"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}} — Evaluate a pasted robots.txt against every AI crawler in this ind
diff_robots_txt — FIRST CALL, needs nothing: {"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}} — Compare two versions of a robots.txt and report only the crawlers
merge_policy — FIRST CALL, needs nothing: {"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}} — Merge one of eight maintained robots.txt stances (block-ai-traini

Declared by sources

What the publisher says

Attributed to the source that supplied each field. Treated as claims, not facts.

No long description beyond the summary.

kind ← Official MCP Registry

name ← Official MCP Registry

summary ← Official MCP Registry

version ← Official MCP Registry

description ← Official MCP Registry

homepageUrl ← Official MCP Registry

publisherName ← Official MCP Registry

Provenance

Where this record came from

Every source is kept verbatim. Field changes are logged as events.

Official MCP Registrydev.workers.pathwren.www/robots-policy-lint

first seen 12 h ago · fetched 12 h agoopen ↗

Field history (6 recent events)

12 h ago · declared · summary → "{\"jsonrpc\":\"2.0\",\"id\":1,\"method\":\"tools/call\",\"params\":{\"name\":\"whoami\",\"arguments\":{}}} free no key"
12 h ago · declared · description → "{\"jsonrpc\":\"2.0\",\"id\":1,\"method\":\"tools/call\",\"params\":{\"name\":\"whoami\",\"arguments\":{}}} free no key"
12 h ago · declared · publisherName → "dev.workers.pathwren.www"
12 h ago · declared · homepageUrl → "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp-robots.html"
12 h ago · declared · version → "1.2.0"
12 h ago · declared · protocols → ["mcp"]

when	check	result	http	latency	detail
30 min ago	mcp initialize	ok	200	182 ms	server robots-policy-lint 1.0.0 · protocol 2025-06-18 · 9 tools
10 h ago	mcp initialize	ok	200	11 ms	server robots-policy-lint 1.0.0 · protocol 2025-06-18 · 8 tools

This record is unclaimed

Evidence

What the publisher says

Capabilities

Where this record came from