{"$schema":"https://wellknown.network/schemas/agent-record-v1.json","schemaVersion":"1","id":"ag_km7xgk2rd4xr","handle":"pyautogui-mcp-server","url":"https://wellknown.network/agents/pyautogui-mcp-server","links":{"self":"https://wellknown.network/agents/pyautogui-mcp-server/record.json","html":"https://wellknown.network/agents/pyautogui-mcp-server","markdown":"https://wellknown.network/agents/pyautogui-mcp-server/record.md","api":"https://wellknown.network/api/v1/agents/pyautogui-mcp-server","status":"https://wellknown.network/api/v1/agents/pyautogui-mcp-server/status","claim":"https://wellknown.network/agents/pyautogui-mcp-server/claim","claimApi":"https://wellknown.network/api/v1/claims","claimDescriptor":"https://wellknown.network/agents/pyautogui-mcp-server/claim.json","badge":"https://wellknown.network/agents/pyautogui-mcp-server/badge.svg","openapi":"https://wellknown.network/openapi.json","history":"https://wellknown.network/api/v1/agents/pyautogui-mcp-server/history","tools":"https://wellknown.network/api/v1/agents/pyautogui-mcp-server/tools"},"ard":{"identifier":"urn:air::server:pyautogui-mcp-server","type":"application/mcp-server-card+json"},"kind":"mcp_server","declared":{"name":"pyautogui-mcp-server","summary":"MCP server package for running Python with pyautogui instrumentation.","description":"# MCP server for simplest GUI agent 🕹️🤖\n\n`pyautogui_mcp_server` packages a Streamable HTTP MCP server for running Python code with `pyautogui` instrumentation.\n\nIt is designed for GUI automation workflows where plain `pyautogui` execution is not enough. The package adds MCP-friendly output handling, and richer screenshots.\n\n## ✨ What this package adds\n\nCompared with running raw `pyautogui` calls directly, this library adds extra effort in the following areas:\n\n- Shared Python globals across tool calls.\n- Captured `stdout`, `stderr`, and final expression results in one MCP response stream.\n- Inline screenshot delivery as MCP image content instead of requiring manual file handling.\n- Annotated mouse-operation previews that show the target point or path before the action runs.\n- Screenshot normalization so captured images line up better with logical screen coordinates.\n\n## 🛠️ Tool response example  \n```\n<stdout>\nCut the right rope by dragging left to right through it.\n</stdout>\n<pyautogui-mcp.dragTo x=860 y=430 duration=0.2 button='left' \n    time_offset=\"T+1.1s\" pyautogui.size=(1440, 900)>\n```\n<img width=\"512\" alt=\"cut-the-rope-by-gui-agent\" src=\"https://yl-data.github.io/2506.onPanda/pyautogui_mcp_server_assets/image/2603.cut-the-rope.webp\" />\n\n```\n</pyautogui-mcp.dragTo>\n```\n\n## 📦 Installation\n\n```bash\npip install pyautogui_mcp_server\n```\n\nFor local development:\n\n```bash\npip install -e .[dev]\n```\n\n## 🚀 Run the MCP server\n\nUse the module entrypoint:\n\n```bash\npython -m pyautogui_mcp_server --host 127.0.0.1 --port 9300\n```\n\nOr use the installed console script:\n\n```bash\npyautogui-mcp-server --port 9300\n```\n\nShow CLI help:\n\n```bash\npython -m pyautogui_mcp_server --help\n```\n\nThe server exposes a `run_python_with_pyautogui` MCP tool that executes Python with instrumented `pyautogui` behavior.\n\n## 📄 License\n\nMIT","publisher":{"name":"DIYer22","url":null},"homepage":"https://github.com/on-panda/pyautogui_mcp_server","repository":"https://github.com/on-panda/pyautogui_mcp_server","version":"0.1.3","license":null,"protocols":["mcp"],"tags":["mcp","pyautogui","automation","server"],"pricing":null,"endpoints":[{"url":"pypi:pyautogui-mcp-server","type":"package_pypi","auth":null,"probeable":false}],"skills":null,"tools":null,"extra":null,"attribution":{"kind":"pypi","name":"pypi","repoUrl":"pypi","summary":"pypi","version":"pypi","description":"pypi","homepageUrl":"pypi","publisherName":"pypi"}},"derived":{"capabilities":[{"slug":"infra.desktop","name":"Desktop Control","confidence":1,"provenance":"derived"}],"categories":["infra"],"language":"en"},"observed":{"status":"unknown","statusReason":"Distributed as a package to run locally; no network endpoint to check.","lastOkAt":null,"lastProbedAt":null,"statusComputedAt":null,"reliability30d":null,"latestObservations":[],"tools":null,"package":{"name":"pyautogui-mcp-server","registry":"pypi","observedAt":"2026-10-22T18:28:46.841Z","publishedAt":"2026-05-26T05:47:04.340918Z","latestVersion":"0.1.3"},"toolSurface":null,"endpointFacts":[]},"verification":{"claimed":false,"claimedAt":null,"proofs":[]},"provenance":{"sources":[{"source":"pypi","key":"pyautogui-mcp-server","url":"https://pypi.org/project/pyautogui-mcp-server/","firstSeenAt":"2026-09-10T10:24:29.586Z","fetchedAt":"2026-10-22T18:27:04.848Z","normalizedAt":"2026-10-22T18:27:04.848Z"}]},"firstSeenAt":"2026-09-10T10:24:29.586Z","updatedAt":"2026-10-22T18:28:46.841Z"}