{"$schema":"https://wellknown.network/schemas/agent-record-v1.json","schemaVersion":"1","id":"ag_te3kb8zfmpzw","handle":"eval-hub-mcp","url":"https://wellknown.network/agents/eval-hub-mcp","links":{"self":"https://wellknown.network/agents/eval-hub-mcp/record.json","html":"https://wellknown.network/agents/eval-hub-mcp","markdown":"https://wellknown.network/agents/eval-hub-mcp/record.md","api":"https://wellknown.network/api/v1/agents/eval-hub-mcp","status":"https://wellknown.network/api/v1/agents/eval-hub-mcp/status","claim":"https://wellknown.network/agents/eval-hub-mcp/claim","claimApi":"https://wellknown.network/api/v1/claims","claimDescriptor":"https://wellknown.network/agents/eval-hub-mcp/claim.json","badge":"https://wellknown.network/agents/eval-hub-mcp/badge.svg","openapi":"https://wellknown.network/openapi.json","history":"https://wellknown.network/api/v1/agents/eval-hub-mcp/history","tools":"https://wellknown.network/api/v1/agents/eval-hub-mcp/tools"},"ard":{"identifier":"urn:air::server:eval-hub-mcp","type":"application/mcp-server-card+json"},"kind":"mcp_server","declared":{"name":"eval-hub-mcp","summary":"MCP server binary for eval-hub","description":"# eval-hub-mcp\n\nThis package distributes the compiled Go eval-hub-mcp server binary for multiple\nplatforms. It installs the binary directly into your `bin/` directory (`Scripts/` on Windows) with no\nPython wrapper — no argument rewriting, no subprocess overhead, no Python\nruntime required at execution time.\n\n## Installation\n\n```bash\npip install eval-hub-mcp\n```\n\n## Capabilities\n\nWith `EVALHUB_BASE_URL`, `EVALHUB_TOKEN`, and `EVALHUB_TENANT` configured, the server exposes MCP **tools** (`discover_providers`, `submit_evaluation`, `get_job_status`, `cancel_job`), **resources** (`evalhub://providers`, `evalhub://benchmarks`, `evalhub://collections`, `evalhub://jobs`, and more), and **prompts** (`edd_workflow`, `evaluate_model`, `compare_runs`). See [MCP.md](../MCP.md) in the eval-hub repository for the full reference.\n\n## Usage\n\n```bash\n# Run in stdio mode (default, for IDE integration)\nevalhub-mcp\n\n# Run in HTTP mode\nevalhub-mcp --transport http --port 3001\n\n# Show version\nevalhub-mcp --version\n```\n\n## Supported Platforms\n\n- Linux: x86_64, arm64\n- macOS: x86_64 (Intel), arm64 (Apple Silicon)\n- Windows: x86_64\n\n## For eval-hub-sdk Users\n\n> **Note:** `eval-hub-sdk[mcp]` currently installs a Python FastMCP-based server. This will be replaced with `eval-hub-mcp` (the Go binary distributed by this package) in a future release.\n\nIf you're using [`eval-hub-sdk`](https://github.com/eval-hub/eval-hub-sdk), you can install the MCP server as an extra:\n\n```bash\npip install eval-hub-sdk[mcp]\n```\n\nFor more information, see the [eval-hub-sdk repository](https://github.com/eval-hub/eval-hub-sdk).\n\n## License\n\nApache-2.0","publisher":null,"homepage":"https://github.com/eval-hub/eval-hub","repository":"https://github.com/eval-hub/eval-hub/issues","version":"1.0.1","license":null,"protocols":["mcp"],"tags":["eval-hub","mcp","binary","model-context-protocol"],"pricing":null,"endpoints":[{"url":"pypi:eval-hub-mcp","type":"package_pypi","auth":null,"probeable":false}],"skills":null,"tools":null,"extra":null,"attribution":{"kind":"pypi","name":"pypi","repoUrl":"pypi","summary":"pypi","version":"pypi","description":"pypi","homepageUrl":"pypi"}},"derived":{"capabilities":[{"slug":"ai.evaluation","name":"Evaluation & Benchmarks","confidence":0.859,"provenance":"derived"},{"slug":"dev.version-control","name":"Version Control","confidence":0.825,"provenance":"derived"},{"slug":"ai.prompting","name":"Prompt Management","confidence":0.791,"provenance":"derived"}],"categories":["ai","dev"],"language":"en"},"observed":{"status":"unknown","statusReason":"Distributed as a package to run locally; no network endpoint to check.","lastOkAt":null,"lastProbedAt":null,"statusComputedAt":null,"reliability30d":null,"latestObservations":[],"tools":null,"package":{"name":"eval-hub-mcp","registry":"pypi","observedAt":"2026-09-15T14:26:58.014Z","publishedAt":"2026-08-20T08:15:04.122776Z","latestVersion":"1.0.1"},"toolSurface":null,"endpointFacts":[]},"verification":{"claimed":false,"claimedAt":null,"proofs":[]},"provenance":{"sources":[{"source":"pypi","key":"eval-hub-mcp","url":"https://pypi.org/project/eval-hub-mcp/","firstSeenAt":"2026-09-09T15:21:54.503Z","fetchedAt":"2026-09-15T14:25:01.721Z","normalizedAt":"2026-09-15T14:25:01.721Z"}]},"firstSeenAt":"2026-09-09T15:21:54.503Z","updatedAt":"2026-09-15T14:26:58.014Z"}