Local testing framework for MCP (Model Context Protocol) servers
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"mcp-testing","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
<div align="center"> <h1>🧪 MCP Testing</h1> <p><strong>AI-powered testing framework for MCP servers</strong></p> <p>Test your MCP servers with real AI agents conducting conversations and LLM judges evaluating results</p> </div> <div align="center"> <a href="https://docs.golf.dev/mcp-testing/getting-started/quickstart"><img src="https://img.shields.io/badge/docs-golf.dev-blue.svg" alt="Documentation"></a> <a href="LICENSE"><img src="https://img.shields.io/badge/license-Apache%202.0-blue.svg" alt="License"></a> <a href="https://github.com/golf-mcp/golf-testing/pulls"><img src="https://img.shields.io/badge/PRs-welcome-brightgreen.svg" alt="PRs Welcome"></a> <a href="https://pypi.org/project/mcp-testing/"><img src="https://img.shields.io/pypi/v/mcp-testing" alt="PyPI"></a> <a href="#"><img src="https://img.shields.io/badge/python-3.12+-blue.svg" alt="Python"></a> </div> ## Why MCP Testing? Traditional testing doesn't work for MCP servers. You can't write unit tests for natural language interactions. MCP Testing solves this with: - **🤖 Real AI Agents** - Claude and ChatGPT actually use your MCP server - **👤 User Simulation** - AI simulates realistic multi-turn user behavior - **⚖️ LLM-as-a-Judge** - Intelligent evaluation instead of brittle assertions - **🎭 Comprehensive Testing** - Security, compliance and performace all in one framework - **🔌 Multiple Transports** - Supports HTTP and stdio servers ## Quick Start Get testing in 3 steps: 1. **Install & Setup** ```bash pip install mcp-testing export ANTHROPIC_API_KEY="sk-ant-..." # For AI agents export OPENAI_API_KEY="sk-..." # For LLM judge ``` 2. **Interactive Onboarding** ```bash mcp-t quickstart # Creates your first server & test suite ``` 3. **Run Tests** ```bash mcp-t run <suite-id> <server-id> # Example: mcp-t run example_suite_001 hackernews_mcp_server ``` ## Core Concepts ### Test Flow ``` Your Test Case → AI Agent (Claude/GPT-4) → …
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.