orchestra-mcp

# 🎵 Orchestra **Automated testing for MCP servers — declarative, fast, CI/CD-ready.** [](LICENSE) [](https://www.python.org/) The [Model Context Protocol (MCP)](https://modelcontextprotocol.io/) is becoming the standard way to connect AI models to external tools and data. Orchestra is a CLI tool that lets you write declarative YAML test suites for any MCP server — whether you're building one or integrating one into your stack. **Write tests once. Run them anywhere. Catch regressions before they reach production.** --- ## Why Orchestra? MCP servers are proliferating fast, but tooling for testing them is still early. Orchestra fills that gap: - **No code required** — define tests in readable YAML - **Works with any MCP server** — STDIO (local subprocess), HTTP (Streamable HTTP), and SSE transports - **Assertions that understand MCP** — JSONPath queries + first-class `isError` detection - **CI/CD native** — exit codes, quiet mode, JSON reports --- ## Install Orchestra is closed-source. The source is proprietary (see [LICENSE](LICENSE)), but the CLI is distributed as a wheel on PyPI so it can be installed in CI without the desktop app: ```bash uv tool install orchestra-mcp # or: pipx install orchestra-mcp orchestra --help ``` Installing it as a *tool* rather than into the project environment keeps Orchestra's dependencies from colliding with the MCP server under test. The desktop app bundles the same CLI; **Get Started → Install the orchestra command-line tool** links it onto your PATH. For development in this repo: ```bash uv sync --extra server --extra dev uv run orchestra --help ``` --- ## Quickstart **New to Orchestra? Use the interactive builder:** ```bash orchestra new schemas/my_test.yaml ``` The wizard guides you through transport, auth, and your first test step. Time to first passing test:…