by Nilkanth Suthar
Automated tests for MCP servers: schema checks, YAML tests, fuzzing, benchmarks, tool-selection evals and a pytest plugin.
pypi:mcp-toolproof · local packagepublished 14 d ago
Evaluate model or agent outputs.
Automated tests for MCP servers: schema checks, YAML tests, fuzzing, benchmarks, tool-selection evals and a pytest plugin.
Behavioral evaluation and description linting for MCP servers
Local testing framework for MCP (Model Context Protocol) servers
Active, runtime adversarial testing for MCP servers: point it at your own server and find out what breaks.
Juiz Computacional para LLMs - MCP Server
Scoring engine for MCP server quality assessment
Living economy for AI agents — Conway physics, energy currency, marketplace, reputation.
A framework for model self-reflection and meta-cognitive processing
Model Context Threat Scanner — local MCP security scanning, attack chains, inventory, CI gates, and optional Semgrep/LLM analysis
MCP server that packages LLM evaluation gates as reusable CI/CD primitives
An interactive application for testing MCP tools.
An evidence-based benchmark and runtime evaluation framework for secure Model Context Protocol tool-using agents.
A CI linter for what your MCP server publishes: tool poisoning and prompt injection across every surface an agent sees, definition drift between runs, and schema rot.
MCP工具评估助手服务器 - 优化Cherry Studio兼容性
Evaluate MCP server accuracy against known questions and answers
Cybersecurity monitoring and analysis for Linux servers via MCP
An MCP server for BigQuery exploration with cost guardrails and a built-in NL→SQL eval harness.
Detect pytest config-leakage that corrupts agent-benchmark grading. Deterministic, no-LLM.
A benchmark for MCP.
Agentic security testing for MCP servers