Evaluate model or agent outputs.
Complete API testing platform MCP server with 14 tools: performance testing (benchmark, load, stress, spike, soak, smoke, A/B compare, profile), functional validation, multi-step workflow chains, OpenAPI contract checking, fuzzing, security scanning, and
npm:reqstorm · local package3/wkpublished 2 mo ago
CLIWatch CLI — manage benchmarks, view results, and get AI-agent-friendly docs for CLI testing
npm:@cliwatch/cli · local package2/wkpublished 7 mo ago
The agent-native profiler for three.js games: an always-on flight recorder, per-entity cost attribution, and a deterministic bench — so a coding agent can measure, attribute, and verify instead of guessing.
npm:sloptimize · local package1/wkpublished 2 mo ago
Ask a collection of LLMs at once through your Benchwarmers server; verdicts pick the next panel.
npm:@wendellresearch-ai/benchwarmers · local packagepublished 30 h ago
Adaptive web research for AI coding agents — 91% of Deep Research quality at 5% cost
pypi:webify-mcp · local packagepublished 4 mo ago
VeriSwarm MCP Server — Trust infrastructure for AI agents via Model Context Protocol
pypi:veriswarm-mcp · local packagepublished 5 mo ago
Assess UK lease tenant break clauses with grounded citations and a measured hallucination rate.
pypi:uk-break-clause-analyzer-mcp · local packagepublished 4 mo ago
Trust and reputation scores for AI agent service selection
pypi:trustscore-mcp · local packagepublished 9 mo ago
A cheap, deterministic first-pass filter for unsupported claims in LLM output, computed without a second model call. Not a standalone hallucination detector. MCP server plus the reference implementation of Touchstone Standard 1.0.
pypi:touchstone-mcp · local packagepublished 4 mo ago
Model Context Protocol server for Tigo Energy solar system monitoring and analytics
pypi:tigo-mcp-server · local packagepublished 16 mo ago
MCP server for 3XB Web Entity Intelligence — score any person or org from live web data
pypi:threexb-mcp · local packagepublished 6 mo ago
Load-test a URL, ping it by phase, ramp to find the capacity, compare runs: JSON reports, guardrails
oci:ghcr.io/omarmhaimdat/pepe:0.41.0 · local packagepublished 2 d ago
Read, measure and explain LLM eval runs of a digline suite. Cannot promote a baseline.
pypi:digline-mcp · local packagepublished 2 d ago
Pokemon TCG MCP server: PSA grading, collection management, and multi-provider pricing.
pypi:tcg-mcp · local packagepublished 6 mo ago
Enhanced Subject Researcher MCP - Iterative target-driven research with multi-vertical search, quality metrics, and sophisticated claim mining
pypi:subject-researcher-mcp · local packagepublished 15 mo ago
MCP server for ShieldPi Watchtower — run LLM security scans, generate drop-in guardrails from scan findings, operate the AI SOC analyst (incident triage + kill-chain reconstruction), and query the live agent monitor from Claude Desktop / Cursor / Continue.
pypi:shieldpi-mcp · local packagepublished 1 mo ago
Find retiring LLM calls in code and test the replacement model on real traffic before switching.
pypi:llmshift · local packagepublished 19 h ago
Roost public MCP servers for AI agents: a payment pre-flight check (roost-corpus-mcp) and a finance-agent safety test (roost-eval-mcp). Advisory, zero-config, no API key.
pypi:roost-mcp · local packagepublished 20 d ago
MCP server with 215+ tools for DaVinci Resolve scripting API (v20.3)
pypi:resolve-mcp · local packagepublished 8 mo ago
A code-first evaluation framework for testing LLM agents' ability to use MCP tools
pypi:pydantic-ai-mcp-evals · local packagepublished 6 mo ago