Evaluation & Benchmarks

Free public benchmark for AI agents: compliance tasks, every claim checked against signed receipts

MCP server for portfolio rotation analysis -- works with Claude, ChatGPT, Gemini, and any MCP client

MCP server and CLI for detecting, redacting, and auditing PHI before medical text is sent to AI agents.

Local MCP server that digests development-loop reports — profilers (NVIDIA ncu, AMD rocprof, Linux perf, Apple Metal, chrome-trace), build tools (ptxas, clang -ftime-trace, cmake, ninja, cargo), benchmarks (criterion), CI run logs, and git change state — into token-efficient JSON for LLM coding age…

MCP server for the Paper Scoring core

Model Context Protocol server for Opik (Comet's LLM observability platform).

Compare print-on-demand supplier prices, shipping and delivered totals for the same product.

MCP server for the Openlayer platform

MCP server for an Online Judge

Video production MCP: 55 tools — edit, grade, TTS captions, beat-sync, master, AI generate.

MCP server exposing multivon-eval + pdfhell as agent-callable tools. Drop into Claude Desktop, Cursor, Cline, or any MCP-compatible AI coding agent.

Local log forensics: compress logs into citable evidence with root-cause confidence tiers.

A Model Context Protocol (MCP) server implementation that provides capabilities to interact with Moodle LMS.

Framework-agnostic ML model analysis MCP server — evaluate, explain, and report on any trained model via Claude

Vehicle handover compliance — NAMA Vehicle Grading, BVRLA Fair Wear & Tear, photographic POD

MEOK AI Labs - quantum-scoring MCP server extracted from SOV3

Persistent graph memory MCP server for AI agents using LadybugDB

Automated tests for MCP servers: schema checks, YAML tests, fuzzing, benchmarks, tool-selection evals and a pytest plugin.

Behavioral evaluation and description linting for MCP servers

Local testing framework for MCP (Model Context Protocol) servers