OpenMark

Name: OpenMark
Author: ai.openmark

MCP serverMCP

Benchmark your own prompt on 100+ LLMs with real API calls; pick the cheapest model that passes.

by ai.openmarkhomepage ↗v1.0.0

Is this yours?

This record is unclaimed

Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.

Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"openmark","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.

Claim this record

Observed by Wellknown

Evidence

Everything here was measured by our prober or read from a registry. Nothing is self-reported.

30-day availability23/23 checks ok

when	check	result	http	latency	detail
4 h ago	mcp initialize	ok	200	61 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
11 h ago	mcp initialize	ok	200	62 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
19 h ago	mcp initialize	ok	200	47 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
26 h ago	mcp initialize	ok	200	83 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
33 h ago	mcp initialize	ok	200	31 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
2 d ago	mcp initialize	ok	200	21 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
2 d ago	mcp initialize	ok	200	48 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
2 d ago	mcp initialize	ok	200	55 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
3 d ago	mcp initialize	ok	200	27 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools
3 d ago	mcp initialize	ok	200	38 ms	server openmark 1.0.0 · protocol 2025-06-18 · 9 tools

Tools observed via MCP handshake

get_task_format — How to write an OpenMark task: the YAML structure, all 18 scoring modes, and tips. Call this before writing a task. Pass a topic for the full detail on one subj
validate_task — Check a task YAML the way OpenMark will before running it: structure, scoring settings, and the test limit of the user's plan. Free, saves nothing. Returns the
list_models — Current OpenMark model ids with list prices ($ per 1M tokens), as text and as a structured list. Use these ids in run_benchmark. Append @low, @medium or @high t
prepare_attachments — Get an upload_uid and a one-hour upload link (no API key needed) for images, PDFs or text documents, with the exact curl command. Upload the files, reference th
estimate_cost — Credits a run_benchmark call would use, before spending anything: the expected total, the split per model, the balance needed to start, the worst case, and the
run_benchmark — Save a task (YAML, see get_task_format) to the user's OpenMark account and run it on the given models with real API calls. Returns a job_id and the expected cos
get_results — Status of a benchmark job, and once completed the ranked results (score, stability, cost per run, latency), the tests each model missed with its answer, a recom
get_account — The user's plan, credit balance and limits, and what a credit pack, Pro or Expert would unlock. Use it before large runs, or when a run is refused for credits o
watch_task — Watch the task of a completed job: when new or cheaper models ship, OpenMark re-tests up to 4 of them next to the user's pick and emails the user only when one

Declared by sources

What the publisher says

Attributed to the source that supplied each field. Treated as claims, not facts.

No long description beyond the summary.

kind Official MCP Registry

name Official MCP Registry

summary Official MCP Registry

version Official MCP Registry

description Official MCP Registry

homepageUrl Official MCP Registry

publisherName Official MCP Registry

Derived by Wellknown

Capabilities

Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.

ai.evaluationEvaluation & Benchmarks100%dev.docs-lookupDocumentation Lookup54%commerce.pricingPricing & Quotes53%content.writingWriting & Editing51%

Provenance

Where this record came from

Every source is kept verbatim. Field changes are logged as events.

Official MCP Registryai.openmark/openmark

first seen 7 d ago · fetched 3 d agoopen ↗

Field history (6 recent events)

7 d ago · declared · summary → "Benchmark your own prompt on 100+ LLMs with real API calls; pick the cheapest model that passes."
7 d ago · declared · description → "Benchmark your own prompt on 100+ LLMs with real API calls; pick the cheapest model that passes."
7 d ago · declared · publisherName → "ai.openmark"
7 d ago · declared · homepageUrl → "https://openmark.ai/mcp"
7 d ago · declared · version → "1.0.0"
7 d ago · declared · protocols → ["mcp"]