{"$schema":"https://wellknown.network/schemas/agent-record-v1.json","schemaVersion":"1","id":"ag_fd67vcfxv8mj","handle":"vllm-mcp-server","url":"https://wellknown.network/agents/vllm-mcp-server","links":{"self":"https://wellknown.network/agents/vllm-mcp-server/record.json","html":"https://wellknown.network/agents/vllm-mcp-server","markdown":"https://wellknown.network/agents/vllm-mcp-server/record.md","api":"https://wellknown.network/api/v1/agents/vllm-mcp-server","status":"https://wellknown.network/api/v1/agents/vllm-mcp-server/status","claim":"https://wellknown.network/agents/vllm-mcp-server/claim","claimApi":"https://wellknown.network/api/v1/claims","claimDescriptor":"https://wellknown.network/agents/vllm-mcp-server/claim.json","badge":"https://wellknown.network/agents/vllm-mcp-server/badge.svg","openapi":"https://wellknown.network/openapi.json"},"ard":{"identifier":"urn:air::server:vllm-mcp-server","type":"application/mcp-server-card+json"},"kind":"mcp_server","declared":{"name":"vllm-mcp-server","summary":"MCP server for vLLM - expose vLLM capabilities to AI assistants","description":"# vLLM MCP Server\n\n[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)\n[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\n\nA [Model Context Protocol (MCP)](https://modelcontextprotocol.io/) server that exposes vLLM capabilities to AI assistants like Claude, Cursor, and other MCP-compatible clients.\n\n## Features\n\n- 🚀 **Chat & Completion**: Send chat messages and text completions to vLLM\n- 📋 **Model Management**: List and inspect available models\n- 📊 **Server Monitoring**: Check server health and performance metrics\n- 🐳 **Platform-Aware Container Control**: Supports both Podman and Docker. Automatically detects your platform (Linux/macOS/Windows) and GPU availability, selecting the appropriate container image and optimal settings (e.g., `max_model_len`)\n- 📈 **Benchmarking**: Run GuideLLM benchmarks (optional)\n- 💬 **Pre-defined Prompts**: Use curated system prompts for common tasks\n\n## Demo\n\n### Start vLLM Server\n\nUse the `start_vllm` tool to launch a vLLM container with automatic platform detection:\n\n![Start vLLM Server](https://raw.githubusercontent.com/micytao/vllm-mcp-server/main/assets/vllm-mcp-start.gif)\n\n### Chat with vLLM\n\nSend chat messages using the `vllm_chat` tool:\n\n![Chat with vLLM](https://raw.githubusercontent.com/micytao/vllm-mcp-server/main/assets/vllm-mcp-chat.gif)\n\n### Stop vLLM Server\n\nClean up with the `stop_vllm` tool:\n\n![Stop vLLM Server](https://raw.githubusercontent.com/micytao/vllm-mcp-server/main/assets/vllm-mcp-stop.gif)\n\n## Installation\n\n### Using uvx (Recommended)\n\n```bash\nuvx vllm-mcp-server\n```\n\n### Using pip\n\n```bash\npip install vllm-mcp-server\n```\n\n### From Source\n\n```bash\ngit clone https://github.com/micytao/vllm-mcp-server.git\ncd vllm-mcp-server\npip install -e .\n```\n\n## Quick Start\n\n### 1. Start a vLLM Server\n\nYou can either start a vLLM server manually or let the MCP server manage it via Docker.\n\n…","publisher":{"name":"micytao","url":null},"homepage":"https://github.com/micytao/vllm-mcp-server","repository":"https://github.com/micytao/vllm-mcp-server","version":"0.1.4","license":null,"protocols":["mcp"],"tags":["ai","llm","mcp","server","vllm"],"pricing":null,"endpoints":[{"url":"pypi:vllm-mcp-server","type":"package_pypi","auth":null,"probeable":false}],"skills":null,"tools":null,"extra":null,"attribution":{"kind":"pypi","name":"pypi","repoUrl":"pypi","summary":"pypi","version":"pypi","description":"pypi","homepageUrl":"pypi","publisherName":"pypi"}},"derived":{"capabilities":[{"slug":"ai.prompting","name":"Prompt Management","confidence":0.791,"provenance":"derived"},{"slug":"dev.version-control","name":"Version Control","confidence":0.745,"provenance":"derived"}],"categories":["ai","dev"],"language":"en"},"observed":{"status":"unknown","statusReason":"Distributed as a package to run locally; no network endpoint to check.","lastOkAt":null,"lastProbedAt":null,"statusComputedAt":null,"reliability30d":null,"latestObservations":[],"tools":null,"package":{"name":"vllm-mcp-server","registry":"pypi","observedAt":"2026-09-10T15:25:15.587Z","publishedAt":"2026-01-03T02:12:57.309366Z","latestVersion":"0.1.4"}},"verification":{"claimed":false,"claimedAt":null,"proofs":[]},"provenance":{"sources":[{"source":"pypi","key":"vllm-mcp-server","url":"https://pypi.org/project/vllm-mcp-server/","firstSeenAt":"2026-09-10T15:23:47.021Z","fetchedAt":"2026-09-10T15:23:47.021Z","normalizedAt":"2026-09-10T15:23:47.021Z"}]},"firstSeenAt":"2026-09-10T15:23:47.021Z","updatedAt":"2026-09-10T15:25:15.587Z"}