VLM Image Understanding MCP Server - Support OpenAI protocol compatible VLMs
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"vlm-mcp","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# VLM MCP Server [中文版本](./README_zh.md) ## Why This Project? When using Claude Code with third-party models, they are typically text-only models without image processing capabilities. Adding an MCP server with image processing capability is essential for tasks that require visual understanding. This project enables users to select their own Vision-Language Model (VLM) for image processing. ## Features - **extract_text_from_image**: Extract text from images (OCR) - **ui_to_artifact**: Convert UI screenshots to code, prompts, design specs, or descriptions - **extract_text_from_screenshot**: Extract text from screenshots with code recognition support - **diagnose_error_screenshot**: Analyze error screenshots and diagnose issues - **understand_technical_diagram**: Analyze technical diagrams (architecture, flowcharts, UML, etc.) - **analyze_data_visualization**: Analyze data visualization charts - **ui_diff_check**: UI comparison to detect visual differences - **analyze_image**: General-purpose image analysis ## Environment Variables | Variable | Required | Description | |----------|----------|-------------| | `VLM_API_KEY` | Yes | API key | | `VLM_BASE_URL` | No | Custom API endpoint (default: https://api.openai.com/v1) | | `VLM_MODEL` | No | Model to use (default: gpt-4o) | | `VLM_MAX_IMAGE_SIZE` | No | Maximum image size (default: 3MB). Images exceeding this size will be automatically compressed before processing. Supported formats: `3MB`, `3M`, `3145728` (bytes), `1024KB`, etc. | ## Quick Start ### Using uvx (Recommended) ```bash # Copy config template and fill in your API Key cp .env.example .env # Edit .env file and fill in VLM_API_KEY # Run directly (will automatically load .env file) uvx vlm-mcp ``` ### Using pip ```bash # Install pip install vlm-mcp # Or install in development mode pip install -e . ``` ### Configure Environment Variables ```bash # OpenAI export VLM_API_KEY=sk-xxx export VLM_MODEL=gpt-4o # Custom API (e.g., Ollama) export VLM_A…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.