A comprehensive Spark event log analysis MCP server with performance monitoring and optimization recommendations
Wellknown found it in public sources; nobody has proven control of it yet. Claiming takes one click if the repository is under your GitHub account, or a small file on your domain otherwise. Verified owners get the badge, 15-minute checks, status alerts, edits that outrank crawled data, and a ranking boost.
Agents can do it too: POST https://wellknown.network/api/v1/claims with {"agent":"spark-eventlog-mcp","method":"well_known_file"} — machine-readable steps at claim.json, guide at /docs/claim.
Everything here was measured by our prober or read from a registry. Nothing is self-reported.
Attributed to the source that supplied each field. Treated as claims, not facts.
# Spark EventLog MCP Server [中文版本](README_zh.md) | English A comprehensive Spark event log analysis MCP server built on FastMCP 2.0 and FastAPI, providing in-depth performance analysis, resource monitoring, and optimization recommendations. ## Features - 🌐 **FastMCP & FastAPI Integration**: MCP protocol support and analysis report APIs powered by FastAPI & FastMCP - 📊 **Performance Analysis**: Shuffle analysis, resource utilization monitoring, task execution analysis - 📈 **Visual Reports**: Auto-generated interactive HTML reports with direct browser access - ☁️ **Multiple Data Sources**: Support for S3, HTTP URLs, and local files - 💡 **Intelligent Optimization**: Automated optimization recommendations based on analysis results ## Quick Start ### MCP Client Integration #### stdio Mode (Recommended for Local Development) ```json { "mcpServers": { "spark-eventlog": { "command": "uv run python", "args": ["/path/to/spark-eventlog-mcp/start.py"], "env": { "MCP_TRANSPORT": "stdio" } } } } ``` #### HTTP Mode **1. Start HTTP Server:** ```bash export MCP_TRANSPORT=streamable-http export MCP_HOST=localhost export MCP_PORT=7799 uv run python start.py ``` **2. Configure Remote MCP:** ```json { "mcpServers": { "spark-eventlog": { "url": "http://localhost:7799/mcp", "type": "http" } } } ``` **3. Access Services:** - API Documentation: http://localhost:7799/docs - Health Check: http://localhost:7799/health - Reports List: http://localhost:7799/api/reports - MCP Endpoint: http://localhost:7799/mcp ## Analysis Examples   ![emr-eks-big-job-sub-01](https://pcmyp.oss-cn-beijing.al…
Mapped onto the structured taxonomy from declared text and observed tool names. Confidence shown for derived entries.
Every source is kept verbatim. Field changes are logged as events.