delta0-inc/heimdall

MCP服务器和AI应用的开源可观测平台

概述

Heimdall 是一款综合可观测平台，专为监控模型上下文协议（MCP）服务器和 AI/LLM 应用而设计。基于 OpenTelemetry 标准，它提供实时追踪、指标和对 AI 基础设施的洞察。

主要特色

• 🔍 实时追踪 - 跟踪每一次工具调用、资源访问和提示执行
• 📊 仪表盘分析 - 可视化延迟、错误率和使用模式
• 🔌 Easy Integration - Python和JavaScript/TypeScript的简单SDK装饰工具
• 🏠 自主机 - 完全运行在自己的基础设施上
• 📈 OpenTelemetry Native - 基于行业标准可观测协议

TODO

• [ ] ** 跟踪用户** - 将追踪与用户身份关联，用于用户级分析（目前所有请求均显示为匿名）。
• [ ] 评估 - LLM评估和质量评分，包括人工注释。
• [ ] 添加云主机服务器 - 托管云部署。

建筑

目前我们仅支持自托管部署。架构如下：

快速启动

Overview

Heimdall is a comprehensive observability platform designed for monitoring Model Context Protocol (MCP) servers and AI/LLM applications. Built on OpenTelemetry standards, it provides real-time tracing, metrics, and insights into your AI infrastructure.

Key Features

• 🔍 Real-time Tracing - Track every tool call, resource access, and prompt execution
• 📊 Dashboard Analytics - Visualize latency, error rates, and usage patterns
• 🔌 Easy Integration - Simple SDK decorators for Python and JavaScript/TypeScript
• 🏠 Self-hosted - Run entirely on your own infrastructure
• 📈 OpenTelemetry Native - Built on industry-standard observability protocols

TODO

• [ ] Track Users - Associate traces with user identities for user-level analytics (currently all requests are shown as anonymous).
• [ ] Evaluate - LLM evaluation and quality scoring, including human annotation.
• [ ] Add Cloud Host Server - Managed cloud deployment.

Architecture

Currently we only support self-hosted deployment. The architecture is as follows:

┌─────────────────┐     OTLP/HTTP      ┌─────────────────┐
│   MCP Server    │ ──────────────────▶│  Heimdall       │
│   + SDK         │    Port 4318       │  Backend        │
└─────────────────┘                    └────────┬────────┘
                                                │
                                                │ REST API
                                                │
                                       ┌────────▼────────┐
                                       │  Heimdall       │
                                       │  Frontend       │
                                       │  Port 5173      │
                                       └─────────────────┘

Quick Start

📖 For detailed setup instructions, see QUICKSTART.md

Prerequisites

• Node.js 18+
• Python 3.9+ (for Python SDK)

1. Start the Backend

cd backend
npm install
npm run dev

2. Start the Frontend

cd frontend
npm install
npm run dev