delta0-inc/heimdall

Overview

Heimdall is a comprehensive observability platform designed for monitoring Model Context Protocol (MCP) servers and AI/LLM applications. Built on OpenTelemetry standards, it provides real-time tracing, metrics, and insights into your AI infrastructure.

Key Features

• 🔍 Real-time Tracing - Track every tool call, resource access, and prompt execution
• 📊 Dashboard Analytics - Visualize latency, error rates, and usage patterns
• 🔌 Easy Integration - Simple SDK decorators for Python and JavaScript/TypeScript
• 🏠 Self-hosted - Run entirely on your own infrastructure
• 📈 OpenTelemetry Native - Built on industry-standard observability protocols

TODO

• [ ] Track Users - Associate traces with user identities for user-level analytics (currently all requests are shown as anonymous).
• [ ] Evaluate - LLM evaluation and quality scoring, including human annotation.
• [ ] Add Cloud Host Server - Managed cloud deployment.

Architecture

Currently we only support self-hosted deployment. The architecture is as follows:

┌─────────────────┐     OTLP/HTTP      ┌─────────────────┐
│   MCP Server    │ ──────────────────▶│  Heimdall       │
│   + SDK         │    Port 4318       │  Backend        │
└─────────────────┘                    └────────┬────────┘
                                                │
                                                │ REST API
                                                │
                                       ┌────────▼────────┐
                                       │  Heimdall       │
                                       │  Frontend       │
                                       │  Port 5173      │
                                       └─────────────────┘

Quick Start

📖 For detailed setup instructions, see QUICKSTART.md

Prerequisites

• Node.js 18+
• Python 3.9+ (for Python SDK)

1. Start the Backend

cd backend
npm install
npm run dev

2. Start the Frontend

cd frontend
npm install
npm run dev