MMCPMarkets
VL

vmlinuzx/llmc

Developer tools
36 stars 0 forks Качество 95 Тренд 95
Repository Install

One stop shop - Local-first RAG stack with intelligent polyglot-code/docs, remote code execution, local llama enrichment, progressive disclosure tools, mcp server, sandboxed security.

Обзор

Get 70-95% cost reduction through local RAG, intelligent routing, and containerized security. LLMC is a and intelligent router designed to drastically reduce the cost of using Large Language Models with your codebase. Instead of sending your entire codebase to Claude or GPT-4, LLMC indexes your code locally, finds the exact relevant snippets (functions, classes, docs), and sends . * Stores text + metadata without external dependencies. * Caches embeddings to avoid re-computing unchanged files. * Packs the most relevant spans into a fixed token budget. * Uses small local models to tag and summarize code for better retrieval. * Trusted clients get direct host access (~76% cheaper than docker overhead). * Untrusted inputs run in Docker/nsjail. * Even if an LLM is "jailbroken" by prompt injection, it can't escape the container. * Cascades from Local → Cheap Cloud → Premium Models. * Hard budget caps to prevent surprise bills. * Automatic token bucket throttling for API providers.

README

⚡ What is LLMC?

LLMC is a local-first RAG (Retrieval Augmented Generation) engine and intelligent router designed to drastically reduce the cost of using Large Language Models with your codebase.

Instead of sending your entire codebase to Claude or GPT-4, LLMC indexes your code locally, finds the exact relevant snippets (functions, classes, docs), and sends only what matters.

graph LR
    A[User Query] --> B(LLMC Router);
    B --> C{Local Index};
    C -->|Search| D[Relevant Context];
    D -->|Trim & Pack| E[Optimized Prompt];
    E --> F[LLM API];
    F --> G[Answer];
    style B fill:#f9f,stroke:#333,stroke-width:2px
    style E fill:#bfb,stroke:#333,stroke-width:2px

🚀 Quick Start

Get up and running in seconds.

1. Install

# One-line install
curl -sSL https://raw.githubusercontent.com/vmlinuzx/llmc/main/install.sh | bash

# Or via pip
pip install "git+https://github.com/vmlinuzx/llmc.git#egg=llmcwrapper[rag,tui,agent]"

2. Index Your Code

cd /path/to/your/project
llmc-cli repo register .

3. Save Money

# Search without using ANY tokens
llmc-cli search "authentication middleware"

# Launch the visual dashboard
llmc-cli tui

✨ Key Features

Feature Description
💸 Massive Savings Reduces token usage by 70-95% by sending only relevant context.
🔒 Security First New in v0.7.0: “Hybrid Mode” for trusted clients (host access) vs. Container Isolation for untrusted LLMs.
🧠 Polyglot RAG Smart parsing (TreeSitter) for Python, TS, JS, Go, Java, and technical docs.
🕸️ GraphRAG Understands your code structure (imports, calls, inheritance) to find related files automatically.
🖥️ TUI Dashboard Terminal UI to monitor indexing, search results, and costs. ⚠️ Work in progress — expect rough edges.
🔌 MCP Support Full Model Context Protocol server to integrate seamlessly with Claude Desktop.

🔍 Deep Dive

📚 Documentation

Full documentation is available in the DOCS/ directory:

📜 History

Originally created by David Carroll (the worst paragliding pilot in the TX Panhandle) after burning through his weekly API limits in days. This tool was born from the necessity to code more while spending less.

🤝 Contributing

We welcome PRs! Please check CONTRIBUTING.md before starting.

  1. Fork the repo
  2. Create your feature branch (git checkout -b feature/amazing-feature)
  3. Commit your changes (git commit -m 'Add some amazing feature')
  4. Push to the branch (git push origin feature/amazing-feature)
  5. Open a Pull Request

Current Release: v0.9.1 “Back From Vacation”

View this README on GitHub

Установка

This server does not publish a one-line install command.

Open the repository installation guide