MMCPMarkets
OL

openconstruct/llama-mcp-server

分析与监控

本页由 AI 翻译，技术细节请以原文为准。 查看原文

10 stars 5 forks 质量 55 趋势 8
Repository Install

MCP cerver to let claude use llamacpp. Uses API.

概览

A Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server. - 💬 with Local Model through Claude Desktop - 🎛️ (temperature, max_tokens, top_p, top_k) - ✅ and server status checks - 🧪 for different capabilities - 📊 and token usage tracking - 🔧 via environment variables npm install @openconstruct/llama-mcp-server A Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server. - 💬 with LibreModel through Claude Desktop - 🎛️ (temperature, max_tokens, top_p, top_k) - ✅ and server status checks - 🧪 for different capabilities - 📊 and token usage tracking - 🔧 via environment variables Make sure llama-server is running with your model: Add this to your Claude Desktop configuration (~/.config/claude/claude_desktop_config.json): Claude will now have access to LibreModel through MCP!

README

以下为原文 README 节选，完整内容请查看原文。

LibreModel MCP Server 🤖

A Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server.

Features

  • 💬 Full conversation support with Local Model through Claude Desktop
  • 🎛️ Complete parameter control (temperature, max_tokens, top_p, top_k)
  • ✅ Health monitoring and server status checks
  • 🧪 Built-in testing tools for different capabilities
  • 📊 Performance metrics and token usage tracking
  • 🔧 Easy configuration via environment variables

Quick Start

npm install @openconstruct/llama-mcp-server

A Model Context Protocol (MCP) server that bridges Claude Desktop with your local LLM instance running via llama-server.

Features

  • 💬 Full conversation support with LibreModel through Claude Desktop
  • 🎛️ Complete parameter control (temperature, max_tokens, top_p, top_k)
  • ✅ Health monitoring and server status checks
  • 🧪 Built-in testing tools for different capabilities
  • 📊 Performance metrics and token usage tracking
  • 🔧 Easy configuration via environment variables

Quick Start

1. Install Dependencies

cd llama-mcp
npm install

2. Build the Server

npm run build

3. Start Your LibreModel

Make sure llama-server is running with your model:

./llama-server -m lm37.gguf -c 2048 --port 8080

4. Configure Claude Desktop

Add this to your Claude Desktop configuration (~/.config/claude/claude_desktop_config.json):

{
  "mcpServers": {
    "libremodel": {
      "command": "node",
      "args": ["/home/jerr/llama-mcp/dist/index.js"]
    }
  }
}

5. Restart Claude Desktop

Claude will now have access to LibreModel through MCP!

Usage

Once configured, you can use these tools in Claude Desktop:

💬 chat - Main conversation tool

Use the chat tool to ask LibreModel: "What is your name and what can you do?"

🧪 quick_test - Test LibreModel capabilities

Run a quick_test with type "creative" to see if LibreModel can write poetry

🏥 health_check - Monitor server status

Use health_check to see if LibreModel is running properly

Configuration

Set environment variables to customize behavior:

export LLAMA_SERVER_URL="http://localhost:8080"  # Default llama-server URL

Available Tools

Tool Description Parameters
chat Converse with MOdel message, temperature, max_tokens, top_p, top_k, system_prompt
quick_test Run predefined capability tests test_type (hello/math/creative/knowledge)
health_check Check server health and status None

Resources

  • Configuration: View current server settings
  • Instructions: Detailed usage guide and setup instructions

Development

# Install dependencies
npm install # LibreModel MCP Server 🤖
在 GitHub 查看完整 README

安装

This server does not publish a one-line install command.

Open the repository installation guide 新手？先看 mcpskill.org 教程 →

配置

{ "mcpServers": { "libremodel": { "command": "node", "args": ["/home/jerr/llama-mcp/dist/index.js"] } } }