PolyLLM 是一个统一的 Go 接口，适用于多个大型语言模型（LLM）提供者。它允许您通过一个统一的接口与各种 LLM API 交互，方便在不同提供者之间切换或在同一应用中使用多个提供者。

目录

• PolyLLM
  • 目录
  • 特色
  • 支持的提供者
  • 安装
• 图书馆
• CLI 工具
• HTTP 服务器
  • 配置
• JSON 配置文件
• MCP 配置
  • 使用情况
• API 使用
• 基本示例
• 使用配置文件
• 聊天完成示例
• 使用 MCP
• CLI 使用
• 安装
• 示例
• HTTP 服务器
• 安装
• 启动服务器
• API 端点
• 示例请求
  • 许可证

特色

• 单一接口：通过统一的API与多个LLM提供者交互
• 提供者无关性：无需更改代码即可轻松切换供应商
• 多接口：通过Go API、CLI工具或HTTP服务器访问LLMs
• MCP 支持：内置支持 Model Context 协议
• 配置文件：基于JSON的提供者配置和MCP工具

支持的提供者

PolyLLM

PolyLLM is a unified Go interface for multiple Large Language Model (LLM) providers. It allows you to interact with various LLM APIs through a single, consistent interface, making it easy to switch between different providers or use multiple providers in the same application.

Table of Contents

• PolyLLM
  • Table of Contents
  • Features
  • Supported Providers
  • Installation
    • Library
    • CLI Tool
    • HTTP Server
  • Configuration
    • JSON Configuration File
    • MCP Configuration
  • Usage
    • API Usage
      • Basic Example
      • Using Configuration File
      • Chat Completion Example
      • Using MCP
    • CLI Usage
      • Installation
      • Examples
    • HTTP Server
      • Installation
      • Starting the Server
      • API Endpoints
      • Example Request
  • License

Features

• Single Interface: Interact with multiple LLM providers through a unified API
• Provider Agnostic: Easily switch between providers without changing your code
• Multiple Interfaces: Access LLMs through a Go API, CLI tool, or HTTP server
• MCP Support: Builtin support for Model Context Protocol
• Configuration File: JSON-based configuration for providers and MCP tools

Supported Providers

PolyLLM currently supports the following LLM providers:

• OpenAI
• DeepSeek
• Qwen (Alibaba Cloud)
• Gemini (Google)
• OpenRouter
• Volcengine
• Groq
• Xai
• Siliconflow

Additional providers can be easily added.

Installation

Library

go get github.com/recally-io/polyllm

CLI Tool

go install github.com/recally-io/polyllm/cmd/polyllm-cli@latest

# use docker 
docker pull ghcr.io/recally-io/polyllm-cli:latest

HTTP Server

go install github.com/recally-io/polyllm/cmd/polyllm-server@latest

# use docker 
docker pull ghcr.io/recally-io/polyllm-server:latest

Configuration

JSON Configuration File

PolyLLM supports configuration via a JSON file. This allows you to define LLM providers and MCP tools.

Example configuration file:

{
  "llms": [
    {
      "name": "gemini",
      "type": "gemini",