项目概述

UIAutomation MCP 是一款 Windows UI 自动化服务器，实现了模型上下文协议（MCP），使 AI 助手和其他应用程序能够通过程序方式与 Windows 桌面应用程序交互。该服务器通过标准化协议接口提供全面访问 Windows UI 自动化功能。

主要功能：

• 完整的UI自动化访问：与任何支持UI自动化的Windows应用程序交互
• Microsoft Learn 合规：遵循 Microsoft 官方 UI 自动化控制模式指南
• 原生AOT性能：优化为快速启动和低内存使用率
• 多进程架构：MCP协议处理与UI操作的安全分离
• 全面的控制支持：按钮、文本字段、列表、网格以及所有标准Windows控件

使用场景：

• Windows应用程序的自动化测试
• 人工智能驱动的桌面自动化
• 无障碍工具开发
• 应用集成与工作流自动化

安装与设置

先决条件

• Windows 10/11（UI 自动化需要 Windows）
• .NET 9.0 运行时（随 winget 自动安装）

UIAutomation MCP

Project Overview

UIAutomation MCP is a Windows UI Automation server that implements the Model Context Protocol (MCP), enabling AI assistants and other applications to interact with Windows desktop applications programmatically. This server provides comprehensive access to Windows UI Automation capabilities through a standardized protocol interface.

Key Features:

• Complete UI Automation Access: Interact with any Windows application that supports UI Automation
• Microsoft Learn Compliant: Follows official Microsoft guidelines for UI Automation control patterns
• Native AOT Performance: Optimized for fast startup and low memory usage
• Multi-Process Architecture: Secure separation between MCP protocol handling and UI operations
• Comprehensive Control Support: Buttons, text fields, lists, grids, and all standard Windows controls

Use Cases:

• Automated testing of Windows applications
• AI-powered desktop automation
• Accessibility tool development
• Application integration and workflow automation

Installation & Setup

Prerequisites

• Windows 10/11 (UI Automation requires Windows)
• .NET 9.0 Runtime (automatically installed with winget)

Install via Winget

Note: The winget package Locomorange.UIAutomationMCP may not be available yet. If you encounter an error, please check the GitHub releases page for manual installation instructions or verify the package name once published.

# Install UIAutomation MCP server
winget install Locomorange.UIAutomationMCP

MCP Server Configuration

Add the UIAutomation MCP server to your MCP client configuration. For most MCP clients, add this to your MCP settings JSON file:

{
  "mcpServers": {
    "uiautomation": {
      "command": "uiautomation-mcp",
      "args": [],
      "env": {}
    }
  }
}

For Claude Desktop, add to %APPDATA%\Claude\claude_desktop_config.json:

{
  "mcpServers": {
    "uiautomation": {
      "command": "uiautomation-mcp",
      "args": []
    }
  }
}

Manual Installation

1. Download the latest release from the GitHub releases page
2. Extract to your preferred location
3. Add the executable path to your MCP client configuration

Basic Usage Example

Once configured, you can use the UIAutomation MCP server through your MCP client. Here are some example commands:

Take a Screenshot

Take a screenshot of the current desktop

Find and Click a Button

Find a button with text "OK" and click it

Enter Text in a Field

Find the text field with name "Username" and enter "john.doe"

Get Window Information

List all open windows and their titles

Navigate Application Menus

Open the File menu in Notepad and click "Save As"

The server provides comprehensive UI automation capabilities including: