wimi321/macos-computer-use-skill

このページは AI により自動翻訳されています。技術的な詳細は原文をご確認ください。原文を見る

20 stars 10 forks 品質 72 トレンド 10MIT

Standalone MCP server that gives AI agents full GUI control over macOS — screenshots, mouse, keyboard, apps, clipboard, and multi-display. Zero private dependencies.

概要

macOS Computer-Use Skill Standalone MCP server that gives AI agents full GUI control over macOS — screenshots, mouse, keyboard, apps, clipboard, and multi-display — with zero private dependencies. Quick Start · Tools · MCP Config · ClawHub On first launch the server automatically creates a Python virtualenv in .runtime/venv and installs all runtime dependencies. No Claude desktop app, no private native modules. macOS requires and permissions for the host process. The server checks both on startup and reports status through MCP. See examples/mcp-config.json for a ready-to-use template. This project ships as a self-contained skill at skill/computer-use-macos. The installer copies the full project to ~/.codex/skills/computer-use-macos/project — the skill keeps working even if the original clone is removed. Python dependencies (pyautogui, mss, Pillow, pyobjc) are installed automatically into an isolated virtualenv on first run.

README

以下は原文 README の抜粋です。原文を見る。

简体中文 · 日本語

Features

	Feature	Description
Vision	Screenshot & Display	Capture any display, enumerate monitors, zoom into regions
Input	Mouse & Keyboard	Click, drag, scroll, type, key combos, hold keys — with IME-safe clipboard routing
Apps	Application Control	Launch apps, detect frontmost app, list installed/running apps, tiered permission model
Clipboard	Read & Write	Full clipboard access for paste-based workflows
Batch	Action Batching	Chain multiple actions in a single MCP call for speed
Runtime	Zero-Config Bootstrap	Auto-creates Python virtualenv and installs dependencies on first run
Portable	Skill Packaging	Ships as a standalone skill — install once, works without the source repo
Public	No Private Dependencies	Built entirely on public packages: Node.js, Python, pyautogui, mss, Pillow, pyobjc

Quick Start

1. Clone & build

git clone https://github.com/wimi321/macos-computer-use-skill.git
cd macos-computer-use-skill
npm install && npm run build

2. Run the MCP server

node dist/cli.js

On first launch the server automatically creates a Python virtualenv in .runtime/venv and installs all runtime dependencies. No Claude desktop app, no private native modules.

3. Or install from ClawHub

clawhub install computer-use-macos

[!NOTE] macOS requires Accessibility and Screen Recording permissions for the host process. The server checks both on startup and reports status through MCP.

Architecture

flowchart LR

GitHub で README 全文を見る

インストール

This server does not publish a one-line install command.

Open the repository installation guide MCP 初心者？mcpskill.org のガイドから始めましょう →

設定

{
  "mcpServers": {
    "computer-use": {
      "command": "node",
      "args": ["/absolute/path/to/macos-computer-use-skill/dist/cli.js"],
      "env": {
        "CLAUDE_COMPUTER_USE_DEBUG": "0",
        "CLAUDE_COMPUTER_USE_COORDINATE_MODE": "pixels"
      }
    }
  }
}