ScreenCue

Bold, hand-drawn arrows and light outlines over your desktop. An AI agent can point to the next control while you keep working in the application.

Ask by voice or text. The agent calls screen_hint, and you click the control yourself. Hints let mouse input pass through and never take keyboard focus. A separate dark text panel is optional.

Rust · Windows / macOS / Linux X11 · Local MCP · MIT · Preview 0.0.4

Early releases follow the 0.0.x versioning policy; small follow-up revisions use letter suffixes.

Features

• A native desktop settings window, app icon, and installable desktop packages. Open ScreenCue normally to configure appearance, privacy, and conversation assistance.
• A Connections menu with separate audio/speaker, fast-model, big-model and System 1 profiles. Choose an API endpoint or command bridge for each, save separate keys in the OS credential store, or reference existing environment variables. See connections.
• Independent speaking notes through screen_prompt: agents can send text immediately without a screenshot or coordinate lookup.
• Optional microphone and system-audio transcription, explicit speaker-role mappings, and local or hosted model adapters. Capture starts only after pressing Start. See conversation setup and the independent fast/decision/planning lanes.
• Optional Windows screen-capture exclusion, with native flag verification. macOS/Linux report unsupported; no sharing application is assumed to honor it. See capture privacy.
• A large, crooked SKETCH arrow made from four hand-drawn animation frames. Its tip stops 12 px before the target, scaled for display density.
• Independent arrow and target outline. Use an ellipse, rectangle, rounded rectangle, or polygon; outlines have no fill.
• Red is the primary color. Automatic contrast can select another color when red blends into the background, then return to red when suitable.
• Independent dark brush panels with a bold title and readable body. Their shape adapts to the text; long text wraps into monitor-bounded pages. Show a panel without an arrow or target, or place it separately with panel_x / panel_y. See text panels.
• Persistent hints: clicks and changes of the active application do not dismiss them.
• Local window tracking without another model call. When the target goes offscreen or its window is minimized or closed, a labeled pointer stays at the display edge.
• Ctrl+Alt+X to hide the entire hint; Ctrl+Option+X on macOS. The shortcut is configurable.