DesktopCtl

Free plan Mac

What DesktopCtl is

DesktopCtl is a macOS launcher and command-line tool for AI agents that need to work through a computer’s screen, mouse, and keyboard. It can interact with any desktop app without app integrations or APIs, and supports CLI-capable agents using any AI model, including local LLMs. Its local GPU-accelerated text recognition and computer vision capture the interface and extract structured content, while the CLI offers deterministic clicking, typing, and waiting. The launcher adds keyboard-first navigation, active-window context, and tools to run or resume sessions with multiple local agents. The maker says screen recognition happens locally and screenshots remain local by default. An on-screen indicator appears during agent access, and operating-system permissions are granted only to DesktopCtl. The software is free and open source under the MIT License. It currently supports macOS on Apple Silicon only, and its release builds are ad-hoc signed rather than Developer ID signed or notarized.

Who it suits

DesktopCtl suits people using CLI-capable AI agents to operate desktop apps, including those bringing local LLMs. It is limited to macOS on Apple Silicon.

What it does well

Works with desktop apps without integrations or APIs
Supports any AI model, including local LLMs
Local screen recognition and computer vision
Free and open source under MIT License

What to know first

Supports macOS on Apple Silicon only
Release builds are not notarized or Developer ID signed

Limits

DesktopCtl currently supports macOS on Apple Silicon only. Its release builds use a local ad-hoc signature and are not Developer ID signed or notarized.

Plans

Plan	Billed and limits	Price
Free and open source	No integrations required · works with any desktop app	Free

As desktopctl.com lists them, read 4 Oct 2026. The maker's own page has the final word.

Getting started

Use a macOS computer with Apple Silicon.
Run the repository’s install command to download the latest release.
Find the CLI at ~/.local/bin/desktopctl and the app at ~/Applications/DesktopCtl.app.
Use a CLI-capable agent and bring an AI model, including a local LLM if desired.
Grant DesktopCtl operating-system permissions for screen, mouse, and keyboard access.

Verdict

DesktopCtl combines screen-based desktop control with a local launcher and CLI for AI agents. Its platform support is currently limited to Apple Silicon Macs.

Questions

How much does DesktopCtl cost?

DesktopCtl is free. Its plan is listed as free.

Is DesktopCtl open source?

Yes. The homepage identifies it as open source under the MIT License.

Which computers does DesktopCtl support?

The repository says it currently supports macOS on Apple Silicon only.

Does it need integrations with the apps it controls?

No app integrations or APIs are required; it works with desktop apps.

Which AI models can I use?

Users can bring any AI model, including local LLMs. The agent must be able to use a CLI.

Where does DesktopCtl run its screen recognition?

The maker says computer vision and text recognition run locally, and screenshots stay local by default rather than being shared with AI agents.

Facts from DesktopCtl's own pages

Access controls: The maker says a visual indicator appears when the agent accesses the screen, mouse, or keyboard, and OS-level permissions are granted only to DesktopCtl. · desktopctl.com, 4 Oct 2026
Agent support: It supports agents that can use a CLI and lets users bring any AI model, including local LLMs. · desktopctl.com, 4 Oct 2026
App compatibility: It works with any desktop app and requires no app integrations or APIs. · desktopctl.com, 4 Oct 2026
Automation: Its CLI provides deterministic actions including clicking, typing, and waiting. · desktopctl.com, 4 Oct 2026
Installation: The repository gives an install command that downloads the latest release and places the CLI at ~/.local/bin/desktopctl and the app at ~/Applications/DesktopCtl.app. · github.com, 4 Oct 2026
Intended users: The maker describes DesktopCtl as a tool for AI agents to control desktop applications, with any CLI-capable agent able to use it. · desktopctl.com, 4 Oct 2026
Launcher: The macOS launcher provides keyboard-first navigation, active-window context, and the ability to run and resume sessions with multiple local agents. · desktopctl.com, 4 Oct 2026
License: The homepage identifies DesktopCtl as open source under the MIT License. · desktopctl.com, 4 Oct 2026
Platform support: The maker’s repository says DesktopCtl currently supports macOS on Apple Silicon only. · github.com, 4 Oct 2026
Privacy: The maker says computer vision and text recognition run locally and screenshots stay local by default rather than being shared with AI agents. · desktopctl.com, 4 Oct 2026
Purpose: DesktopCtl is a local launcher and CLI for AI agents to observe and control a computer using its screen, mouse, and keyboard. · desktopctl.com, 4 Oct 2026
Signing: The repository says release builds use a local ad-hoc signature and are not Developer ID signed or notarized. · github.com, 4 Oct 2026
UI perception: It uses local GPU-accelerated text recognition and computer vision to capture the UI and extract structured content. · desktopctl.com, 4 Oct 2026

Where DesktopCtl stands on Freedom251

AI Computer Use Agents#8 of 24