GitHub Copilot can now use the apps on your computer
Computer use in public preview: Copilot clicks, types and moves between apps where there’s no API or CLI.
On October 1, GitHub added desktop app control to Copilot. It’s aimed at legacy and GUI-only software with no API, command line or MCP integration.
What’s new
Copilot reads app content and visual context, then clicks controls, enters and edits text, scrolls, drags and moves through workflows across several apps. GitHub’s example is completing an expense report in Safari.
How to try it
It works in Copilot CLI and the GitHub Copilot app on macOS and Windows.
- CLI:
/computer on, with/computer showfor status and/computer offto disable it. - App: Settings, Computer Use, Enable Computer Use.
It helps to describe the outcome, the apps involved and any constraints rather than individual clicks.
Limitations
This is a public preview. Copilot asks for approval before controlling any app, and you can review or reset apps set to “always allow”. macOS requires Accessibility and Screen Recording permissions. Admins can turn the feature off for their organization. The announcement doesn’t name plans or prices.
Prepared with AI from public sources.