Computer use

Let a chat engine see your Mac and interact with other apps. You control macOS permissions and whether input actions need approval.

Set it up

1. Open Settings › Connectors and find Computer. The same permission controls appear in onboarding’s Your Mac step.
2. Choose Grant… or Open System Settings. Grant Screen Recording for screenshots and Accessibility for finding controls and sending input.
3. Return to Shelzo and choose Check permissions if the status is not current. “Not checked” means the permission status is unknown.
4. Choose the input policy below, then ask a chat to do a small task. For example: “Open TextEdit and type Hello into its document.”

Ask, Allow, and Off

• Ask each time: each click, typing action, key press, scroll, drag, or app/URL opening waits for your approval in the chat or Inbox.
• Allow: input actions run without another connector approval.
• Off: input actions are blocked, but observation tools remain available. Disable the Computer connector entirely to remove all its tools.

Screenshots, app/window lists, finding controls, waiting, and checking permissions do not need a connector approval. They still require the relevant macOS permissions.

What the agent can do

It can capture a screen or window, inspect accessible controls, open apps and URLs, click, type, press keys, scroll, and drag. Apps expose different amounts of accessibility information, so finding a control is not guaranteed.

The helper refuses input into Shelzo’s own windows. It cannot bypass macOS permissions or approve its own requests. Screenshots are returned to the engine as tool results; consider what is visible before asking it to look.

Stop

Click Computer use · Stop in the title bar, or press ⌥⌘.. Stop disconnects computer use, denies pending computer approvals, and interrupts affected agent turns. It does not undo clicks or text already sent. To keep future input blocked, choose Off or disable the connector.

If it fails

Check Screen Recording and Accessibility under System Settings › Privacy & Security, then refresh permissions in Shelzo. If input has no target after an approval, name the intended app in your request. “Computer use helper is not bundled in this build” needs a complete app bundle; changing permissions cannot repair a missing helper.