agent-desktop

agent-desktop is a skill for Claude Code, Codex from superagent-ai/grok-cli. It costs 56 tokens per session (615 once invoked), scanned A, original, MIT.

Instructions for using a computer-control helper on macOS. It lets an agent inspect and interact with native desktop applications through their visible windows and interface controls.

In plain words
What is it for?
Use it to launch apps, focus windows, inspect controls, click, type, scroll, and visually confirm actions in macOS applications.
Why use it?
It provides a way to handle desktop tasks that cannot be completed through repository files or browser-only tools.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/superagent-ai/grok-cli/agent-desktop
Any agent
npx skills add superagent-ai/grok-cli --skill agent-desktop
Clone the repo
git clone --depth 1 https://github.com/superagent-ai/grok-cli

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for agent-desktop

README.md
[![agentmods](https://agentmods.dev/badge/skills/superagent-ai/grok-cli/agent-desktop.svg)](https://agentmods.dev/skills/superagent-ai/grok-cli/agent-desktop)
Your own site
<a href="https://agentmods.dev/skills/superagent-ai/grok-cli/agent-desktop"><img src="https://agentmods.dev/badge/skills/superagent-ai/grok-cli/agent-desktop.svg" alt="Measured on agentmods" height="20"></a>
Per session 56 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 615 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00056 $0.00615
Opus 5 $0.00028 $0.00308
Sonnet 5 $0.00011 $0.00123
Haiku 4.5 $0.00006 $0.00061

Measured 3d ago against content hash 5b817bb2fa21, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

agent-desktop scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 3d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.agents/skills/agent-desktop/SKILL.md · 59 lines

How it starts

The opening of the file, as written. The whole thing — 59 lines — stays where its author put it; the contents beside it link to each section on GitHub.

agent-desktop

Use this skill when the task involves the host macOS desktop rather than repository files, shell output, or browser-only verification.

This project uses agent-desktop on the host. Prefer the built-in Computer sub-agent for these tasks instead of trying to drive the desktop with plain shell commands.

When to use it

  • The user wants to inspect or interact with a native macOS application.
  • The task needs app launch, window focus, accessibility snapshots, semantic element refs, clicks, typing, keypresses, or scrolling.
  • A browser-only workflow is not enough, or the target is not a web page.

Requirements

  • agent-desktop must be installed and its native binary available.
  • On macOS, the terminal app running grok needs Accessibility permission.
  • Refs from computer_snapshot are only valid until the next snapshot.

Preferred flow

  1. Delegate to task with agent: "computer" unless the current agent already has the computer_* tools and the task is tiny.
  2. Use computer_launch, computer_list_windows, or computer_focus_window to get the target app/window ready.
  3. Start with computer_snapshot.
  4. Pick one ref-based action.
  5. After any UI transition, snapshot again before reusing refs.

Tool guidance

  • computer_snapshot: primary observation tool; prefer interactive_only.
  • computer_click: use ref values from the latest snapshot whenever possible.
  • computer_type: requires a target ref and is preferred over coordinate typing.
  • computer_press: use for shortcuts and special keys such as Enter, Tab, cmd+space, or cmd+k.
  • computer_scroll: pass an element ref, not raw coordinates.
  • computer_get: read text, value, bounds, role, or states from a ref.
  • computer_screenshot: use for visual confirmation or when the accessibility tree is not enough.

Reliability rules

  • Use a snapshot -> act -> snapshot loop.
  • Prefer refs over coordinates.
  • Refs go stale after the next snapshot; do not reuse them blindly.
  • Keep actions reversible and low risk unless the user explicitly asked for something destructive.
  • If the accessibility tree is poor or ambiguous, use computer_screenshot for confirmation and explain the limitation.

Read the full file on GitHub · 59 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 3d ago First seen · 59 lines · 56 tokens per session scan A 5b817bb2fa21

Subscribe to this mod's changes

agent-desktop is a skill published in the GitHub repository superagent-ai/grok-cli (3,445 stars, last pushed 1mo ago), licensed MIT. It adds 56 tokens to every session and 615 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.