computer-use

computer-use is a skill for Claude Code, Codex from pedroiff0/awesome-skills. It costs 68 tokens per session (2,748 once invoked), scanned A, a copy of computer-use, MIT.

A skill for controlling a computer desktop by clicking, typing, scrolling, and dragging in the background. It works on macOS, Windows, and Linux without taking over the user's cursor or keyboard focus.

In plain words
What is it for?
Use it to interact with any tool-capable desktop application, beginning with a screenshot that identifies clickable and editable elements.
Why use it?
It lets an AI agent operate desktop applications while the user continues working in other windows or virtual desktops.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to interact with any tool-capable desktop application, beginning with a screenshot that identifies clickable and editable elements.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/pedroiff0/awesome-skills/computer-use
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add pedroiff0/awesome-skills --skill computer-use
Clone the repo
git clone --depth 1 https://github.com/pedroiff0/awesome-skills

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for computer-use

README.md
[![agentmods](https://agentmods.dev/badge/skills/pedroiff0/awesome-skills/computer-use.svg)](https://agentmods.dev/skills/pedroiff0/awesome-skills/computer-use)
Your own site
<a href="https://agentmods.dev/skills/pedroiff0/awesome-skills/computer-use"><img src="https://agentmods.dev/badge/skills/pedroiff0/awesome-skills/computer-use.svg" alt="Measured on agentmods" height="20"></a>
Per session 68 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,748 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. ✓ AI security review Sonnet 5 · 7 Sept 2026 📄 Read the review
Origin 98% copy Near-identical to another mod in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00068 $0.02748
Opus 5 $0.00034 $0.01374
Sonnet 5 $0.00014 $0.00550
Haiku 4.5 $0.00007 $0.00275

Measured 8d ago against content hash 3e5ebf09a2d9, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-08, from the pricing page.

Security

Grade A, and why

computer-use scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

This is a copy

98% identical to computer-use — 1 line differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.

skills/autonomous-ai-agents/computer-use/SKILL.md · 265 lines

How it starts

The opening of the file, as written. The whole thing — 265 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Computer Use (universal, any-model, cross-platform)

You have a computer_use tool that drives the user's desktop in the background — your actions do NOT move the user's cursor, steal keyboard focus, or switch virtual desktops / Spaces. The user can keep typing in their editor while you click around in a browser in another window. This is the opposite of pyautogui-style automation.

Everything here works with any tool-capable model — Claude, GPT, Gemini, or an open model on a local OpenAI-compatible endpoint. There is no Anthropic-native schema to learn.

Hermes drives cua-driver under the hood for the platform plumbing. The Hermes-side computer_use tool exposed in this skill is a higher-level Hermes vocabulary; the raw cua-driver MCP tools (which a different agent harness would see) are NOT what you call — call the computer_use actions documented below.

The canonical workflow

Step 1 — Capture first. Almost every task starts with:

computer_use(action="capture", mode="som", app="<the app you're driving>")

Returns a screenshot with numbered overlays on every interactable element AND an AX-tree index like:

#1  AXButton 'Back' @ (12, 80, 28, 28) [Chrome]
#2  AXTextField 'Address bar' @ (80, 80, 900, 32) [Chrome]
#7  Link 'Sign In' @ (900, 420, 80, 24) [Chrome]
...

The role names match the host platform's accessibility framework (AXButton on macOS, Button on Windows UIA, push button on Linux AT-SPI) — treat them as labels, not as strict types.

Step 2 — Click by element index. This is the single most important habit:

computer_use(action="click", element=7)

Much more reliable than pixel coordinates for every model. Claude was trained on both; other models are often only reliable with indices.

Step 3 — Verify. After any state-changing action, re-capture. You can save a round-trip by asking for the post-action capture inline:

computer_use(action="click", element=7, capture_after=True)

Read the full file on GitHub · 265 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 265 lines · 68 tokens per session scan F 3e5ebf09a2d9

Subscribe to this mod's changes

computer-use is a skill published in the GitHub repository pedroiff0/awesome-skills (1 stars, last pushed today), licensed MIT. It adds 68 tokens to every session and 2,748 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. It is 98% identical to computer-use, differing in 1 line, and is treated as a copy.

Related

Other skills, from other repositories

mnemosyne-maintenance

Use when: upgrading Mnemosyne, diagnosing slow/hung consolidation (mnemosynesleep), fixing missing embeddings, or troubleshooting import/version mismatches.

AtlasOmnia/hermes-custom-pack · 40 tokens

dx-roaster

Brutally honest developer-experience audit for a GitHub repo. Scores 10 DX dimensions (time-to-first-success, README clarity, visual proof, install, quick-start, docs, examples, community, trust, marketing), writes a shareable roast in the requested tone (brutal/honest/kind), produces a prioritized action plan ranked…

Varnan-Tech/opendirectory · 130 tokens

hf-model-card-research

Extract structured metadata — downloads, likes, benchmark claims, file sizes, author statements — from HuggingFace model cards. Used when the user asks you to "check these models on HF", "pull benchmarks for these variants", or "compare what authors claim.".

AtlasOmnia/donna-starter · 35 tokens

ai-llm-skills-guide

Guide for AI Agents and LLM development skills including RAG, multi-agent systems, prompt engineering, memory systems, and context engineering.

gmh5225/awesome-skills · 35 tokens

mnemosyne-maintenance

Use when: upgrading Mnemosyne, diagnosing slow/hung consolidation (mnemosynesleep), fixing missing embeddings, or troubleshooting import/version mismatches.

AtlasOmnia/donna-starter · 40 tokens

review-workflow

A review workflow for GitHub pull requests and issues, including judging whether changes can be merged or an issue can be closed. It requires read-only review, REST API access, and testing changes in practice.

ggg123124/vrchat-assistant · 46 tokens