web-infra-dev/midscene-skills

AI-powered, vision-driven UI automation for every platform.

306Stars on the repository
6Mods indexed here, across every type
17d agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown

web-infra-dev/midscene-skills

Skill Claude CodeCodex

Vision-driven Android device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control Android devices with natural language commands via ADB. Perform taps, swipes, text input, app…

not rated 306 +1 17d ago A 159 tokens original MIT

browser-automation

02

web-infra-dev/midscene-skills

Skill Claude CodeCodex

Vision-driven browser automation using Midscene. Operates from screenshots — no DOM or accessibility labels needed. Runs in headless Puppeteer — does NOT take over the user's mouse or keyboard. Also supports CDP mode and Bridge mode to connect to an existing Chrome. Use this skill when the user wants to: Browse…

not rated 306 +1 17d ago A 191 tokens original MIT

computer-automation

03

web-infra-dev/midscene-skills

Skill Claude CodeCodex

Vision-driven desktop automation using Midscene. Control your local desktop (macOS, Windows, Linux) or a remote Windows desktop over RDP with natural language commands. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of…

not rated 306 +1 17d ago A 214 tokens original MIT

web-infra-dev/midscene-skills

Skill Claude CodeCodex

Vision-driven HarmonyOS NEXT device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control HarmonyOS devices with natural language commands via HDC. Perform taps, swipes, text…

not rated 306 +1 17d ago A 164 tokens original MIT

web-infra-dev/midscene-skills

Skill Claude CodeCodex

Vision-driven iOS device automation using Midscene CLI. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control iOS devices with natural language commands via WebDriverAgent. Triggers: ios, iphone, ipad, ios…

not rated 306 +1 17d ago A 150 tokens original MIT

vitest-midscene-e2e

06

web-infra-dev/midscene-skills

Skill Claude CodeCodex

Enhances Vitest with Midscene for AI-powered UI testing across Web (Playwright), Android (ADB), and iOS (WDA). Scaffolds new projects, converts existing projects, and creates/updates/debugs/runs E2E tests using natural-language UI interactions. Triggers: write test, add test, create test, update test, fix test, debug…

not rated 306 +1 17d ago A 139 tokens original MIT

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: