Give your AI agent eyes and hands on iOS Simulator and Android emulator/devices.
About the project
lycorp-jp/sim-use is a command-line tool that lets AI agents observe and control iOS simulators, Android emulators, and devices through accessibility information and input actions. It helps agents test mobile applications by reading compact screen descriptions and interacting with named elements, while the catalogue skills and instructions teach agents how to use those capabilities.
Drive iOS Simulator, Android emulator/device, and physical iPhone/iPad screens for AI agents. Use when asked to automate a simulator or emulator, drive a real iOS device, tap/swipe/type on a device, describe UI, take a screenshot, or interact with a mobile app.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: