Skill Claude CodeCodex
Launch a datacollection automated trajectory-collection task on a GPU host using the geniesim autocollect run CLI verb (which wraps scripts/rundatacollection.sh: docker run -d + in-container server+client). Trigger: when the user asks to "采集数据", "跑数据采集", "run data collection", "collect a task", "生产轨迹", "launch a…
Skill Claude CodeCodex
Probe a model inference WebSocket server (e.g. servepolicy) and validate the response — using the geniesim benchmark check-inference CLI verb, which wraps the benchmark package's checkinference.py. Trigger: When the user asks to "check inference", "校验模型推理", "test inference server", "verify policy server", "ping the…
Skill Claude CodeCodex
Convert robot trajectory datasets between formats — currently agibot v1 → LeRobot v2.1 (parquet + HEVC/PNG-encoded MP4). Uses the geniesim dataset convert agibot-to-lerobot CLI verb, which wraps the geniesimbenchmark.dataset.convert.agibottolerobot Python API. Trigger: When the user asks to "convert agibot to…
Skill Claude CodeCodex
Provision and launch the Simulation Challenge baseline inference model end to end: clone the inference code from a given git repo/branch, download the checkpoints from ModelScope into the repo's local checkpoints path, install deps, and start the inference agent. Trigger: When the user asks to "拉取 baseline 模型"…
Skill Claude CodeCodex
Download the Simulation Challenge LeRobot v2.1 training datasets from ModelScope using ./scripts/downloaddataset.sh. Pulls task-suite data (instruction / manipulation / sim2real) from the agibotworld/GenieSim3.0-Dataset repo into a local dir. Trigger: When the user asks to "下载训练数据", "下载数据集", "拉取 lerobot 数据", "download…
Skill Claude CodeCodex
Entry point for the Simulation Challenge skill set. Use when the user mentions the challenge, leaderboard, submitting a model, or any of the /api/challenge/ endpoints — this skill picks the right downstream skill for them.
Skill Claude CodeCodex
Reference for the Simulation Challenge inference wire protocol — the exact obs (input) and action (output) message format exchanged between the gateway/genie-sim simulator and the contestant's inference agent over the reverse WebSocket tunnel. Covers the JSON-RPC envelope, image encoding, per-board state/action joint…
Skill Claude CodeCodex
Use when the contestant needs to obtain or refresh their Simulation Challenge JWT (CHALLENGETOKEN), or wants to inspect the current logged-in user. Trigger words include "log in", "token", "401", "current user", "name", "refresh".
Skill Claude CodeCodex
Use to track a Simulation Challenge job's progress — list jobs, watch a job's status until terminal, fetch its per-task scores, or pull execution logs when it failed. Read-only; safe to run without confirmation.
Skill Claude CodeCodex
Use to fetch the contestant's best score and the per-board leaderboard for the Simulation Challenge. Read-only; safe to run without confirmation.
Skill Claude CodeCodex
Use when the contestant wants to launch the inference Agent that connects to the Simulation gateway via WebSocket. Wraps the inference repo's ./scripts/tunnel.sh and scales to PARALLELISM processes. This is side-effecting (consumes GPUs and a parallelism slot) — confirm before launching.
Skill Claude CodeCodex
Use when the contestant wants to submit a model evaluation job to the Simulation Challenge — POST /api/challenge/job. This is a quota-consuming, side-effecting action; always confirm with the user first. Captures JOBUUID, PARALLELISM, TUNNELENDPOINT for the rest of the pipeline.
Skill Claude CodeCodex
Use when something in the Simulation Challenge pipeline is misbehaving — auth errors, agent disconnects, jobs stuck in Pending, jobs ending in Failed, drain frames. Maps a symptom to its likely cause and the next command to run.
Skill Claude CodeCodex
Launch a geniesimbenchmark task locally (typically inside the GUI Docker container) against a user-provided inference server, using the geniesim benchmark run CLI verb. Trigger: When the user asks to "run geniesim", "本地跑仿真", "启动仿真任务", "run a benchmark", "launch .yaml", or wants to execute a benchmark task config…
Skill Claude CodeCodex
Stand up the geniesimgenerator scene-generation stack — the MCP asset servers + Open WebUI — via docker compose, picking one embedding backend. Trigger: When the user asks to "部署 generator", "deploy the scene generator", "启动资产检索服务", "start the MCP assets server", "run the generator stack", "set up open-webui for scene…
Skill Claude CodeCodex
Turn a natural-language scene request into a Genie Sim scene — an LLM writes a Scene-Language DSL program (LLMRESULT.py), and geniesimgenerator.app compiles it into scene.usda + a layout graph under benchmark/config/llmtask/. Works either through the Open WebUI agent, OR by having Claude write the DSL program directly…
Skill Claude CodeCodex
Search the Genie Sim asset library by natural-language keyword via the generator's searchassets MCP tool (RAG over ASSETSINDEX), and look up asset interaction metadata via getinteractions. Trigger: When the user asks to "搜索资产", "find an asset", "查一下有没有...的模型", "search the asset library", "what assets match ", "look up…
Skill Claude CodeCodex
Bring a custom robot into the Genie Sim RT Engine — author / fix a xacro / URDF in geniesimrobotmodel, prep meshes with the offline tools (normalizeobjnames.py, diagnoseurdf.py, recomputeinertia.py, fixdaeunits.py, copydaematerial.py), stage assets into the AS3 layout (robot.usda +…
Skill Claude CodeCodex
Build the geniesimros colcon workspace inside the Genie Sim Docker container using the geniesim ros build CLI verb. Produces the ./devel overlay that every ros2 launch geniesimbringup … step depends on. Trigger: When the user asks to "build ros workspace", "编译 ros 工作空间", "colcon build", "build geniesimbringup", "set…
Skill Claude CodeCodex
Diagnose physics misbehaviour in the Genie Sim RT Engine — robot swings on spawn, contacts tunnel, joints drift past their limits, cloth blows up, the convex-hull proxy renders instead of the visual mesh, or the wrong physics backend is active. Walks the user through the engine's debug toggles (visualizers, marker…
Skill Claude CodeCodex
Launch a geniesimbringup scene against a chosen physics + render backend, using ros2 launch geniesimbringup app.launch.py. Covers the scene × launcher matrix (pick-and-place / whole-body-control / flat-table demos × Isaac PhysX / Newton-standalone backends) and the optional MoveIt 2 + WBC RViz overlay. Trigger: When…
Skill Claude CodeCodex
Tune PBR metallic / roughness on URDF visual meshes without re-exporting DAE — author an inline element inside any , and let the engine's URDF→USD pipeline patch the converter's defaults post-conversion. Useful for sim-to-real visual fidelity (DAE materials round-trip poorly; Isaac Sim's importer lands every embedded…
Skill Claude CodeCodex
Bring up MoveIt 2 + whole-body-control RViz for the Genie G2 family, using ros2 launch geniesimmoveit wbc.launch.py. Covers arm × gripper selection, the three packaged IK plugins (KDL-coupled, bioik-coupled, relaxed-IK), the GenieBioIK human-prior A/B switch, and the useros2control:=false mode for direct /jointcommand…
Skill Claude CodeCodex
Capture a Genie Sim RT Engine episode while a scene runs — record the canonical ROS 2 topics (/jointstates, /jointcommand, /tf, /clock, cameras) with ros2 bag, or pair the recording with the teleop / benchmark loops that have their own per-episode output hooks. Trigger: When the user asks to "record an episode"…