understudylabs

understudylabs/understudy-agent-tools

Plugin Claude Code

Plugin marketplace listing 1 plugin: understudy.

understudylabs/understudy-agent-tools

Plugin Claude Code

Improve LLM apps and agents from real traces — reduce cost/latency, raise quality/reliability, capture traces, build evals, run local optimization (GEPA), compare models/providers, and route through Understudy.

understudylabs/understudy-agent-tools

Command

Start the Understudy onboarding skill.

understudylabs/understudy-agent-tools

Instructions file CodexOpenCode

Public OSS conventions for Understudy agent tools.

understudylabs/understudy-agent-tools

Instructions file

Instructions for understudylabs/understudy-agent-tools, covering claude.md, prime directive (the 10-second version), how to behave and run on fable, parallelize like the model card.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when deciding whether a verifier reward is trustworthy for optimization.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Measure per-band model headroom from a local, source-bound run artifact before investing in training.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to build an eval from their real LLM app before changing anything — "measure how my app is doing today", "build an eval from my workload", "we have no baseline", "is my current model actually good". Turns the workload into auditable local artifacts (harness, metric, frozen splits, baseline)…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer asks "is Understudy causing my errors", "which workloads are routed", "is my routing config actually taking effect", "is my provider healthy", "are there 500s on staging", "what's our error rate", "where is my gateway spend going", or wants self-service diagnostics without asking the team. Reads…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to compare candidate models — any mix of local, gateway, or frontier — on the same eval and see quality, latency, cost, and reliability side by side. "Which model should I use", "sweep these models on my benchmark", "compare Gemma vs the frontier on my eval". To stand up and serve a local…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when you need to know HOW two model runs differ behaviorally on the same tasks, not just THAT one scores higher — per-task trajectory diffing that classifies the gap as persistence/recovery, knowledge, or format/parsing. "why does the bigger model pass these", "is this gap RL-shaped", "diff these two trajectory…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use to turn loose per-task trajectory JSONs (a Lilac export or local rollout corpus) into a queryable, provenance-tracked, contamination-safe dataset that hard-blocks any selection leaking frozen dev/holdout into a train/RL/distill pool. "curate my trajectories", "which rollouts are train-safe", "exclude the holdout…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use to build a simulated, seeded environment (AutomationBench / verifiers style) so any model can run a captured agentic workload end-to-end and be scored on final state — "simulate this workload's tools", "build a validator for these traces", "let a small model attempt the whole task", "score recall/precision against…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a user asks to "deslop", "de-AI", "make it sound human", remove AI patterns or tropes, clean up AI writing, review prose for authenticity, or draft substantial natural-sounding prose. Applies to papers, articles, memos, reports, newsletters, cover letters, and other edited writing.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to replace an expensive frontier model on a classification workload (binary, multi-class, multi-label, or structured extraction) with a fine-tuned open-weight student — "distill this classifier", "can a small model do this tagging job", "the frontier labels these for $X, make it cheaper"…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer provides a hosted Understudy traceid or asks "get this trace", "download this trace", "show every request in this trace", or "export these trace IDs". Resolves trace membership through the customer trace lookup API, exports linked captures privately, and hands local files to the trace viewer or…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer already has production LLM traces — a bucket of captures, provider log exports, or gateway capture files — and wants them visualized, turned into local redacted eval sets, or profiled for cost. "Visualize this trace", "ingest my traces", "turn these logs into an eval set", "where is my LLM spend…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to inspect Anthropic or Claude billing evidence from email, invoices, usage exports, or an authenticated billing website: "scan my Anthropic bills", "check billing emails", "look at the console usage page", "find spend hotspots from receipts". Optional, approval-gated evidence source for…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to install, enable, update, reinstall, remove, or verify Understudy in a coding agent - "install Understudy", "add the Understudy skills", "make Claude/Cursor/Codex/OpenCode/Hermes/Devin see the skills". Chooses the requested agent platform and routes to the local install, reload…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for Codex installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify the Understudy Codex plugin - "install Understudy in Codex", "add the Codex plugin", "make Codex see the skills". Route to install-agent-adapter with platform codex.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for Cursor installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify the Understudy Cursor plugin - "install Understudy in Cursor", "add the Cursor plugin", "make Cursor see the skills". Route to install-agent-adapter with platform cursor.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for OpenCode installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify Understudy in OpenCode - "install Understudy in OpenCode", "add the OpenCode skills", "make OpenCode see the skills". Route to install-agent-adapter with platform opencode.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for Claude Code installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify the Understudy Claude Code plugin - "install Understudy in Claude", "add the Understudy skills", "why can't Claude see the skill". Route to install-agent-adapter with platform claude-code.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer's LLM app is running but has NO traces yet and wants capture flowing in about a minute with no code changes — "instrument my app", "start capturing my LLM calls", "I have no traces, get me some", "turn on tracing for my agent". Detects the provider SDK, redirects it through the Understudy gateway…