understudylabs/understudy-agent-tools

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when deciding whether a verifier reward is trustworthy for optimization.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Measure per-band model headroom from a local, source-bound run artifact before investing in training.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to build an eval from their real LLM app before changing anything — "measure how my app is doing today", "build an eval from my workload", "we have no baseline", "is my current model actually good". Turns the workload into auditable local artifacts (harness, metric, frozen splits, baseline)…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer asks "is Understudy causing my errors", "which workloads are routed", "is my routing config actually taking effect", "is my provider healthy", "are there 500s on staging", "what's our error rate", "where is my gateway spend going", or wants self-service diagnostics without asking the team. Reads…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to compare candidate models — any mix of local, gateway, or frontier — on the same eval and see quality, latency, cost, and reliability side by side. "Which model should I use", "sweep these models on my benchmark", "compare Gemma vs the frontier on my eval". To stand up and serve a local…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when you need to know HOW two model runs differ behaviorally on the same tasks, not just THAT one scores higher — per-task trajectory diffing that classifies the gap as persistence/recovery, knowledge, or format/parsing. "why does the bigger model pass these", "is this gap RL-shaped", "diff these two trajectory…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use to turn loose per-task trajectory JSONs (a Lilac export or local rollout corpus) into a queryable, provenance-tracked, contamination-safe dataset that hard-blocks any selection leaking frozen dev/holdout into a train/RL/distill pool. "curate my trajectories", "which rollouts are train-safe", "exclude the holdout…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use to build a simulated, seeded environment (AutomationBench / verifiers style) so any model can run a captured agentic workload end-to-end and be scored on final state — "simulate this workload's tools", "build a validator for these traces", "let a small model attempt the whole task", "score recall/precision against…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a user asks to "deslop", "de-AI", "make it sound human", remove AI patterns or tropes, clean up AI writing, review prose for authenticity, or draft substantial natural-sounding prose. Applies to papers, articles, memos, reports, newsletters, cover letters, and other edited writing.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to replace an expensive frontier model on a classification workload (binary, multi-class, multi-label, or structured extraction) with a fine-tuned open-weight student — "distill this classifier", "can a small model do this tagging job", "the frontier labels these for $X, make it cheaper"…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer provides a hosted Understudy traceid or asks "get this trace", "download this trace", "show every request in this trace", or "export these trace IDs". Resolves trace membership through the customer trace lookup API, exports linked captures privately, and hands local files to the trace viewer or…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer already has production LLM traces — a bucket of captures, provider log exports, or gateway capture files — and wants them visualized, turned into local redacted eval sets, or profiled for cost. "Visualize this trace", "ingest my traces", "turn these logs into an eval set", "where is my LLM spend…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to inspect Anthropic or Claude billing evidence from email, invoices, usage exports, or an authenticated billing website: "scan my Anthropic bills", "check billing emails", "look at the console usage page", "find spend hotspots from receipts". Optional, approval-gated evidence source for…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to install, enable, update, reinstall, remove, or verify Understudy in a coding agent - "install Understudy", "add the Understudy skills", "make Claude/Cursor/Codex/OpenCode/Hermes/Devin see the skills". Chooses the requested agent platform and routes to the local install, reload…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for Codex installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify the Understudy Codex plugin - "install Understudy in Codex", "add the Codex plugin", "make Codex see the skills". Route to install-agent-adapter with platform codex.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for Cursor installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify the Understudy Cursor plugin - "install Understudy in Cursor", "add the Cursor plugin", "make Cursor see the skills". Route to install-agent-adapter with platform cursor.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for OpenCode installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify Understudy in OpenCode - "install Understudy in OpenCode", "add the OpenCode skills", "make OpenCode see the skills". Route to install-agent-adapter with platform opencode.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Compatibility shim for Claude Code installs. Use when a developer asks to install, update, enable, reinstall, remove, or verify the Understudy Claude Code plugin - "install Understudy in Claude", "add the Understudy skills", "why can't Claude see the skill". Route to install-agent-adapter with platform claude-code.

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer's LLM app is running but has NO traces yet and wants capture flowing in about a minute with no code changes — "instrument my app", "start capturing my LLM calls", "I have no traces, get me some", "turn on tracing for my agent". Detects the provider SDK, redirects it through the Understudy gateway…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use to give a developer an immediate local-vs-frontier model comparison before they have their own traces — "what can a local model do", "is a small model good enough", "compare a local model to a frontier model", "the onboarding climb". For comparing many models on a user's own eval, use compare-model-sweep; to serve…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Polish LaTeX papers and PDFs through evidence proofreading, deslop-style prose cleanup, TeX compilation, warning triage, and layout fixes for widows, orphans, overfull boxes, trailing paragraphs, dense tables, captions, URLs, and artifact paths. Use when the user asks to prepare, review, polish, typeset, compile, or…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to fine-tune or distill a local open model on their Mac and see which training method actually moves a captured workload — "fine-tune a local model", "distill the frontier into a small model", "would training close the gap". Compares baseline, rejection-sampled fine-tuning, distillation, and…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use when a developer wants to cut Claude or Anthropic API spend: "lower my Anthropic bill", "audit my Claude spend", "find prompt cache failures", "why is cacheread zero", "can we move this from Claude to OpenAI or a local model". Audits call sites, tokenizer risk, cache structure, batchability, and route candidates…

understudylabs/understudy-agent-tools

Skill Claude CodeCodex

Use to acquire, cache, organize, and explain local open-weight models — "download a model", "what models do I have", "where did the weights go", "free up model disk", "which Gemma/Nemotron should I pull", "how do open models work". Covers where weights come from and live, formats/quantization, gated weights and HF…