Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.
GoogleCloudPlatform/professional-services
Skill Claude CodeCodex
This skill should be used when the user wants to evaluate an AI agent end-to-end: scaffold an evaluation, design metrics that test a real hypothesis, make an agent measurable, audit generated eval config, read evaluation results, or run an improvement ("hill climbing") loop. Covers evaluation methodology, metric…
GoogleCloudPlatform/professional-services
Skill Claude CodeCodex
Executes high-performance agent evaluations, multi-turn UserSim simulations, and declarative metric grading aligned with google/agents-cli and the Quality Flywheel. Publishes benchmark artifacts to the GCS Evaluation Registry, executes automated head-to-head delta comparisons (--compare-to), and optimizes system…
GoogleCloudPlatform/professional-services
Skill Claude CodeCodex
Performs an exhaustive, question-by-question narrative diagnostic breakdown of an agent-eval benchmark run by analyzing questionanswerlog.md, evalsummary.json, and raw trajectory traces. Use when diagnosing low score causes, investigating the Memory Reuse vs. Traceability rubric clash, performing pre-release failure…