workshop-nightly-pilot

workshop-nightly-pilot is a skill for Claude Code, Codex from microsoft/aibast-agents-library. It costs 69 tokens per session (2,743 once invoked), scanned A, original, MIT.

A repeatable test run for workshops in Copilot Studio, Microsoft's tool for building AI assistants. It builds each workshop agent, runs its demonstration prompts in the real product, captures screenshots, and records product bugs.

In plain words
What is it for?
Use it to re-test workshop solutions end to end, verify displayed results, correct screenshot annotations, and report reproducible problems.
Why use it?
It checks actual behaviour instead of relying only on existing screenshots or documentation.

Skill for Claude CodeCodex ✓ vendor

Written for no agent in particular: nothing here depends on one.

Good fit Use it to re-test workshop solutions end to end, verify displayed results, correct screenshot annotations, and report reproducible problems.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/microsoft/aibast-agents-library/workshop-nightly-pilot
About the project

AIBAST Agents Library is a collection of industry-focused AI agent templates accompanied by a local server that connects agents to GitHub Copilot for language-model inference. It helps developers create and run tool-using agents and isolated project environments, with an optional cloud-backed path for persistent memory. The catalogue entries provide the repository's agents, skills, commands, hooks, and instructions.

microsoft/aibast-agents-library · 7 stars · on GitHub

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add microsoft/aibast-agents-library --skill workshop-nightly-pilot
Clone the repo
git clone --depth 1 https://github.com/microsoft/aibast-agents-library

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for workshop-nightly-pilot

README.md
[![agentmods](https://agentmods.dev/badge/skills/microsoft/aibast-agents-library/workshop-nightly-pilot/github.svg)](https://agentmods.dev/skills/microsoft/aibast-agents-library/workshop-nightly-pilot)
Your own site
<a href="https://agentmods.dev/skills/microsoft/aibast-agents-library/workshop-nightly-pilot"><img src="https://agentmods.dev/badge/skills/microsoft/aibast-agents-library/workshop-nightly-pilot/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for workshop-nightly-pilot

Your own site · 80×15
<a href="https://agentmods.dev/skills/microsoft/aibast-agents-library/workshop-nightly-pilot"><img src="https://agentmods.dev/badge/skills/microsoft/aibast-agents-library/workshop-nightly-pilot.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 69 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,743 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00069 $0.02743
Opus 5 $0.00034 $0.01372
Sonnet 5 $0.00014 $0.00549
Haiku 4.5 $0.00007 $0.00274

Measured today against content hash bfc5263794c3, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-15, from the pricing page.

Security

Grade A, and why

workshop-nightly-pilot scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured today.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

solutions/_shared/workshop-nightly-pilot-skill.md · 174 lines

How it starts

The opening of the file, as written. The whole thing — 174 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Workshop Nightly Pilot

This is the repeatable runbook for testing an AIBAST workshop like a student, against the real product, not just reviewing existing screenshots. It was built by piloting solutions/account-intelligence end-to-end (see PR #206 and issue #204), which found a real, reproducible Copilot Studio bug (AI-02/AI-06 skipped knowledge retrieval on the first turn of a fresh chat, then passed on retry). Every subsequent solution should get the same treatment.

Why this exists: annotation-box QA (fixing misaligned green highlight boxes on existing screenshots) is a different, smaller job than this one. That pass was done across all 51 other solutions in PRs #207-#216 and only touched already-reusable screenshots. It never rebuilt an agent, never re-ran a demo prompt, and never caught a live product regression. This skill is what actually re-validates the product, not just the pictures of it.

Instructions for Copilot

Execute these steps autonomously. Pause only where marked ⏸.

Step 0: Load rotation state

Read solutions/_shared/pilot-rotation-state.json. It tracks, per solution: status (pending / piloted / no_checkpoints_file / blocked), reshoot_required_count at last scan, last_piloted date, environment_agent_name used, and issues_filed.

Pick the next batch to work (default default_batch_size_per_run from the state file, currently 2) using this order:

  1. status == "pending", highest reshoot_required_count first (biggest gaps get fixed sooner).
  2. Skip status == "no_checkpoints_file" entries -- flag them in your report but do not invent a checkpoints file from scratch; that's a separate authoring task, not a pilot.
  3. Once every pending entry has been piloted, reset the whole rotation: set every piloted entry back to pending (a fresh nightly regression pass), bump a full_cycles_completed counter at the top level, and start again from #1. This is what makes it a nightly loop instead of a one-time backlog burn-down.

Read the full file on GitHub · 174 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. today First seen · 174 lines · 69 tokens per session scan A bfc5263794c3

Subscribe to this mod's changes

workshop-nightly-pilot is a skill published in the GitHub repository microsoft/aibast-agents-library (7 stars, last pushed today), licensed MIT. It adds 69 tokens to every session and 2,743 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-15.

Related

Other skills, from other repositories

dogfood

Systematically explore and test a mobile app on iOS/Android with agent-device to find bugs, UX issues, and other problems. Use when asked to dogfood, QA, exploratory test, find issues, bug hunt, or test this app on mobile.

callstack/agent-device · 55 tokens

test-warp-ui

Guides testing Warp UI features and changes using the computer use tool. Use this skill only when computer-use testing was requested (explicit request or accepted offer) and the computeruse tool is available to the agent. Covers launching Warp and verifying UI behavior.

warpdotdev/warp · 55 tokens

test-electron-app

Drive the real running PostHog Electron app (live tRPC, workspace-server, real data) over CDP with agent-browser. Connect to the running app on port 9222, test desktop changes against a local Django stack, snapshot the accessibility tree, inspect network requests, and screenshot only when explicitly asked. Use when…

PostHog/posthog-foss · 112 tokens

pyats-dynamic-test

Generate and execute deterministic pyATS aetest validation scripts - interface state, OSPF neighbors, BGP paths, ping matrices, and custom compliance tests. Use when writing a network test, validating post-change state, running pass/fail checks, or building automated regression tests.

automateyournetwork/netclaw · 61 tokens

test-loop

Plan, generate, and heal an executable E2E test suite from approved acceptance criteria (web and mobile).

HoangNguyen0403/agent-skills-standard · 25 tokens

playwright-cli

Automates browser interactions for testing and validating your own web applications using playwright-cli. Use when you need terminal-first browser control for navigation, form filling, screenshots, tracing, bound browser sessions, debugging, or generating Playwright test code. Only use against applications you own or…

testdino-hq/playwright-skill · 64 tokens