microsoft/eval-guide

A plugin for AI agent evaluation. Plan evals, generate test cases, interpret results for Copilot Studio agents. Grounded in Microsoft's Eval Scenario Library & Triage Playbook.

About the project

eval-guide is an AI agent evaluation toolkit for Copilot Studio that helps users plan evaluations, create test cases, interpret results, and diagnose failures. It is used with Claude Code or GitHub Copilot to assess single-response and multi-turn agent behavior using Microsoft’s evaluation guidance.

This repository also configures its own agents. See what eval-guide tells them →

140Stars on the repository
10Mods indexed here, across every type
4mo agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown

eval-guide

01

microsoft/eval-guide

Plugin Claude Code ✓ vendor

Bundles 6 skills · 569 tokens together

AI agent evaluation toolkit for Copilot Studio. Plan evals, generate test cases, interpret results, and triage failures — grounded in Microsoft's Eval Scenario Library and Triage & Improvement Playbook.

not rated 140 +1 4mo ago A tokens not measured original MIT