microsoft/a11y-llm-eval

An eval tool to benchmark how well LLMs generate accessible HTML

About the project

A11y LLM Evaluation Harness and Dataset is a test suite for measuring how well language models generate accessible HTML. It runs agent-generated pages in a browser and evaluates them with automated accessibility checks.

This repository also configures its own agents. See what a11y-llm-eval tells them →

Open on GitHub microsoft.github.io

62Stars on the repository

3Mods indexed here, across every type

5mo agoLast push, which is what freshness is scored on

MITLicence, which decides whether bodies are shown

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 1 mods

building-accessible-ui

microsoft/a11y-llm-eval

Skill Claude CodeCodex ✓ vendor

MUST BE USED for any UI work. Invoke this skill before generating, modifying, or reviewing any code that renders, styles, or wires up a user-facing interface — including markup, components, templates, styles, and the JavaScript/TypeScript that drives them. This skill encodes the accessibility (WCAG 2.2 AA)…

not rated 62 +1 5mo ago A 112 tokens original MIT