Scenarios and tasks for evaluating AI agents on real-world AWS automation tasks. Use the aws-bench framework (https://github.com/aws-bench/aws-bench) to provision isolated AWS environments, run agents, and evaluate their results.
Latest release v1.0.0 · 20 Oct 2026
2 files for Codex, OpenCode and Claude Code: aws-bench-datasets AGENTS.md, aws-bench-datasets CLAUDE.md — 1,233 tokens loaded in every session.
AGENTS.md A 1,228 tok CLAUDE.md A 5 tok These files are aws-bench/aws-bench-datasets's own configuration — they tell Codex, OpenCode and Claude Code how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.