Scenarios and tasks for evaluating AI agents on real-world AWS automation tasks. Use the aws-bench framework (https://github.com/aws-bench/aws-bench) to provision isolated AWS environments, run agents, and evaluate their results.
Instructions file CodexOpenCode
Instructions for aws-bench/aws-bench-datasets, covering aws-bench-datasets contributor and agent guide, purpose, repository layout, task contracts and scenario contracts.
Instructions file
Instructions for aws-bench/aws-bench-datasets, a project described as: Scenarios and tasks for evaluating AI agents on real-world AWS automation tasks. Use the aws-bench framework (https://github.com/aws-bench/aws-bench) to provision isolated AWS environments, run agents, and evaluate their results.