agentmods.dev

aws-bench-datasets: Instructions file for Codex

AGENTS.md

aws-bench-datasets AGENTS.md is an instructions file for Codex, OpenCode from aws-bench/aws-bench-datasets. It costs 1,228 tokens per session, scanned A, original, Apache-2.0.

A contributor and coding-agent guide for aws-bench-datasets, a repository of benchmark tasks, cloud scenarios, test hooks, and reference solutions. It explains the repository layout and the contracts that published tasks and scenarios must follow.

In plain words
What is it for?
Use it when adding or changing benchmark tasks, AWS scenarios, lifecycle scripts, verifiers, or dataset metrics. It also helps locate the correct files and understand which tests and contracts apply.
Why use it?
It gives contributors one clear set of rules for structuring benchmark content and checking that it can run reliably. This reduces mistakes between task definitions, deployment scenarios, and verification code.

Instructions file for CodexOpenCode

Written for Codex and OpenCode: the file is AGENTS.md.

This is aws-bench/aws-bench-datasets's own configuration. It tells Codex and OpenCode how to work on aws-bench-datasets itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything aws-bench-datasets configures →

not rated 20repo yesterday A scan 1,228 tokens original Apache-2.0
View source ↗ aws-bench/aws-bench-datasets
Reuse

Borrowing it

Nothing to install: this file belongs to aws-bench/aws-bench-datasets. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/aws-bench/aws-bench-datasets/main/AGENTS.md
Clone the repo
git clone --depth 1 https://github.com/aws-bench/aws-bench-datasets

Made for: Codex, OpenCode.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for aws-bench-datasets AGENTS.md

README.md
[![agentmods](https://agentmods.dev/badge/instructions/aws-bench/aws-bench-datasets/agents-md/github.svg)](https://agentmods.dev/instructions/aws-bench/aws-bench-datasets/agents-md)
Your own site
<a href="https://agentmods.dev/instructions/aws-bench/aws-bench-datasets/agents-md"><img src="https://agentmods.dev/badge/instructions/aws-bench/aws-bench-datasets/agents-md/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for aws-bench-datasets AGENTS.md

Your own site · 80×15
<a href="https://agentmods.dev/instructions/aws-bench/aws-bench-datasets/agents-md"><img src="https://agentmods.dev/badge/instructions/aws-bench/aws-bench-datasets/agents-md.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 1,228 This file is loaded in full into every session.
When invoked 1,228 The same file — it is already loaded in full.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.01228 $0.01228
Opus 5.5 $0.00491 $0.00491
Sonnet 5.5 $0.00246 $0.00246
Haiku 4.5 $0.00123 $0.00123

Measured 2mo ago against content hash e0d7361713a2, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

aws-bench-datasets AGENTS.md scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

AGENTS.md · 80 lines

How it starts

The opening of the file, as written. The whole thing — 80 lines — stays where its author put it; the contents beside it link to each section on GitHub.

aws-bench-datasets contributor and agent guide

Purpose

aws-bench-datasets contains the benchmark content executed by the aws-bench framework: task prompts, verifiers, reference solutions, per-task lifecycle hooks, and containerized AWS scenarios. Framework orchestration belongs in the aws-bench repository.

This guide defines the technical contracts published tasks and scenarios must satisfy. If you're proposing or building a new one, start with CONTRIBUTING.md for the contribution process, then come back here for the contracts.

Repository layout

  • tasks/<scenario-id>/<task-name>/ — published task definitions.
  • scenarios/<scenario-id>/ — published scenario manifests (scenario.toml), the deployment container and CDK application (scenario/), and lifecycle scripts: deploy/ (required), plus optional reset/, verify/, and cleanup/.
  • shared/judge/ — canonical introspection-judge files copied into tasks.
  • shared/tasks/ — canonical helpers shared by task hook directories.
  • metric/ — dataset-level metric implementation.
  • test/ — repository-wide schema, consistency, and reentrancy tests.

Task contracts

Every published task must include task.toml, instruction.md, an environment/, and tests/test.sh; a solution/solve.sh reference solution is optional (the oracle agent uses it when present). The task's [scenario].scenario_id must match a directory under scenarios/.

  • Introspection tasks use metadata.request_type = "introspection", run the agent with an agent role that has a read-only policy (set via agent_role_name in task.toml), write a textual answer, and use tests/ground_truth.json with the shared judge.
  • Mutation tasks use metadata.request_type = "mutation", run the agent with an agent role that has a write-capable policy (set via agent_role_name in task.toml), write the documented structured output, and use tests/check.py to verify live AWS state.
  • Keep [concurrency].mode, the selected agent role, the instruction, the verifier, and the actual behavior of every lifecycle phase consistent. A task is read-only only when its pre-invoke, agent, verifier, and post-invoke behavior are all read-only.
  • Placeholders in instructions, verifier environments, and ground truth must resolve from scenario exports or the flat string map emitted by pre-invoke.
  • Pre-invoke must create /logs/pre_invoke/placeholder.json when it outputs placeholders.
  • Verifiers must create the Harbor reward output.
  • Post-invoke must be safe to retry and restore task-specific mutations.

Read the full file on GitHub · 80 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2mo ago First seen · 80 lines · 1,228 tokens per session scan A e0d7361713a2

Subscribe to this mod's changes

aws-bench-datasets AGENTS.md is an instructions file published in the GitHub repository aws-bench/aws-bench-datasets (20 stars, last pushed yesterday), licensed Apache-2.0. It adds 1,228 tokens to every session, about $0.0049 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

ai-agentsawsbenchmarkdataset
Related

aws-bench-datasets AGENTS.md compared with instructions from other repositories

aws-bench-datasets AGENTS.md next to 6 instructions from other repositories
ModTypeStarsLast pushLicenceScanTokensWorks with
aws-bench-datasets AGENTS.mdaws-bench/aws-bench-datasetsInstructions file20yesterdayApache-2.0A1,228Codex, OpenCode
vscode buildNext.instructions.mdmicrosoft/vscodeInstructions file195kyesterdayMITA9,719GitHub Copilot
next.js AGENTS.mdvercel/next.jsInstructions file143kyesterdayMITA7,461Codex, OpenCode
langchain AGENTS.mdlangchain-ai/langchainInstructions file149kyesterdayMITA4,680Codex, OpenCode
vscode oss-third-party-notices.instructions.mdmicrosoft/vscodeInstructions file195kyesterdayMITA5,516GitHub Copilot
vscode copilot-instructions.mdmicrosoft/vscodeInstructions file195kyesterdayMITA3,093GitHub Copilot
deepseek-harness AGENTS.mddeepseek-ai/deepseek-harnessInstructions file274k2d agoMITA4,313Codex, OpenCode