harbor-framework/harbor

Framework for evaluating and improving agents

4.8kStars on the repository
12Mods indexed here, across every type
2d agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

bundled-keep

01

harbor-framework/harbor

Skill Claude CodeCodex

Existing task skill that should remain after job-level skill injection.

4.8k 2d ago A 17 tokens original Apache-2.0

runtime-proof

02

harbor-framework/harbor

Skill Claude CodeCodex

Write the proof file for the Harbor runtime skill injection example.

4.8k 2d ago A 15 tokens original Apache-2.0

create-adapter

04

harbor-framework/harbor

Skill Claude CodeCodex

Scaffold a new Harbor benchmark adapter by running harbor adapter init and then guide implementation using the Adapters Agent Guide as the authoritative spec.

4.8k 2d ago A 34 tokens original Apache-2.0

create-task

05

harbor-framework/harbor

Skill Claude CodeCodex

Create a new Harbor task for evaluating agents. Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval. Guides through instruction writing, environment setup, verifier design (pytest vs Reward Kit vs custom), and solution scripting.

4.8k 2d ago F 56 tokens original Apache-2.0

harbor-exec

06

harbor-framework/harbor

Skill Claude CodeCodex

Use when working with Harbor's harbor exec CLI workflow: compiling files, directories, or globs into Harbor tasks; running map jobs; configuring artifacts and existence-only verification; using map-reduce; writing or reviewing ExecConfig YAML/JSON/TOML; or debugging command behavior, config validation, and job outputs.

4.8k 2d ago A 71 tokens original Apache-2.0

publish

07

harbor-framework/harbor

Skill Claude CodeCodex

Publish a Harbor task or dataset to the registry. Use when the user wants to upload, publish, or share tasks or datasets/benchmarks on the Harbor registry.

4.8k 2d ago A 35 tokens original Apache-2.0

rewardkit

08

harbor-framework/harbor

Skill Claude CodeCodex

Write Harbor task verifiers using Reward Kit. Use when creating or editing a task's tests/ directory, adding grading criteria, setting up LLM/agent judges, or designing verifiers that produce a reward score.

4.8k 2d ago A 46 tokens original Apache-2.0

harbor-framework/harbor

Skill Claude CodeCodex

Create or reuse Hugging Face dataset PRs for harborframework/parity-experiments and upload Harbor parity/oracle result folders efficiently with sparse checkout, raw git pushes, and Git LFS.

4.8k 2d ago A 49 tokens original Apache-2.0