pku-liang/hwe-bench

Benchmarking LLM agents on real-world hardware bug repair tasks

52Stars on the repository
10Mods indexed here, across every type
1mo agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

bundled-keep

01

pku-liang/hwe-bench

Skill Claude CodeCodex

Existing task skill that should remain after job-level skill injection.

not rated 52 +2 1mo ago A 17 tokens copy · 100% Apache-2.0

runtime-proof

02

pku-liang/hwe-bench

Skill Claude CodeCodex

Write the proof file for the Harbor runtime skill injection example.

not rated 52 +2 1mo ago A 15 tokens copy · 100% Apache-2.0

generate-greeting

03

pku-liang/hwe-bench

Skill Claude CodeCodex

Generate a greeting message and write it to a file.

not rated 52 +2 1mo ago A 15 tokens copy · 100% Apache-2.0

create-adapter

04

pku-liang/hwe-bench

Skill Claude CodeCodex

Scaffold a new Harbor benchmark adapter by running harbor adapter init and then guide implementation using the Adapters Agent Guide as the authoritative spec.

not rated 52 +2 1mo ago A 34 tokens copy · 100% Apache-2.0

create-task

05

pku-liang/hwe-bench

Skill Claude Code

Create a new Harbor task for evaluating agents. Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval. Guides through instruction writing, environment setup, verifier design (pytest vs Reward Kit vs custom), and solution scripting.

not rated 52 +2 1mo ago F 56 tokens copy · 100% Apache-2.0

harbor-exec

06

pku-liang/hwe-bench

Skill Claude CodeCodex

Use when working with Harbor's harbor exec CLI workflow: compiling files, directories, or globs into Harbor tasks; running map jobs; configuring artifacts and existence-only verification; using map-reduce; writing or reviewing ExecConfig YAML/JSON/TOML; or debugging command behavior, config validation, and job outputs.

not rated 52 +2 1mo ago A 71 tokens copy · 100% Apache-2.0

publish

07

pku-liang/hwe-bench

Skill Claude Code

Publish a Harbor task or dataset to the registry. Use when the user wants to upload, publish, or share tasks or datasets/benchmarks on the Harbor registry.

not rated 52 +2 1mo ago A 35 tokens copy · 95% Apache-2.0

rewardkit

08

pku-liang/hwe-bench

Skill Claude CodeCodex

Write Harbor task verifiers using Reward Kit. Use when creating or editing a task's tests/ directory, adding grading criteria, setting up LLM/agent judges, or designing verifiers that produce a reward score.

not rated 52 +2 1mo ago A 46 tokens copy · 91% Apache-2.0

pku-liang/hwe-bench

Skill Claude CodeCodex

Create or reuse Hugging Face dataset PRs for harborframework/parity-experiments and upload Harbor parity/oracle result folders efficiently with sparse checkout, raw git pushes, and Git LFS.

not rated 52 +2 1mo ago A 49 tokens copy · 100% Apache-2.0

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: