eval-code

eval-code is a skill for Claude Code, Codex from ZTE-AICloud/Co-OmniSpec. It costs 61 tokens per session (1,430 once invoked), scanned A, original, MIT.

A complete evaluation workflow that collects code changes from an SDD feature branch and sends them to a third-party model for quality assessment. SDD is a process for developing software from written specifications.

In plain words
What is it for?
Use it to produce an evaluation report for a feature branch, including its code changes and the model's quality assessment.
Why use it?
It removes the need to gather changed files and run separate evaluation steps by hand.

Skill for Claude CodeCodex

Installs and runs on its own, but its text points at files inside its plugin — anything it tells you to read at a ${CLAUDE_PLUGIN_ROOT} path is only there once the plugin is installed. Installing the plugin gets both.

Part of the omni-dsdd plugin — 40 skills, 16 agents, 1 hook shipped together

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/zte-aicloud/co-omnispec/eval-code
Any agent
npx skills add ZTE-AICloud/Co-OmniSpec --skill eval-code
Clone the repo
git clone --depth 1 https://github.com/ZTE-AICloud/Co-OmniSpec

Made for: Claude Code, Codex.

Or install omni-dsdd, the plugin that ships this one along with the rest of its 40 skills, 16 agents, 1 hook.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for eval-code

README.md
[![agentmods](https://agentmods.dev/badge/skills/zte-aicloud/co-omnispec/eval-code.svg)](https://agentmods.dev/skills/zte-aicloud/co-omnispec/eval-code)
Your own site
<a href="https://agentmods.dev/skills/zte-aicloud/co-omnispec/eval-code"><img src="https://agentmods.dev/badge/skills/zte-aicloud/co-omnispec/eval-code.svg" alt="Measured on agentmods" height="20"></a>
Per session 61 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,430 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00061 $0.01430
Opus 5 $0.00030 $0.00715
Sonnet 5 $0.00012 $0.00286
Haiku 4.5 $0.00006 $0.00143

Measured 4d ago against content hash 83866a6cda0d, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

eval-code scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.

The scan reads SKILL.md. This mod also ships 1 executable file (scripts/main.py), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

omni-dsdd/skills/eval-code/SKILL.md · 192 lines

How it starts

The opening of the file, as written. The whole thing — 192 lines — stays where its author put it; the contents beside it link to each section on GitHub.

OmniEval 综合代码评测技能

本技能整合了代码变更采集和第三方模型评测功能,提供完整的 SDD 流程代码质量评估。

环境初始化

变量 含义
CLAUDE_PLUGIN_ROOT 插件根目录
CLAUDE_WORKING_DIR Git 工作区根
FEATURE_DIR 当前特性目录
test -n "${CLAUDE_PLUGIN_ROOT:-}" && test -d "${CLAUDE_PLUGIN_ROOT}"
test -n "${CLAUDE_WORKING_DIR:-}" && test -d "${CLAUDE_WORKING_DIR}"

缺失时:export CLAUDE_WORKING_DIR="$(pwd)"不用 git rev-parse --show-toplevel)。

推荐source "${FEATURE_DIR}/.runs/env.sh"

路径约定

产物 路径
采集 JSON ${FEATURE_DIR}/.runs/evaluations/code.diff.json
评测报告 ${FEATURE_DIR}/.runs/evaluations/eval-code-report.txt

功能说明

  1. 代码变更采集:从当前 SDD 分支采集代码变更信息,生成评测所需的 JSON 文件
  2. 自动评测:使用第三方评测模型对生成的代码进行质量评估
  3. 结果输出:将评测结果同时输出到控制台和文件

技能依赖

本技能会调用以下技能:

  • /eval-code-collector: 采集 SDD 流程的代码变更信息
  • /eval-code-evaluator: 使用第三方评测模型对代码质量进行评估

执行流程

阶段 1:代码变更采集

加载 skill eval-code-collector,或执行:

python3 "${CLAUDE_PLUGIN_ROOT}/skills/eval-code-collector/scripts/collect.py" \
  --working-dir "${CLAUDE_WORKING_DIR}" \
  ${FEATURE_DIR:+--feature-dir "${FEATURE_DIR}"} \
  --target-dir "<目标代码目录>"

阶段 2:代码质量评测

加载 skill eval-code-evaluator,或执行:

python3 "${CLAUDE_PLUGIN_ROOT}/skills/eval-code-evaluator/scripts/evaluate_code.py" \
  --config "${FEATURE_DIR}/.runs/evaluations/code.diff.json" \
  --output "${FEATURE_DIR}/.runs/evaluations/eval-code-report.txt"

输入参数

自动检测当前项目的主要代码目录:

  • 优先级顺序: 当前目录
  • 用户可以通过参数指定特定目录来覆盖自动检测
  • 评测模型:使用配置文件中指定的模型(默认 glm4.6)

输出

  1. 控制台输出:显示评测进度和最终结果
  2. 文件输出${FEATURE_DIR}/.runs/evaluations/eval-code-report.txt - 包含详细的评测报告

评测指标

ICE Score 组件

  • 功能正确性 (0-1):代码是否正确实现了需求
  • 实用性 (0-1):代码是否实用且结构良好

Code Judge 组件

  • 评分 (0-1):代码一致性和整体质量
  • 不一致问题:发现的问题列表
    • 严重级别:Small, Major, Fatal
  • 问题数量:发现的问题总数

综合指标

  • 平均 LLM 评测指标:所有指标的综合得分

使用示例

基础用法

/eval-code

执行步骤:

  1. 自动检测并采集当前项目的主要代码目录变更
  2. 自动进行代码质量评测
  3. 输出评测结果到控制台和文件

指定目录

Read the full file on GitHub · 192 lines

Files

What ships with it

2 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 4d ago First seen · 192 lines · 61 tokens per session scan A 83866a6cda0d

Subscribe to this mod's changes

eval-code is a skill published in the GitHub repository ZTE-AICloud/Co-OmniSpec (54 stars, last pushed 1mo ago), licensed MIT. It adds 61 tokens to every session and 1,430 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

systematic-debugging

Use when encountering any bug, test failure, or unexpected behavior, before proposing fixes.

obra/superpowers · 21 tokens

brainstorming

You MUST use this before any creative work - creating features, building components, adding functionality, or modifying behavior. Explores user intent, requirements and design before implementation.

obra/superpowers · 37 tokens

auto-perf-optimize

Run agent-driven VS Code performance or memory investigations. Use when asked to launch Code OSS, automate a VS Code scenario, run the Chat memory smoke runner, capture renderer heap snapshots, take workflow screenshots, compare run summaries, or drive a repeatable scenario before heap-snapshot analysis.

microsoft/vscode · 62 tokens

chat-perf

Run chat perf benchmarks and memory leak checks against the local dev build or any published VS Code version. Use when investigating chat rendering regressions, validating perf-sensitive changes to chat UI, or checking for memory leaks in the chat response pipeline.

microsoft/vscode · 51 tokens

chat-pet-sprite-creation

Use when creating or changing VS Code chat pet sprite art, sprite sheets, state animations, eye treatments, Stable/Insiders variants, or pet transitions under src/vs/workbench/contrib/chat/browser/widget/media/chatPet.

microsoft/vscode · 53 tokens

cpu-profile-analysis

Analyze V8/Chrome CPU profiles (.cpuprofile) and DevTools trace files (Trace-.json). Use when: profiling performance, investigating slow functions, comparing code paths, finding bottlenecks, analyzing timeToRequest, understanding call trees from sampling profiler data, analyzing layout/paint/rendering, investigating…

microsoft/vscode · 71 tokens