agent-eval-canvas

agent-eval-canvas is a skill for Claude Code, Codex from GCWing/BitFun. It costs 82 tokens per session (1,965 once invoked), scanned A, original, MIT.

A report-building tool for examining one software-agent run from start to finish. It records what the agent did, which step affected the result, why it succeeded or failed, and what should change.

In plain words
What is it for?
Use it to analyze one evaluation case, including its request, expected and actual results, timeline, tool calls, errors, evidence, score, and cost.
Why use it?
It turns a complicated run history into a clear incident review instead of leaving the cause buried in tool calls and logs.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to analyze one evaluation case, including its request, expected and actual results, timeline, tool calls, errors, evidence, score, and cost.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/gcwing/bitfun/agent-eval-canvas
About the project

BitFun is a desktop AI agent that turns tasks into interactive mini-apps while also writing code, creating documents, and controlling computers. It is for software development and general desktop work across Windows, macOS, and Linux. Its catalogue entries extend the agent with skills, agents, and instructions.

GCWing/BitFun · 2,077 stars · on GitHub

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add GCWing/BitFun --skill agent-eval-canvas
Clone the repo
git clone --depth 1 https://github.com/GCWing/BitFun

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for agent-eval-canvas

README.md
[![agentmods](https://agentmods.dev/badge/skills/gcwing/bitfun/agent-eval-canvas/github.svg)](https://agentmods.dev/skills/gcwing/bitfun/agent-eval-canvas)
Your own site
<a href="https://agentmods.dev/skills/gcwing/bitfun/agent-eval-canvas"><img src="https://agentmods.dev/badge/skills/gcwing/bitfun/agent-eval-canvas/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for agent-eval-canvas

Your own site · 80×15
<a href="https://agentmods.dev/skills/gcwing/bitfun/agent-eval-canvas"><img src="https://agentmods.dev/badge/skills/gcwing/bitfun/agent-eval-canvas.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 82 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,965 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 1 finding, up to high

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • high Privilege Escalation · line 83
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00082 $0.01965
Opus 5.5 $0.00033 $0.00786
Sonnet 5.5 $0.00016 $0.00393
Haiku 4.5 $0.00008 $0.00197

Measured 1mo ago against content hash 4d8998ffa2a1, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

agent-eval-canvas scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

src/crates/assembly/core/builtin_skills/agent-eval-canvas/SKILL.md · 219 lines

How it starts

The opening of the file, as written. The whole thing — 219 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Agent Eval Canvas

Use this skill to produce a session-scoped OpenBitFun Canvas for a single agent case. The report should read like an incident review or clinical diagnosis, not like an aggregate benchmark summary. Its job is to explain what happened in one run, which step determined success or failure, why, and what to fix next.

Read and follow openbitfun-canvas first. It defines the Canvas tool workflow, source rules, SDK surface, design constraints, and final response requirements.

Inputs

Gather the case evidence before writing TSX:

  • Case ID, task type, original user request, expected result, actual result, final verdict, score, model, prompt version, tools, max steps, timeout, and environment facts when available.
  • Full or summarized trajectory: LLM calls, tool calls, handoffs, guardrail events, custom events, observations, retries, and final answer.
  • Tool call details: tool name, call timing, arguments, raw or summarized result, error state, whether the result was used, and recovery behavior.
  • Evidence artifacts: files, retrieved sources, code snippets, tables, judge output, screenshots, or execution logs that support the verdict.
  • Cost facts: total latency, steps, LLM calls, tool calls, tokens, repeated calls, invalid steps, budget/timeout status.
  • Safety facts: risky commands, permission prompts, sensitive data, production side effects, prompt injection exposure, and guardrail behavior.

If the trace or expected result is missing, ask for it unless the user clearly wants a best-effort report from partial evidence. In a best-effort report, mark unsupported fields as unavailable and keep root-cause claims conservative.

Canvas Structure

Lead with diagnosis, then evidence. The first screen should answer: did the case pass, what was the decisive step, and what should change next.

  1. Case header: Case ID, task type, verdict, score, run configuration, and a one-sentence conclusion.
  2. Diagnostic summary: final outcome, critical failure or success step, primary root cause, downstream propagation, confidence, and top repair.
  3. Trajectory timeline: compact step table or swimlane showing behavior type, agent action, input/observation, reasonableness, tag, and issue.
  4. Step-level evaluation: per-step cards or rows with labels: OK, WARN, ERROR, ROOT_CAUSE, and PROPAGATED.
  5. Critical step deep dive: why this step changed the run, what evidence proves it, why later errors are downstream, and what should have happened.
  6. Root cause and propagation: category breakdown plus a clear chain from first error to final result.
  7. Tool and evidence analysis: tool choice, parameters, results, result use, recovery behavior, unsupported claims, stale evidence, and source fit.
  8. Cost, efficiency, and safety: latency, tokens, duplicate work, invalid steps, risky actions, sensitive data, and confirmation/guardrail handling.
  9. Repair plan and regression: fixes grouped by Prompt, Planner, Tool schema, Tool result, Memory/RAG, Runtime, Evaluator, and Guardrail; include next-run pass criteria and steps to watch.

Read the full file on GitHub · 219 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago Changed · +1 lines · +1 tokens per session 4d8998ffa2a1
  2. 2mo ago First seen · 218 lines · 81 tokens per session scan A a770fd1c9e47

Subscribe to this mod's changes

agent-eval-canvas is a skill published in the GitHub repository GCWing/BitFun (2,077 stars, last pushed 1mo ago), licensed MIT. It adds 82 tokens to every session and 1,965 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

worker-management

Use when admin requests hand-creating or resetting a Worker, starting/stopping a Worker, managing Worker skills, enabling peer mentions, or opening a QwenPaw console. Use agentteams-find-worker only as a helper for Nacos-backed market import or when task assignment needs you to discover a suitable Worker.

agentscope-ai/AgentTeams · 65 tokens

git-delegation

A procedure for sending Git version-control commands to a separate Manager instead of running them directly. Git is the tool used to track code changes and work with repositories.

agentscope-ai/AgentTeams · 51 tokens

github-operations

A tool for managing GitHub pull requests and issues. Pull requests are proposed code changes for review, while issues are GitHub's way to track bugs, tasks, and questions.

agentscope-ai/AgentTeams · 50 tokens

agentteams-migrate

Analyze current OpenClaw setup and generate a migration package (ZIP) for importing into AgentTeams as a managed Worker.

agentscope-ai/AgentTeams · 28 tokens

teamharness-task-delegation

Use when you act as Leader to turn ready Quick Task or Project Work state into Worker task instructions, send assignment messages, check submitted results, and define completion/blocker report contracts. Do not use to create projects, create rooms, or execute Worker tasks.

agentscope-ai/AgentTeams · 59 tokens

teamharness-task-execution

Use when you act as Worker: receive TASKASSIGNED, acknowledge the task, work inside shared/tasks/{task-id}/, submit with taskflow submittask, publish deliverables through submittask, and report TASKCOMPLETED or blockers in the Task room.

agentscope-ai/AgentTeams · 58 tokens