noctrace: Skill for Claude Code

.claude/skills/auto-scan/SKILL.md

auto-scan is a skill for Claude Code from nyktora/noctrace. It costs 124 tokens per session (1,929 once invoked), scanned A, original, MIT.

A research helper that checks releases from Claude Code, GitHub Copilot, Codex CLI, and competing tools for new observability-related changes.

In plain words
What is it for?
Use it to run provider, competitor, feature, or release scans and identify changes that may affect noctrace, an open-source tool for inspecting AI coding-agent activity.
Why use it?
It removes the need to track several products and release notes manually. It turns those findings into a ranked list of possible improvements with effort estimates.

Skill for Claude Code

Written for Claude Code: installed under .claude/. Also seen: mentions CLAUDE.md; mentions subagents; mentions Claude Code.

This is nyktora/noctrace's own configuration. It tells Claude Code how to work on noctrace itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything noctrace configures →

Part of the noctrace plugin — 5 skills, 4 agents, 1 MCP server shipped together

Reuse

Borrowing it

Nothing to install: this file belongs to nyktora/noctrace. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/nyktora/noctrace/main/.claude/skills/auto-scan/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/nyktora/noctrace

Made for: Claude Code.

Or install noctrace, the plugin that ships this one along with the rest of its 5 skills, 4 agents, 1 MCP server.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for auto-scan

README.md
[![agentmods](https://agentmods.dev/badge/skills/nyktora/noctrace/auto-scan.svg)](https://agentmods.dev/skills/nyktora/noctrace/auto-scan)
Your own site
<a href="https://agentmods.dev/skills/nyktora/noctrace/auto-scan"><img src="https://agentmods.dev/badge/skills/nyktora/noctrace/auto-scan.svg" alt="Measured on agentmods" height="20"></a>
Per session 124 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,929 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00124 $0.01929
Opus 5 $0.00062 $0.00964
Sonnet 5 $0.00025 $0.00386
Haiku 4.5 $0.00012 $0.00193

Measured 8d ago against content hash d602f377006b, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-08, from the pricing page.

Security

Grade A, and why

auto-scan scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/auto-scan/SKILL.md · 202 lines

How it starts

The opening of the file, as written. The whole thing — 202 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Auto-Scan: Provider & Competitor Intelligence

You are a product intelligence analyst for noctrace, an open-source multi-provider AI coding agent observability tool. Your job is to scan upstream providers and competitor tools, then produce an actionable feature list.

Noctrace currently supports: Claude Code, OpenAI Codex CLI, and GitHub Copilot Chat.

When to run

  • On demand when the user invokes /auto-scan
  • Proactively when starting a session if the last scan in docs/research/ is older than 7 days

Scan targets

Upstream providers (what they ship = what we can observe)

Provider What to search for Why it matters
Claude Code Changelog, new JSONL record types, new hook events, new tools, OTel changes, new agent features New records = new waterfall rows. New hooks = new real-time events.
GitHub Copilot VS Code Copilot Chat updates, agent mode changes, new tool IDs, session file format changes, OTel support New tool IDs need mapping. Format changes can break the parser.
Codex CLI GitHub releases, new JSONL event types, new tools, session format changes Same as Claude Code but for the Codex provider.

Competitors (what they build = what users expect)

Competitor URL / search term What to look for
claude-devtools github.com/matt1398/claude-devtools Context forensics, subagent trees, notification triggers
Cogpit cogpit.dev or search "cogpit claude code" Desktop app features, real-time dashboard, file attention
Agent Watch agent-watch.com Multi-agent monitoring, remote control, team-wide dashboards
ccusage github.com/ryoppippi/ccusage Cost tracking, session reports, Codex support
claude-code-viewer github.com/d-kimuson/claude-code-viewer Web client, interactive sessions, project management
Simon Willison Timeline tools.simonwillison.net/claude-code-timeline Timeline visualization, UI innovations
Datadog/Dynatrace/SigNoz Search "[platform] claude code monitoring" Enterprise observability features noctrace could do locally

Read the full file on GitHub · 202 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 202 lines · 124 tokens per session scan A d602f377006b

Subscribe to this mod's changes

auto-scan is a skill published in the GitHub repository nyktora/noctrace (5 stars, last pushed 4mo ago), licensed MIT. It adds 124 tokens to every session and 1,929 once invoked, about $0.0006 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

langsmith-observability

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

davila7/claude-code-templates · 45 tokens

phoenix-observability

Open-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations on datasets, or monitoring production AI systems with real-time insights.

davila7/claude-code-templates · 47 tokens

agent-inspect

Local evidence debugger and trajectory-test toolkit for TypeScript AI agents. Use when capturing framework-faithful traces, asserting TraceContract/TraceFacts, packaging Evidence v2, or inspecting local runs over read-only MCP (gettracefacts).

rajudandigam/agent-inspect · 52 tokens

sre-expert

Expert-level site reliability engineering, SLOs, incident management, and operational excellence. Use when the user mentions reliability, monitoring, incident management, SLOs, or observability, or when the task involves SRE Fundamentals, Reliability Practices, SRE Principles, or On-Call.

personamanagmentlayer/pcl · 63 tokens

debugging-workflow

Find the cause of a defect by hypothesis and bisection rather than by guessing, then fix it behind a regression test. Use when the user reports a bug, a crash, a test that fails intermittently, a performance regression or a production incident, asks why code behaves unexpectedly, or when the task involves reproducing…

personamanagmentlayer/pcl · 91 tokens

linkerd-expert

Expert-level Linkerd service mesh management, traffic control, reliability, and production operations. Use when the user mentions service mesh, Kubernetes, microservices, mTLS, or observability, or when the task involves Linkerd Architecture, Mesh Injection, Traffic Management, or Reliability Features.

personamanagmentlayer/pcl · 61 tokens