arize-prompt-optimization

arize-prompt-optimization is a skill for Claude Code, Codex from boshi-xixixi/TraeSkill. It costs 73 tokens per session (4,440 once invoked), scanned A, original, MIT.

A data-driven workflow for improving or debugging prompts used by language-model applications, using production traces, evaluations, and annotations.

In plain words
What is it for?
Use it to find prompts in application trace data, collect evaluation signals, and optimize prompt quality based on recorded results.
Why use it?
It helps connect prompt changes to observed model performance instead of relying only on guesswork.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one. Also seen: installed under .agents/ (shared by several agents).

Good fit Use it to find prompts in application trace data, collect evaluation signals…

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/boshi-xixixi/traeskill/arize-prompt-optimization
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add boshi-xixixi/TraeSkill --skill arize-prompt-optimization
Clone the repo
git clone --depth 1 https://github.com/boshi-xixixi/TraeSkill

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for arize-prompt-optimization

README.md
[![agentmods](https://agentmods.dev/badge/skills/boshi-xixixi/traeskill/arize-prompt-optimization.svg)](https://agentmods.dev/skills/boshi-xixixi/traeskill/arize-prompt-optimization)
Your own site
<a href="https://agentmods.dev/skills/boshi-xixixi/traeskill/arize-prompt-optimization"><img src="https://agentmods.dev/badge/skills/boshi-xixixi/traeskill/arize-prompt-optimization.svg" alt="Measured on agentmods" height="20"></a>
Per session 73 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 4,440 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00073 $0.04440
Opus 5 $0.00036 $0.02220
Sonnet 5 $0.00015 $0.00888
Haiku 4.5 $0.00007 $0.00444

Measured 7d ago against content hash 22554535b853, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-06, from the pricing page.

Security

Grade A, and why

arize-prompt-optimization scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

Copies of this mod

3 near-identical copies found in the catalogue:

.trae/Skills/.agents/skills/arize-prompt-optimization/SKILL.md · 454 lines

How it starts

The opening of the file, as written. The whole thing — 454 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Arize Prompt Optimization Skill

SPACE — All --space flags and the ARIZE_SPACE env var accept a space name (e.g., my-workspace) or a base64 space ID (e.g., U3BhY2U6...). Find yours with ax spaces list.

Concepts

Where Prompts Live in Trace Data

LLM applications emit spans following OpenInference semantic conventions. Prompts are stored in different span attributes depending on the span kind and instrumentation:

Column What it contains When to use
attributes.llm.input_messages Structured chat messages (system, user, assistant, tool) in role-based format Primary source for chat-based LLM prompts
attributes.llm.input_messages.roles Array of roles: system, user, assistant, tool Extract individual message roles
attributes.llm.input_messages.contents Array of message content strings Extract message text
attributes.input.value Serialized prompt or user question (generic, all span kinds) Fallback when structured messages are not available
attributes.llm.prompt_template.template Template with {variable} placeholders (e.g., "Answer {question} using {context}") When the app uses prompt templates
attributes.llm.prompt_template.variables Template variable values (JSON object) See what values were substituted into the template
attributes.output.value Model response text See what the LLM produced
attributes.llm.output_messages Structured model output (including tool calls) Inspect tool-calling responses

Finding Prompts by Span Kind

  • LLM span (attributes.openinference.span.kind = 'LLM'): Check attributes.llm.input_messages for structured chat messages, OR attributes.input.value for a serialized prompt. Check attributes.llm.prompt_template.template for the template.
  • Chain/Agent span: attributes.input.value contains the user's question. The actual LLM prompt lives on child LLM spans -- navigate down the trace tree.
  • Tool span: attributes.input.value has tool input, attributes.output.value has tool result. Not typically where prompts live.

Read the full file on GitHub · 454 lines

Files

What ships with it

2 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 454 lines · 73 tokens per session scan A 22554535b853

Subscribe to this mod's changes

arize-prompt-optimization is a skill published in the GitHub repository boshi-xixixi/TraeSkill (261 stars, last pushed 3mo ago), licensed MIT. It adds 73 tokens to every session and 4,440 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

ai-debugging-tools

Create debugging tools for AI behavior visualization and analysis.

LgrappaG/Workflows-Agents · 14 tokens

debugging

A systematic method for finding the underlying cause of a software bug by observing the failure, forming a hypothesis, and testing it.

Lion-1209/Lion-Skills · 24 tokens

error-handling

A guide to handling failures and recording useful logs in software. It explains when to pass an error upward, recover, reduce functionality, or retry temporary failures.

Lion-1209/Lion-Skills · 14 tokens

notebooklm

Install, authenticate, troubleshoot, and operate Gemini Notebook through the notebooklm-py CLI or typed async Python API. Use for notebook and source management, grounded chat and research, and artifact generation or download when the user mentions Gemini Notebook, notebooklm-py, the notebooklm CLI, or its Python API.…

teng-lin/notebooklm-py · 79 tokens

bug-investigator

Use when encountering any bug, test failure, or unexpected behavior during spec-superflow execution, before proposing fixes. Invoked automatically when build-executor hits a blockage.

MageByte-Zero/spec-superflow · 37 tokens

azure-data-factory

Expert knowledge for Azure Data Factory development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when building ADF pipelines with IR/SSIS, triggers, data flows, SAP/SaaS…

MicrosoftDocs/Agent-Skills · 126 tokens