shinpr/rashomon

Measure prompt and skill improvements with blind A/B comparison.

18Stars on the repository
13Mods indexed here, across every type
2d agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown

knowledge-optimizer

01

shinpr/rashomon

Agent

Collects user feedback on comparison results and optimizes the knowledge base. Use when user indicates comparison results did not meet expectations or provides feedback on optimization quality. Adjusts confidence scores and manages knowledge entries.

18 2d ago A 44 tokens original MIT

prompt-analyzer

02

shinpr/rashomon

Agent

Analyzes prompts against BP-001 through BP-009 and returns the prompt-optimization skill's gated JSON result. Use when prompt text or a prompt file is provided for optimization.

18 2d ago A 40 tokens original MIT

prompt-executor

03

shinpr/rashomon

Agent

Executes a prompt in an isolated worktree environment and captures results. Use when worktree path and prompt are provided for execution. Returns execution status, outputs, and observations with strictly factual reporting only.

18 2d ago A 44 tokens original MIT

report-generator

04

shinpr/rashomon

Agent

Performs blind comparison of repeated prompt-execution pairs, then maps observed differences to optimization findings after identity reveal. Use when original and optimized prompt trials are available.

18 2d ago A 35 tokens original MIT

skill-creator

05

shinpr/rashomon

Agent

Generates or modifies optimized skill files. In creation mode, builds from raw user knowledge. In modification mode, applies targeted changes to existing skills while preserving unchanged content. Use when creating new skills or updating existing ones.

18 2d ago A 47 tokens original MIT

skill-eval-reporter

06

shinpr/rashomon

Agent

Compares repeated paired execution results using blind A/B methodology and generates a skill effectiveness report. Use when valid skill-evaluation result pairs are available.

18 2d ago A 35 tokens original MIT

skill-reviewer

07

shinpr/rashomon

Agent

Evaluates skill file quality against optimization patterns and editing principles. Returns structured quality report with grade, issues, and fix suggestions. Use when reviewing created or modified skill content.

18 2d ago A 38 tokens original MIT