prompt-optimizer

Prompt Optimizer — Core Skill

AuthorAgent's prompts are its most important tool. This skill continuously optimizes them based on what actually produces good results — not guesswork, but measured outcomes.

The Problem

Every skill, goal step, and system prompt contains prompts. Some work great. Some produce mediocre results. Without measurement, you're flying blind. The Prompt Optimizer tracks which prompt formulations produce the best outputs and evolves them over time.

How It Works

Prompt Tracking

Every prompt sent to an AI provider is logged with its outcome:

{
  "promptId": "p-347",
  "timestamp": "2026-02-24T15:00:00Z",
  "template": "Write a compelling book blurb for: {{description}}...",
  "skill": "blurb-writer",
  "taskType": "marketing",
  "provider": "gemini",
  "inputTokens": 450,
  "outputTokens": 890,
  "outcome": "accepted",
  "userEdited": false,
  "qualitySignals": {
    "wordCount": 147,
    "completeness": true,
    "followedInstructions": true,
    "userAccepted": true
  }
}

Quality Signals

The optimizer watches for these signals:

Positive signals (prompt is working):

• User accepted output without edits
• Output matched requested format/length
• No follow-up "try again" or "that's not what I meant"
• User explicitly praised the result
• Output was saved to a file (user valued it enough to keep)

Negative signals (prompt needs improvement):

• User heavily edited the output
• User said "try again" or "not quite"
• Output was too long/short for the task
• AI produced an error or refusal
• Output missed key requirements from the prompt
• User abandoned the result

Prompt Evolution

When a prompt consistently underperforms, the optimizer creates variations:

Prompt Lab: "blurb-writer" skill
════════════════════════════════

Original (Score: 6.2/10 across 14 uses):
"Write a compelling book blurb for: {{description}}.
Create 3 versions: (1) short tagline, (2) back-cover
blurb (150 words), (3) Amazon description with HTML."

Variation A (Score: 7.8/10 across 6 uses):
"You are a bestselling book marketer. Write a blurb
for: {{description}}.
Rules: Hook in first sentence. No spoilers past Act 1.
End with a question or cliffhanger.
Format: tagline (10 words max), back cover (150 words),
Amazon listing (with <b> tags for emphasis)."

Variation B (Score: 8.1/10 across 4 uses):
"Study these bestselling blurbs for pacing and hooks:
[example 1], [example 2].
Now write a blurb for: {{description}} using the same
techniques. Output: tagline, 150-word back cover,
Amazon description."

→ RECOMMENDATION: Promote Variation B to primary.