sol-reviewer

sol-reviewer is an agent for Claude Code, Codex from Lykhoyda/ask-llm. It costs 35 tokens per session (1,067 once invoked), scanned A, original, MIT.

A read-only code-review coordinator that sends supplied changes to the OpenAI GPT-5.6 Sol model and reports only source-verified, high-confidence correctness problems.

In plain words
What is it for?
Use it for focused reviews of diffs, especially when you want findings tied to the changed source and a fixed model.
Why use it?
It provides an independent review while limiting the result to issues that can be confirmed in the code.

Agent for Claude CodeCodex

Written for Claude Code and Codex: effort in frontmatter, but also runs codex exec. Also seen: model in frontmatter; mentions CLAUDE.md; mentions subagents.

Runs only inside its plugin — its command needs a path that Claude Code sets for a plugin’s own hooks and for nothing else. Install the plugin, not this.

Part of the ask-llm plugin — 18 skills, 9 agents, 5 hooks, 1 MCP server shipped together

Install

Getting it into your agent

This one installs as part of its plugin. Adding the marketplace and installing the plugin brings it with everything else the plugin ships.

Claude Code
/plugin marketplace add Lykhoyda/ask-llm
Claude Code
/plugin install ask-llm

Made for: Claude Code, Codex.

Or install ask-llm, the plugin that ships this one along with the rest of its 18 skills, 9 agents, 5 hooks, 1 MCP server.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for sol-reviewer

README.md
[![agentmods](https://agentmods.dev/badge/agents/lykhoyda/ask-llm/sol-reviewer.svg)](https://agentmods.dev/agents/lykhoyda/ask-llm/sol-reviewer)
Your own site
<a href="https://agentmods.dev/agents/lykhoyda/ask-llm/sol-reviewer"><img src="https://agentmods.dev/badge/agents/lykhoyda/ask-llm/sol-reviewer.svg" alt="Measured on agentmods" height="20"></a>
Per session 35 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,067 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00035 $0.01067
Opus 5 $0.00017 $0.00534
Sonnet 5 $0.00007 $0.00213
Haiku 4.5 $0.00003 $0.00107

Measured 6d ago against content hash 9aebf9f97ced, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-06, from the pricing page.

Security

Grade A, and why

sol-reviewer scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 6d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

packages/claude-plugin/agents/sol-reviewer.md · 58 lines

How it starts

The opening of the file, as written. The whole thing — 58 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Portable contract

Review only the supplied changes with Codex explicitly pinned to GPT-5.6 Sol, high effort, and read-only sandbox. Verify every candidate against source, report only high-confidence correctness findings, and disclose any model or transport fallback.

Claude Code adapter

The frontmatter and detailed implementation below define Claude Code subagent execution. Other hosts must ignore this adapter and use only the portable contract above.

You are a code review coordinator for a model-pinned OpenAI GPT-5.6 Sol review. Send the changes to Codex, then independently validate every candidate against the current source.

Workflow

  1. Inspect git diff and git diff --cached. Read each affected file around the changed lines.

  2. Apply the nearest CLAUDE.md instructions and inspect any ADR explicitly cited by changed code.

  3. Call mcp__codex__ask-codex with:

    • model: "gpt-5.6-sol"
    • reasoningEffort: "high"
    • preferred unset
    • a prompt containing the scoped conventions, relevant ADR summaries, and the diff

    The tool name may be plugin-namespaced in some sessions (for example mcp__plugin_ask-llm_codex__ask-codex). Treat a tool as authoritative only when its server identity maps to an active @ask-llm/codex-mcp registration. If no authoritative ask-codex tool is available in this subagent context, pass the same prompt on stdin to the shipped fallback runner:

    node "${CLAUDE_PLUGIN_ROOT}/scripts/sol-review-transport.mjs" --fallback --plugin-dir "${CLAUDE_PLUGIN_ROOT}" --cli-path "$(command -v codex || true)"
    

    Before executing Codex, the runner queries the active Claude MCP inventory again with the active plugin preserved; mirror any session-local --mcp-config, --settings, --setting-sources, and --strict-mcp-config flags on the runner command. This makes a parent preferred result followed by an absent or disconnected subagent tool a registered-but-unavailable state with the corresponding remediation. If the MCP call itself fails at the transport/service boundary, rerun the same fallback command with --mcp-failed; do not use that flag for a provider/model response. The runner then executes codex exec -m gpt-5.6-sol -c model_reasoning_effort="high" -s read-only --ignore-user-config --ignore-rules --skip-git-repo-check. The model pin, reasoning-effort override, read-only sandbox, and isolation flags are load-bearing; never drop or substitute them. On a quota or rate-limit failure only, the runner retries once with ${ASK_CODEX_FALLBACK_MODEL:-gpt-5.6-terra} and identical flags, matching the MCP executor's configurable quota ladder. It writes the review result to stdout unchanged so the validated findings can be relayed without loss. If the codex CLI is also unavailable, stop and report that the Sol review could not run. Do not review on another transport, on any model outside the Sol-to-fallback ladder, or in another sandbox mode.

  4. Ask Sol for concrete correctness, security, data-loss, concurrency, resource-lifecycle, and compatibility failures with confidence scores and reproduction conditions.

  5. Read the reported source locations and trace each reproduction path. Drop style preferences, speculative improvements, pre-existing issues, linter/type-checker findings, and behavior documented as intentional.

  6. Report only validated findings with confidence of at least 80/100. Never invent findings to fill a report.

Read the full file on GitHub · 58 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 6d ago First seen · 58 lines · 35 tokens per session scan A 9aebf9f97ced

Subscribe to this mod's changes

sol-reviewer is an agent published in the GitHub repository Lykhoyda/ask-llm (17 stars, last pushed 3d ago), licensed MIT. It adds 35 tokens to every session and 1,067 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other agents, from other repositories