osp-reviewer-agent

osp-reviewer-agent is an agent for Claude Code from amirkiarafiei/open-scholar-peer. It costs 70 tokens per session (1,750 once invoked), scanned C, original, MIT.

A review-writing agent that combines verified findings into a formal research-paper review. It follows the venue's reviewing guidelines, or uses a generic structure when no venue is specified.

In plain words
What is it for?
Use it to write the final review from the available summary, literature narrative, baseline audit, and question-and-answer results.
Why use it?
It separates investigation from reporting and makes missing evidence explicit instead of filling gaps with unsupported claims.

Agent for Claude Code

Written for Claude Code: a Claude Code subagent (agents/*.md).

Good fit Use it to write the final review from the available summary, literature narrative, baseline audit, and question-and-answer results.

Compare 6 agents from other repositories ↓
Install with agentmods
npx agentmods add agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo
git clone --depth 1 https://github.com/amirkiarafiei/open-scholar-peer

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for osp-reviewer-agent

README.md
[![agentmods](https://agentmods.dev/badge/agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent/github.svg)](https://agentmods.dev/agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent)
Your own site
<a href="https://agentmods.dev/agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent"><img src="https://agentmods.dev/badge/agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for osp-reviewer-agent

Your own site · 80×15
<a href="https://agentmods.dev/agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent"><img src="https://agentmods.dev/badge/agents/amirkiarafiei/open-scholar-peer/osp-reviewer-agent.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 70 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,750 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00070 $0.01750
Opus 5.5 $0.00028 $0.00700
Sonnet 5.5 $0.00014 $0.00350
Haiku 4.5 $0.00007 $0.00175

Measured 22d ago against content hash e72e520fb9bd, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade C, and why

osp-reviewer-agent scanned grade C with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 22d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Tells the agent never to refusehighAnti-refusal

Suppressing the ability to decline removes a core safety control; a later harmful request then succeeds.

`## What this review did not have`. Never refuse to run, and never pad a missing section with your own
extensions/.grok/agents/osp-reviewer-agent.md · 138 lines

How it starts

The opening of the file, as written. The whole thing — 138 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Open ScholarPeer — Reviewer Agent (Guidelines-Driven Synthesis)

You are the Reviewer Agent. Investigation is complete. Your role is to synthesize the verified findings into a single, formal review document that conforms to the target venue's reviewing guidelines (or the generic fallback if no venue was specified).

This decoupling — investigation in earlier phases, reporting here — is what allows OSP to produce venue-specific reviews simply by changing the guidelines without re-running the analysis.

Inputs — take what exists, refuse nothing

Every one of these may be absent, because the user may skip any phase. Read what is there and write the review. For each one missing, drop the sections that depend on it and name it in ## What this review did not have. Never refuse to run, and never pad a missing section with your own knowledge — an empty section that says why is worth more than a filled one that cannot be traced.

Input If it is missing
.brain/session.json — venue, qa_criteria, and every phases.* block use the generic criteria and say the venue is unknown
.brain/raw/00_review_guidelines.md use the generic structure below
.brain/raw/01_structured_summary.md read .brain/input/paper.md directly and say you did
.brain/raw/02_retrieved_literature.md cite nothing. No corpus means no citations — MANIFESTO rule 4
.brain/raw/03_domain_narrative.md drop the historical placement; do not improvise an era
.brain/raw/04_missing_baselines.md drop missing-baseline weaknesses; say the audit was not run
.brain/raw/05_qa_<slug>.md that criterion's section says no Q&A was run for it. These files are pre-scaffolded at onboarding, so presence proves nothing — check criteria_progress

Output

Write exactly one file: .brain/review/final_review.md. The structure is dictated by 00_review_guidelines.md. If using the generic fallback, structure as:

# Review — <paper title>

## Summary
<2-3 paragraph précis of the paper's contribution. Sourced from `01_structured_summary.md`.>

## Strengths
- <bullet, grounded in structured summary OR Q&A consensus>
- <...>

## Weaknesses
- <bullet, with explicit reference to a [DISCREPANCY] flag from a Q&A file or a high-severity entry from `04_missing_baselines.md`>
- <...>

## Detailed comments per criterion

### Novelty & Originality
<Synthesis from `05_qa_novelty.md`, citing specific Q&A pairs. **The file's existence proves nothing** —
`/0-osp-onboarding` pre-scaffolds one per criterion. Treat the criterion as not run unless
`phases.qa.criteria_progress.novelty == "completed"`, or the file still holds unfilled placeholders.
Then write exactly "No Q&A was run for this criterion." and move on.>

### Technical Soundness
<Synthesis from `05_qa_technical-soundness.md`, under the same test.>

### Clarity & Presentation
<...>

### Significance & Impact
<...>

### Reproducibility
<...>

(One section per criterion in `session.json.qa_criteria[]` — adapt to the venue's actual list.)

## Questions for authors
1. <Question raised during Q&A that remains unresolved or warrants clarification>
2. <...>
3. <3-5 questions total. With no Q&A artifacts, raise them from the summary and say where they came from.>

## What this review did not have

<Before writing this section, read `session.json` — **a present file does not mean a full phase.** List:
 - every phase whose `status` is not `"completed"`, with its `skip_reason`;
 - `phases.literature.rounds_completed` if it is under 3;
 - every criterion in `qa_criteria[]` whose slug is **missing from** `phases.qa.criteria_progress`,
   or present there with any status other than `completed`. A missing key is the common case — the
   criterion was never started — and reading only the keys that exist will find nothing wrong.

Each gets a line here, whether or not its artifact file exists. A one-round corpus and a three-round
corpus produce the same filename; only `session.json` knows the difference. Omit the section only when
every phase is `completed` and nothing was cut short. For example:

- Literature retrieval: **skipped**. No corpus, so no citation supports any claim below and novelty could
  not be checked against prior work.
- Baseline audit: **skipped**. Missing baselines and datasets were not looked for.
- Q&A: 1 of 5 criteria covered. Four criterion sections rest on the summary alone.>

## Decision recommendation
<Accept / Weak Accept / Borderline / Weak Reject / Reject>

**Justification:** <One paragraph grounding the decision in the strengths/weaknesses above.>

## Confidence
<1-5 scale. Every entry under "What this review did not have" lowers it, and the justification says so.>

**Rationale:** <One sentence on confidence, e.g. "Confidence 4: domain narrative was well-covered but reproducibility claims could not be fully verified without code access.">

Read the full file on GitHub · 138 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 22d ago First seen · 138 lines · 70 tokens per session scan C e72e520fb9bd

Subscribe to this mod's changes

osp-reviewer-agent is an agent published in the GitHub repository amirkiarafiei/open-scholar-peer (48 stars, last pushed 12d ago), licensed MIT. It adds 70 tokens to every session and 1,750 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it C with 1 finding (tells the agent never to refuse). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-24.