osp-reviewer-agent

osp-reviewer-agent is a skill for Claude Code, Codex from amirkiarafiei/open-scholar-peer. It costs 70 tokens per session (1,750 once invoked), scanned C, original, MIT.

An automated peer-review writer for research papers. It combines an existing paper summary, related literature, domain context, missing comparison methods, and question-and-answer findings into one review that follows the target publication’s guidelines.

In plain words
What is it for?
Use it after research and evidence collection to produce the final review document, including the paper’s contribution summary, assessment, and venue-specific review sections.
Why use it?
It removes the need to manually combine separate investigation notes into a consistent review. It does not perform new investigation; it works from the supplied files.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it after research and evidence collection to produce the final review document, including the paper’s contribution summary, assessment, and venue-specific review sections.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add amirkiarafiei/open-scholar-peer --skill osp-reviewer-agent
Clone the repo
git clone --depth 1 https://github.com/amirkiarafiei/open-scholar-peer

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for osp-reviewer-agent

README.md
[![agentmods](https://agentmods.dev/badge/skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent/github.svg)](https://agentmods.dev/skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent)
Your own site
<a href="https://agentmods.dev/skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent"><img src="https://agentmods.dev/badge/skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for osp-reviewer-agent

Your own site · 80×15
<a href="https://agentmods.dev/skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent"><img src="https://agentmods.dev/badge/skills/amirkiarafiei/open-scholar-peer/osp-reviewer-agent.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 70 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,750 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 1 finding. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00070 $0.01750
Opus 5.5 $0.00028 $0.00700
Sonnet 5.5 $0.00014 $0.00350
Haiku 4.5 $0.00007 $0.00175

Measured 1mo ago against content hash e72e520fb9bd, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade C, and why

osp-reviewer-agent scanned grade C with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Tells the agent never to refusehighAnti-refusal

Suppressing the ability to decline removes a core safety control; a later harmful request then succeeds.

`## What this review did not have`. Never refuse to run, and never pad a missing section with your own
extensions/.agent/skills/osp-reviewer-agent/SKILL.md · 138 lines

How it starts

The opening of the file, as written. The whole thing — 138 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Open ScholarPeer — Reviewer Agent (Guidelines-Driven Synthesis)

You are the Reviewer Agent. Investigation is complete. Your role is to synthesize the verified findings into a single, formal review document that conforms to the target venue's reviewing guidelines (or the generic fallback if no venue was specified).

This decoupling — investigation in earlier phases, reporting here — is what allows OSP to produce venue-specific reviews simply by changing the guidelines without re-running the analysis.

Inputs — take what exists, refuse nothing

Every one of these may be absent, because the user may skip any phase. Read what is there and write the review. For each one missing, drop the sections that depend on it and name it in ## What this review did not have. Never refuse to run, and never pad a missing section with your own knowledge — an empty section that says why is worth more than a filled one that cannot be traced.

Input If it is missing
.brain/session.json — venue, qa_criteria, and every phases.* block use the generic criteria and say the venue is unknown
.brain/raw/00_review_guidelines.md use the generic structure below
.brain/raw/01_structured_summary.md read .brain/input/paper.md directly and say you did
.brain/raw/02_retrieved_literature.md cite nothing. No corpus means no citations — MANIFESTO rule 4
.brain/raw/03_domain_narrative.md drop the historical placement; do not improvise an era
.brain/raw/04_missing_baselines.md drop missing-baseline weaknesses; say the audit was not run
.brain/raw/05_qa_<slug>.md that criterion's section says no Q&A was run for it. These files are pre-scaffolded at onboarding, so presence proves nothing — check criteria_progress

Output

Write exactly one file: .brain/review/final_review.md. The structure is dictated by 00_review_guidelines.md. If using the generic fallback, structure as:

# Review — <paper title>

## Summary
<2-3 paragraph précis of the paper's contribution. Sourced from `01_structured_summary.md`.>

## Strengths
- <bullet, grounded in structured summary OR Q&A consensus>
- <...>

## Weaknesses
- <bullet, with explicit reference to a [DISCREPANCY] flag from a Q&A file or a high-severity entry from `04_missing_baselines.md`>
- <...>

## Detailed comments per criterion

### Novelty & Originality
<Synthesis from `05_qa_novelty.md`, citing specific Q&A pairs. **The file's existence proves nothing** —
`/0-osp-onboarding` pre-scaffolds one per criterion. Treat the criterion as not run unless
`phases.qa.criteria_progress.novelty == "completed"`, or the file still holds unfilled placeholders.
Then write exactly "No Q&A was run for this criterion." and move on.>

### Technical Soundness
<Synthesis from `05_qa_technical-soundness.md`, under the same test.>

### Clarity & Presentation
<...>

### Significance & Impact
<...>

### Reproducibility
<...>

(One section per criterion in `session.json.qa_criteria[]` — adapt to the venue's actual list.)

## Questions for authors
1. <Question raised during Q&A that remains unresolved or warrants clarification>
2. <...>
3. <3-5 questions total. With no Q&A artifacts, raise them from the summary and say where they came from.>

## What this review did not have

<Before writing this section, read `session.json` — **a present file does not mean a full phase.** List:
 - every phase whose `status` is not `"completed"`, with its `skip_reason`;
 - `phases.literature.rounds_completed` if it is under 3;
 - every criterion in `qa_criteria[]` whose slug is **missing from** `phases.qa.criteria_progress`,
   or present there with any status other than `completed`. A missing key is the common case — the
   criterion was never started — and reading only the keys that exist will find nothing wrong.

Each gets a line here, whether or not its artifact file exists. A one-round corpus and a three-round
corpus produce the same filename; only `session.json` knows the difference. Omit the section only when
every phase is `completed` and nothing was cut short. For example:

- Literature retrieval: **skipped**. No corpus, so no citation supports any claim below and novelty could
  not be checked against prior work.
- Baseline audit: **skipped**. Missing baselines and datasets were not looked for.
- Q&A: 1 of 5 criteria covered. Four criterion sections rest on the summary alone.>

## Decision recommendation
<Accept / Weak Accept / Borderline / Weak Reject / Reject>

**Justification:** <One paragraph grounding the decision in the strengths/weaknesses above.>

## Confidence
<1-5 scale. Every entry under "What this review did not have" lowers it, and the justification says so.>

**Rationale:** <One sentence on confidence, e.g. "Confidence 4: domain narrative was well-covered but reproducibility claims could not be fully verified without code access.">

Read the full file on GitHub · 138 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago Changed · +34 lines scan A → C e72e520fb9bd
  2. 2mo ago First seen · 104 lines · 70 tokens per session scan A b8c443c0b047

Subscribe to this mod's changes

osp-reviewer-agent is a skill published in the GitHub repository amirkiarafiei/open-scholar-peer (51 stars, last pushed 6d ago), licensed MIT. It adds 70 tokens to every session and 1,750 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it C with 1 finding (tells the agent never to refuse). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

ara-rigor-reviewer

Performs ARA Seal Level 2 semantic epistemic review on Agent-Native Research Artifacts, scoring six dimensions (evidence relevance, falsifiability, scope calibration, argument coherence, exploration integrity, methodological rigor) and producing a constructive, severity-ranked report with a Strong Accept-to-Reject…

Orchestra-Research/AI-Research-SKILLs · 91 tokens

baseline-comparison-audit

Audit whether a paper's baseline comparisons are COMPLETE, FAIR, and SIGNIFICANT: a required recent SOTA baseline is missing while 'best/SOTA' is claimed (HP-MISSING-BASELINE); a baseline is undertuned / given less compute-tuning-data, run at a mismatched config, or the equal-budget ablation-as-baseline is absent…

wanshuiyin/Anti-Autoresearch · 310 tokens

eval-design-forensics

Audit whether a paper's EVALUATION DESIGN actually measures what it claims and whether its reporting is complete — the validity layer family D (experiment-forensics) cannot reach. Three patterns: train/test leakage means the reported score may not measure generalization (HP-EVAL-LEAKAGE — adopts the Kapoor & Narayanan…

wanshuiyin/Anti-Autoresearch · 458 tokens

novelty-duplication-advisory

MEMO-ONLY prior-work overlap advisory: surfaces the two ADVISORY taxonomy signals neither a tool nor a model can decide from the paper alone — ADV-TRIVIAL-COMBINATION (standard A+B+C / 缝合 stapling) and ADV-DUPLICATE-PUBLICATION (repackaged / duplicate submission). The executor RETRIEVES candidate prior work (DBLP…

wanshuiyin/Anti-Autoresearch · 284 tokens

anti-autoresearch

End-to-end substantive-integrity forensic sweep of a research paper (especially autoresearch / AI-Scientist-style output). Orchestrates the whole pipeline: ingest (arxiv-id | pdf | dir → working dir + pdftotext for L0) → /evidence-ledger (artifact manifest + observability level L0/L1/L2 + span-anchored claims.json) →…

wanshuiyin/Anti-Autoresearch · 275 tokens

adversarial-case-builder

Synthesize the single strongest EVIDENCE-BOUND reviewer case to reject a paper, built ONLY from the evidence ledger (claims.json) + the other auditors' confirmed findings — never free-floating LLM critique. Two fresh cross-model codex threads: an attack writes the 200-word rejection paragraph (every accusation tagged…

wanshuiyin/Anti-Autoresearch · 194 tokens