umbrella-review-skeptic

umbrella-review-skeptic is a skill for Claude Code, Codex from Vambrocop/EvidenceForge. It costs 75 tokens per session (848 once invoked), scanned A, original, MIT.

A method for reviewing existing systematic reviews and meta-analyses, which combine results from multiple research studies. It checks whether those reviews reused the same underlying studies and whether their conclusions can be compared.

In plain words
What is it for?
It helps assess review quality, map shared primary studies, investigate conflicting conclusions, and decide whether review-level statistical pooling is appropriate.
Why use it?
It reduces the risk of counting the same evidence more than once or averaging results that were produced using incompatible methods.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit It helps assess review quality, map shared primary studies, investigate conflicting conclusions, and decide whether review-level statistical pooling is appropriate.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/vambrocop/evidenceforge/umbrella-review-skeptic
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add Vambrocop/EvidenceForge --skill umbrella-review-skeptic
Clone the repo
git clone --depth 1 https://github.com/Vambrocop/EvidenceForge

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for umbrella-review-skeptic

README.md
[![agentmods](https://agentmods.dev/badge/skills/vambrocop/evidenceforge/umbrella-review-skeptic/github.svg)](https://agentmods.dev/skills/vambrocop/evidenceforge/umbrella-review-skeptic)
Your own site
<a href="https://agentmods.dev/skills/vambrocop/evidenceforge/umbrella-review-skeptic"><img src="https://agentmods.dev/badge/skills/vambrocop/evidenceforge/umbrella-review-skeptic/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for umbrella-review-skeptic

Your own site · 80×15
<a href="https://agentmods.dev/skills/vambrocop/evidenceforge/umbrella-review-skeptic"><img src="https://agentmods.dev/badge/skills/vambrocop/evidenceforge/umbrella-review-skeptic.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 75 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 848 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00075 $0.00848
Opus 5 $0.00037 $0.00424
Sonnet 5 $0.00015 $0.00170
Haiku 4.5 $0.00007 $0.00085

Measured 11d ago against content hash 6fe883c9d18e, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

umbrella-review-skeptic scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 11d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/umbrella-review-skeptic/SKILL.md · 104 lines

How it starts

The opening of the file, as written. The whole thing — 104 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Umbrella Review Skeptic

Use this skill when the evidence base already contains reviews or meta-analyses and the user wants to synthesize the syntheses.

Core Principle

Do not simply average meta-analyses. Existing reviews often reuse the same primary studies, use different inclusion rules, and report non-comparable pooled effects.

Intake

Identify:

  • included reviews/meta-analyses;
  • review questions;
  • search dates;
  • primary studies included in each review;
  • pooled effects and metrics;
  • quality assessment method;
  • overlap among reviews;
  • whether a second-order statistical synthesis is planned.

Load:

  • references/overlap-and-quality.md for overlap and quality checks.
  • references/second-order-decision-rules.md when deciding whether review-level pooling is defensible.
  • references/agricultural-diversification-second-order-meta.md for long-term agricultural diversification, ecosystem-service, profitability, and yield trade-off synthesis.

Workflow

  1. Classify the project: umbrella review, review of reviews, or second-order meta-analysis.
  2. Extract review-level characteristics.
  3. Build a primary-study by review matrix.
  4. Assess overlap and duplicate evidence.
  5. Assess review quality and search currency.
  6. Compare effect metrics and inclusion criteria.
  7. Apply AMSTAR 2 / ROBIS-style review appraisal logic where appropriate.
  8. Decide: narrative umbrella synthesis, evidence map, or second-order pooling.
  9. If pooling, state dependence assumptions and model choice.
  10. Report discordance and certainty.

Use templates/overlap-matrix.md for overlap tracking. Use templates/second-order-temporal-tradeoff-audit.md and templates/review-level-effect-schema.csv for review-level temporal meta-regression and yield-service trade-off audits. Use templates/second-order-r-package-ledger.csv when extracting software packages and model roles from a second-order meta-analysis. Use templates/osf-r-dependency-inventory.csv when auditing OSF/GitHub R scripts beyond the packages named in the paper. Use templates/second-order-quality-scorecard.csv, templates/second-order-model-spec-ledger.csv, and templates/agricultural-diversification-taxonomy.csv when adapting agricultural diversification second-order meta-analysis protocols. Use templates/second-order-peer-review-readiness-checklist.csv before submission or revision to anticipate reviewer concerns about second-order environmental meta-analyses.

Read the full file on GitHub · 104 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 11d ago First seen · 104 lines · 75 tokens per session scan A 6fe883c9d18e

Subscribe to this mod's changes

umbrella-review-skeptic is a skill published in the GitHub repository Vambrocop/EvidenceForge (5 stars, last pushed 1mo ago), licensed MIT. It adds 75 tokens to every session and 848 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

easymeta

A workflow for systematic reviews, evidence maps, and meta-analyses in medicine, public health, and natural or environmental sciences.

Rimagination/easymeta · 172 tokens

systematic-review

Use this Skill when conducting a systematic literature review following PRISMA 2020: PICO framework, database search strategy, title/abstract screening, full-text eligibility, data extraction, and GRADE evidence grading.

xjtulyc/awesome-rosetta-skills · 47 tokens

systematic-review-epi

Use this Skill for systematic reviews: meta-regression, publication bias tests (Egger, funnel plot), GRADE evidence synthesis, and forest plots.

xjtulyc/awesome-rosetta-skills · 36 tokens

create-pr

Creates a GitHub PR with a Linear-ticket-prefixed title and a decision-led, narrative description for prisma-next. Use when the user wants to create a pull request, open a PR, or submit changes for review.

prisma/orm · 47 tokens

contrib-pr

Open a high-quality external contributor PR against prisma/orm. Use when the user is an outside contributor (not a Prisma maintainer) and wants to submit a change as a pull request from a fork. Encodes the contribution flow from CONTRIBUTING.md so the resulting PR passes review on the first round.

prisma/orm · 65 tokens

github-review-iteration

Orchestrates a GitHub PR review loop by delegating triage and implementation to dedicated sub-agents, then repeating until actionable review items are cleared. Use when the user says “address PR review”, “triage review comments”, or “iterate until review is clean”.

prisma/orm · 60 tokens