sciatlas-idea-evaluate

sciatlas-idea-evaluate is a skill for Codex from zjunlp/SciAtlas. It costs 96 tokens per session (1,388 once invoked), scanned A, original, MIT.

A guided workflow for reviewing a research idea or paper with SciAtlas, a tool that connects academic papers and evidence. It gathers supporting material and produces an automated review using reviewer and rubric reports.

In plain words
What is it for?
Use it to evaluate an idea or paper, check claims against source passages, apply review criteria, and combine several generated assessments into one report.
Why use it?
It helps identify strengths, weaknesses, and evidence gaps before a research idea or paper is submitted or developed further.

Skill for Codex

Written for Codex: agents/openai.yaml present.

Good fit Use it to evaluate an idea or paper, check claims against source passages, apply review criteria, and combine several generated assessments into one report.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/zjunlp/sciatlas/sciatlas-idea-evaluate
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add zjunlp/SciAtlas --skill sciatlas-idea-evaluate
Clone the repo
git clone --depth 1 https://github.com/zjunlp/SciAtlas

Made for: Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for sciatlas-idea-evaluate

README.md
[![agentmods](https://agentmods.dev/badge/skills/zjunlp/sciatlas/sciatlas-idea-evaluate.svg)](https://agentmods.dev/skills/zjunlp/sciatlas/sciatlas-idea-evaluate)
Your own site
<a href="https://agentmods.dev/skills/zjunlp/sciatlas/sciatlas-idea-evaluate"><img src="https://agentmods.dev/badge/skills/zjunlp/sciatlas/sciatlas-idea-evaluate.svg" alt="Measured on agentmods" height="20"></a>
Per session 96 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,388 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 1 finding, up to medium

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • medium Excessive Agency · line 15
    Skill enables autonomous high-impact decisions without human-in-the-loop verification. Critical operations (destructive commands, financial transactions, data deletion) should require explicit user confirmation.
    Fix: Add human-in-the-loop confirmation for destructive, irreversible, or high-impact operations. Never auto-execute commands that modify files, send data, or alter system state.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00096 $0.01388
Opus 5 $0.00048 $0.00694
Sonnet 5 $0.00019 $0.00278
Haiku 4.5 $0.00010 $0.00139

Measured 8d ago against content hash 127ad583a03a, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-07, from the pricing page.

Security

Grade A, and why

sciatlas-idea-evaluate scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

agent-skill/sciatlas-idea-evaluate/SKILL.md · 136 lines

How it starts

The opening of the file, as written. The whole thing — 136 lines — stays where its author put it; the contents beside it link to each section on GitHub.

SciAtlas Idea Evaluate

Use this skill to run the repository automated review workflow. The workflow builds idea context, searches KG/S2 evidence, creates a manifest, grounds claims to paper paragraphs, builds rubric evidence, samples reviewer backgrounds, generates reviewer reports, and synthesizes a final report.

Operating Contract

  • Run only sciatlas idea-evaluate or python run_sciatlas.py idea-evaluate for this skill.
  • Own the end-to-end novice flow: install or locate the CLI, guide registration, configure .env or shell variables, run the workflow, inspect artifacts, and synthesize the final review result.
  • Ask the user only for human-only values: missing idea/PDF path, email, verification code, SciAtlas token, LLM/S2/KG credentials that are not already configured, or one necessary scope clarification.
  • Do not ask the user to run shell commands when tool access is available.
  • Use --workflow flash by default.
  • Use --workflow full for a broader reviewer/rubric/evidence pass or when the user wants a more comprehensive review.
  • Never disclose full API keys or tokens.
  • Read saved artifacts before answering.

Zero-Start Bootstrap

  1. Check whether the repository command works:
python run_sciatlas.py idea-evaluate -h

If needed, fall back to sciatlas idea-evaluate -h after installing the full checkout.

  1. This dedicated workflow requires a full SciAtlas checkout. If it is missing, clone the repository, change into it, then run python -m pip install -e ./sciatlas and python -m pip install -r requirements-workflows.txt. Do not use the GitHub #subdirectory=sciatlas package-only installation for this workflow.
  2. Check current environment and .env for SCIATLAS_API_KEY, LLM settings, S2 settings, and KG settings before asking the user.
  3. If no SciAtlas token is configured, guide the user to http://sciatlas.openkg.cn/register; ask for email, verification code, and returned sciatlas_xxx token only when needed.
  4. If LLM/S2/KG credentials are required and missing, ask only for the missing values. Use the user's provider values without printing them back.
  5. Configure the current shell or .env yourself, then run the workflow.

Read the full file on GitHub · 136 lines

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 136 lines · 96 tokens per session scan A 127ad583a03a

Subscribe to this mod's changes

sciatlas-idea-evaluate is a skill published in the GitHub repository zjunlp/SciAtlas (146 stars, last pushed 1mo ago), licensed MIT. It adds 96 tokens to every session and 1,388 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

paper2video

Turn a research paper, a paper2assets package, or an existing PPT deck into a narrated MP4 video by fully delegating slide authoring to the installed ppt-master skill and fully delegating rendering, subtitles, timeline assembly, and strict media QA to the installed pptx2video skill and its public CLI. Resolves one…

microsoft/ResearchStudio · 157 tokens

idea-quality

Score the QUALITY of a research idea at the idea stage — given a Markdown file with Title / Motivation / Method sections (no experiments needed), produce a per-axis quality assessment with cited evidence and an overall 0–100 score plus a verdict; or, given two such idea files, a blind head-to-head comparison. TRIGGER…

microsoft/ResearchStudio · 215 tokens

scienceworld-animal-identifier

Use when the agent needs to locate, identify, and focus on a specific animal or biological entity in the ScienceWorld environment. This skill handles tasks involving animal comparison, examination, or interaction (such as determining lifespan extremes) by navigating to the correct location with "teleport to"…

zjunlp/SkillNet · 83 tokens

scienceworld-measurement-taker

Use when the agent needs to measure a quantitative property (temperature, weight, pH) of a target object or substance using a measurement tool. This skill covers acquiring the tool, preparing both tool and target with focus actions, executing the measurement via "use [TOOL] on [TARGET]", and interpreting the resulting…

zjunlp/SkillNet · 81 tokens

scienceworld-object-selector

Use when the agent needs to choose a specific object from multiple candidates in the environment based on task criteria such as object type (non-living thing, electrical component, container), properties, or category. This skill surveys visible objects with "look around", evaluates each against the task requirements…

zjunlp/SkillNet · 79 tokens

scienceworld-task-focuser

Use when the agent needs to direct attention to a specific object in the environment or inventory before performing a critical action such as measuring, using, or connecting. This preparatory "focus on" step signals intent to the ScienceWorld system, often unlocking required state changes for subsequent interactive…

zjunlp/SkillNet · 67 tokens