physical-ai-datasets

physical-ai-datasets is a skill for Claude Code, Codex from NVIDIA/nurec-skills. It costs 255 tokens per session (13,103 once invoked), scanned B, original, Apache-2.0.

A catalogue of NVIDIA Physical AI datasets on Hugging Face, a website for sharing machine-learning datasets and models. The datasets cover autonomous vehicles, robotics, manipulation, spatial intelligence, and related work.

In plain words
What is it for?
Use it to find, compare, and download datasets for vehicle reconstruction, robotics, GR00T post-training, grasping, spatial-intelligence research, or simulation-ready content.
Why use it?
It helps you choose a relevant NVIDIA dataset without searching the organisation's collections one by one.

Skill for Claude CodeCodex ✓ vendor

Written for no agent in particular: nothing here depends on one.

Needs its repository: it reads a path above its own folder, which exists only inside the repository. The line is ncore_vis <local-dir>/clips/<uuid>/pai_<uuid>.json # via ../ncore/SKILL.md.

Good fit Use it to find, compare, and download datasets for vehicle reconstruction, robotics, GR00T post-training, grasping, spatial-intelligence research, or simulation-ready content.

Compare 6 skills from other repositories ↓
About the project

NVIDIA NuRec Skills is a set of agent instructions for running neural reconstruction and rendering workflows in NVIDIA Omniverse NuRec. It targets autonomous-vehicle and robotics simulation, guiding agents across the public containers, repositories, and artifacts that make up the NuRec stack.

NVIDIA/nurec-skills · 37 stars · on GitHub

Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/NVIDIA/nurec-skills
agentmods
npx agentmods add skills/nvidia/nurec-skills/physical-ai-datasets

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for physical-ai-datasets

README.md
[![agentmods](https://agentmods.dev/badge/skills/nvidia/nurec-skills/physical-ai-datasets/github.svg)](https://agentmods.dev/skills/nvidia/nurec-skills/physical-ai-datasets)
Your own site
<a href="https://agentmods.dev/skills/nvidia/nurec-skills/physical-ai-datasets"><img src="https://agentmods.dev/badge/skills/nvidia/nurec-skills/physical-ai-datasets/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for physical-ai-datasets

Your own site · 80×15
<a href="https://agentmods.dev/skills/nvidia/nurec-skills/physical-ai-datasets"><img src="https://agentmods.dev/badge/skills/nvidia/nurec-skills/physical-ai-datasets.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 255 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 13,103 The whole file, excluding the scripts and references it only reads on demand.
Security scan B 2 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 4 findings, up to high

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • high Privilege Escalation · line 33
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 92
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 150
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • medium Privilege Escalation · line 146
    Commands invoke sudo or root privileges. Verify this elevated access is necessary and justified.
    Fix: Avoid sudo/root unless strictly required. Prefer least-privilege patterns. If elevation is needed, document the justification and scope.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00255 $0.13103
Opus 5 $0.00128 $0.06552
Sonnet 5 $0.00051 $0.02621
Haiku 4.5 $0.00026 $0.01310

Measured 11d ago against content hash 4637bc2d3ab8, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade B, and why

physical-ai-datasets scanned grade B with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 11d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Asks for rootmediumPrivilege escalation

A mod that escalates privileges can change anything on the machine, not only the project.

sudo apt -y install git git-lfs

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

| Tooling | `wget … scripts/download.py; python download.py --odir <path> --file_types hdmap,lidar,synthetic` |
skills/physical-ai-datasets/SKILL.md · 888 lines

How it starts

The opening of the file, as written. The whole thing — 888 lines — stays where its author put it; the contents beside it link to each section on GitHub.

NVIDIA Physical AI Datasets (Hugging Face)

Purpose

Help the agent find, evaluate, and download an NVIDIA PhysicalAI-* dataset on Hugging Face that fits the user's downstream task — autonomous-vehicle reconstruction, robotics manipulation, GR00T post-training, spatial-intelligence research, grasping, or sim-ready content — and then hand off to the sibling skill (ncore, nre, asset-harvester, nurec-fixer) or upstream NVIDIA tool that actually consumes it.

Use this skill when: the user asks "is there an NVIDIA dataset for X?", "where do I get NCore / NuRec / GR00T sample data?", or is shopping the Hugging Face NVIDIA org for PhysicalAI-* collections.

Do NOT use this skill when:

  • The user already knows the dataset and just wants to run a pipeline — jump straight to the consuming skill.
  • The user needs a non-NVIDIA dataset (Waymo, nuScenes, KITTI, …) — this catalog is NVIDIA-only.
  • The user wants to train Cosmos / GR00T / Isaac Sim itself — that's the upstream tool's job, not this catalog's.

Overview

Catalog of NVIDIA's open Physical AI dataset family on Hugging Face. Pick by task (Section 2 § lookup table) or family (Sections 3–10). Every entry lists: dataset path, size, format, license, gating, and the downstream skill in this repo that consumes it.

Source of truth: https://huggingface.co/nvidia (filter PhysicalAI-) and the curated Physical AI collection. When upstream cards drift, re-check the HF page; this skill mirrors the cards as of Apr 2026.

Prerequisites

  • HuggingFace account with the dataset card opened in a browser at least once, and the gating checkbox accepted on every dataset you intend to download.
  • HuggingFace user access token exported as HF_TOKEN (create at https://huggingface.co/settings/tokens).
  • git, git-lfs, and huggingface_hub[cli] on PATH.
  • Storage room sized to the dataset you're pulling (see the per-row size column; some are < 1 GB, the AV dataset is 133 TB — always pre-filter with --include or physical_ai_av).

Read the full file on GitHub · 888 lines

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 11d ago First seen · 888 lines · 255 tokens per session scan B 4637bc2d3ab8

Subscribe to this mod's changes

physical-ai-datasets is a skill published in the GitHub repository NVIDIA/nurec-skills (37 stars, last pushed 7d ago), licensed Apache-2.0. It adds 255 tokens to every session and 13,103 once invoked, about $0.0013 per session on Opus 5. A static security scan graded it B with 2 findings (asks for root, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

arboreto

Infer gene regulatory networks (GRNs) from gene expression data using scalable algorithms (GRNBoost2, GENIE3). Use when analyzing transcriptomics data (bulk RNA-seq, single-cell RNA-seq) to identify transcription factor-target gene relationships and regulatory interactions. Supports distributed computation for…

K-Dense-AI/scientific-agent-skills · 66 tokens

pyhealth

Build clinical/healthcare deep-learning pipelines with PyHealth — loading EHR/signal/imaging datasets (MIMIC-III/IV, eICU, OMOP, SleepEDF, ChestXray14, EHRShot), defining tasks (mortality, readmission, length-of-stay, drug recommendation, sleep staging, ICD coding, EEG events), instantiating models (Transformer…

K-Dense-AI/scientific-agent-skills · 216 tokens

torchdrug

Build and troubleshoot TorchDrug 0.2.1 workflows for molecular graphs, property prediction, self-supervised pretraining, molecule generation, retrosynthesis, protein representation learning, and knowledge graph reasoning. Use when code imports torchdrug or needs its datasets, models, tasks, or Engine.

K-Dense-AI/scientific-agent-skills · 61 tokens

deepspot-m

Generate transcriptome-wide virtual spatial transcriptomics from H&E histology with DeepSpot-M. Use when you need spatial gene expression in log1p-CPM for 224x224 tiles at about 20x, want to query protein-coding genes by symbol instead of a fixed panel, or want to run prediction across a whole slide after tiling with…

K-Dense-AI/scientific-agent-skills · 80 tokens

nemo-mbridge-perf-expert-parallel-overlap

Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlapmoeexpertparallelcomm, delaywgradcompute, and flex dispatcher backends such as DeepEP and HybridEP.

NVIDIA/skills · 56 tokens

pick-a-pii-model

Select an on-device OpenMed PII model from the committed registry by language, runtime format, and size budget, then require recall validation before deployment. Use when an agent must choose a local PII detector for CPU, Apple Silicon, or a mobile export without relying on live model discovery.

maziyarpanahi/openmed · 64 tokens