NVIDIA-TAO

60 mods across 1 repository, 86 stars between them.

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Run TAO Data Services object-detection gap analysis from ground-truth and inference annotations. Use when an object detection workflow needs to identify weak images by comparing model predictions against ground truth using per-class recall, precision, and AP50 thresholds. Use when the user asks to "analyze OD gaps"…

86 3d ago A 84 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Performs gap analysis on NVIDIA TAO VCN Classify (Visual Component Net) experiments by invoking the pinned TAO data-services container directly via docker run … gapanalysis vcnaoi … — picks the optimal decision threshold, ranks per-sample weakness, and emits a top-K weakest parquet expanded per-lighting for downstream…

86 3d ago A 103 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Extract false-positive and false-negative gaps from VLM binary-classification-question (BCQ, yes/no) predictions. Use when the user asks to "analyze VLM BCQ gaps", "extract VLM false positives and false negatives", or identify failure cases from a predictions JSON for DEFT root-cause analysis on a…

86 3d ago A 83 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Run tao-daft convert to convert NVIDIA TAO DAFT datasets between supported formats. Do not use for non-DAFT data. Use when the user asks to convert a DAFT dataset, change DAFT format, change a TAO dataset format, or run tao-daft convert.

86 3d ago A 71 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Full PAIDF AnomalyGen pipeline — fine-tune on a new anomaly dataset, generate synthetic anomaly images (SDG), evaluate quality (nnscore), and search per-sample (guidance, cropratio) parameters. Three modes: full (Phase 0→7: finetune then generate), finetuneonly (Phase 0→1: train only), inferenceonly (Phase 0, 2→7…

86 3d ago A 163 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Run TAO Data Services image embedding to turn a parquet of image filepaths into an embedding parquet using CLIP, SigLIP, or a TAO checkpoint. Use when a workflow needs embeddings before nearest-neighbor or unique-neighbor mining, or when the user asks to "embed images", "compute image embeddings", or "generate SigLIP…

86 3d ago A 81 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Two-step image grounding pipeline: extracts referring expressions from (image, caption) pairs and grounds them to pixel-space bounding boxes via a VLM. Use when the user wants to ground captions to bboxes, generate phrase-grounded annotations, auto-label images for grounding, or run the imagegrounding pipeline.…

86 3d ago A 95 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Four-step image referring-expression pipeline: turns images plus KITTI bounding-box labels into region descriptions, scene captions, grounded referring expressions, and (optionally) verified expressions via VLM distillation. Use when the user wants to generate referring-expression annotations from images with KITTI…

86 3d ago A 143 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Multi-step video annotation pipeline that turns raw videos into Chain-of-Thought training data — multi-level captions, structured descriptions, and QA pairs (MCQ, binary, open-ended) with reasoning traces, via VLM/LLM distillation. Use when the user wants to "create video training data", "generate video QA datasets"…

86 3d ago A 134 tokens original Apache-2.0

tao-mine-aoi-images

34

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Runs the DEFT embed-then-mine workflow for VCN AOI iterations — embeds the gap-analysis target parquet, embeds a source pool, and mines nearest-neighbour source images for downstream augmentation. Use as the immediate next step after tao-route-visual-changenet-samples when expanding a real-image augmentation queue…

86 3d ago A 79 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Run TAO Data Services TMM nearest-neighbor mining from embedding parquet files. Use when a workflow needs to mine source samples closest to target samples.

86 3d ago A 39 tokens original Apache-2.0

tao-mine-od-images

36

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Run TAO Data Services TMM unique-neighbor matching mining from embedding parquet files for object detection workflows. Use when an object detection workflow needs to mine a bijectively-assigned set of unique source images closest to target samples. Use global allocation when mining without class constraints. Use…

86 3d ago A 74 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Routes the weakest VCN samples (output of tao-analyze-gaps-visual-changenet) into per-augmentation-module subsets based on each module's label eligibility. Use when the user asks to "route VCN gap samples", "split AOI gaps for k-NN mining and AnomalyGen", or prepare the immediate next step after DEFT gap analysis in a…

86 3d ago A 95 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Run tao-daft validate to check NVIDIA TAO DAFT datasets for structure, schema, and cross-reference errors. Do not use for non-DAFT formats. Use when the user asks to validate a DAFT dataset, check DAFT schema, validate a TAO dataset format, or run tao-daft validate.

86 3d ago A 77 tokens original Apache-2.0

tao-finetune-clip

39

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

CLIP vision-language model for image-text retrieval, zero-shot classification, embedding extraction, ONNX export, and TensorRT deployment. Use when fine-tuning or training CLIP, running zero-shot classification, computing image embeddings, or deploying CLIP to ONNX/TensorRT. This is a single-action model skill; do not…

86 3d ago A 104 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Cosmos-Embed1 video-text embedding for text-to-video retrieval, video-to-video search, semantic deduplication, and fine-tuning. Use when the user asks to "fine-tune Cosmos-Embed1", "run cosmos-embed inference", "export Cosmos-Embed1", "embed videos", or "search videos with text".

86 3d ago A 79 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Shared Cosmos3 frontend that explicitly routes Cosmos Framework and Cosmos-RL, validates runtime model/video-dataset/SLURM inputs, consumes an SQSH or packaged backend image, optionally plans explicit clean source builds, prepares checkpoints, validates the first update in-process, and returns token-weighted losses…

86 3d ago A 73 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

NV-Tesseract AD Diffusion — diffusion-based anomaly detection and fine-tuning for multivariate time series. Use when the user asks to "fine-tune NV-Tesseract", "run AD diffusion inference", "detect anomalies with diffusion", "time series anomaly detection", "finetune ad-diffusion", "use…

86 3d ago A 148 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

NV-Tesseract Forecasting — transformer-based multivariate time series forecasting with DARR (context-enhanced kNN retrieval), interpretability, and fine-tuning. Use when the user asks to "forecast with NV-Tesseract", "run forecasting inference", "use performforecasting", "DARR mode", "context-enhanced forecasting"…

86 3d ago A 144 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

InternVideo2-CLIP L14 (TAO videoclip) for video-text retrieval, zero-shot classification, embedding extraction, LoRA fine-tuning, ONNX export, and TensorRT deployment. Use when the user asks to "fine-tune IV2CLIP", "run videoclip train/evaluate/inference/export", "build a Video-CLIP TensorRT engine"…

86 3d ago A 111 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Action recognition from video sequences. Supports RGB, optical flow, and joint (multi-stream) input types for classifying temporal actions in video clips. Use when training, evaluating, exporting, or running inference on a TAO action-recognition model. Trigger phrases include "train action recognition", "video action…

86 3d ago A 84 tokens original Apache-2.0

tao-train-bevfusion

46

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

BEVFusion for multi-sensor 3D object detection. Fuses LiDAR point clouds and camera images in bird's-eye-view (BEV) space, used in autonomous driving for robust 3D perception. Use when training, evaluating, or running inference for a TAO BEVFusion model. Trigger phrases include "train BEVFusion", "LiDAR + camera…

86 3d ago A 103 tokens original Apache-2.0

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

CenterPose for keypoint / pose estimation. Detects object centers and regresses keypoint locations for 6-DoF object pose estimation. Use when training, evaluating, exporting, or running inference for a TAO CenterPose model. Trigger phrases include "train CenterPose", "6-DoF object pose", "keypoint estimation", "object…

86 3d ago A 81 tokens original Apache-2.0

tao-train-codetr

48

NVIDIA-TAO/tao-skill-bank

Skill Claude CodeCodex

Co-DETR (CoDINO) for object detection. A DETR-family detector with collaborative hybrid assignment — auxiliary one-to-many heads supervise the encoder during training, giving strong closed-set accuracy at high inference cost. Use when training, evaluating, or running inference for a TAO Co-DETR model. Trigger phrases…

86 3d ago A 107 tokens original Apache-2.0