NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
This repository also configures its own agents. See what video-search-and-summarization tells them →
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Cursor
Update the BDD test container image when its dependencies or runtime change. Determines version bump (major vs minor vs patch), rebuilds the Docker image, pushes to GitLab registry, and updates the image tag in starttest.sh. Test source (tests/, features/, scripts/, data/, conftest.py) is bind-mounted from the host…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Routes VSS video questions through hot conversation context, stored memory, bounded introspection, or an exact-window vss vlm run CLI job, including a user-confirmed vss-search-archive handoff with a pre-resolved bounded VIDEOURL. Not for retrieval or metadata-answerable questions.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when deploying standalone RT-VLM dense captioning or calling its REST API (uploads, captions, streams, chat-completions, Kafka). Not for VSS profile deploy or video-search ingestion.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when the user wants to deploy, run, debug, tear down, or call the REST API of the RTVI-CV 2D detection / tracking microservice. Trigger when the user says things like 'deploy rtvi-cv', 'start warehouse 2d', 'add a stream', 'check rtvi-cv health', or 'stop the perception container'. Not for VLM…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use when deploying or operating standalone RTVI-CV-3D / MV3DT multi-camera 3D tracking for calibrated MP4/file inputs and live RTSP streams: missing-calibration handoff to AMC skills, the 4-camera sample dataset, camera config, BEV Fusion, live OSD or saved grid/BEV outputs, bundled brokers, basic external MQTT/Kafka…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use when the user asks to select, configure, deploy, verify, debug, or tear down a VSS profile (base, search, lvs, warehouse, edge). Not for standalone microservices — use the vss-deploy- skill.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when deploying, operating, integrating, or customizing the VSS RT-Embed Video Embedding microservice. Covers standalone Docker Compose deployment, the /v1 REST API for text/video embeddings and live streams, Redis/Kafka/OTel integration, troubleshooting, and bring-your-own-model (BYOM) custom embedding…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when running AutoMagicCalib on local MP4s, RTSP, or the bundled sample dataset, or when deploying vss-auto-calibration. Do not use for non-AMC calibration or runtime analytics.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Generates VSS video summary reports with LVS HITL and optional Enterprise RAG document grounding. Trigger when the user asks for a frag/RAG-assisted video report, knowledge-enhanced analysis, or Enterprise RAG context in a video summary.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill CodexCursor
Configure the Docker Compose webhook receivers required by the VIOS webhook notification BDD tests, including the custom body template cases. Use when preparing deployment/stream-processing/docker-compose/configs/notificationconfig.json for testwebhooknotifications.py or testwebhookcustombody.py, or when those tests…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Benchmark a deployed LVS instance — set up test media, run single-file latency and burst-throughput tests, analyze GPU and latency metrics, and get configuration recommendations to improve performance.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use when the user asks to deploy, upgrade, or size the VSS warehouse blueprint (2D / 3D / MV3DT) on Kubernetes via Helm — as opposed to Docker Compose, which is covered by vss-deploy-profile's warehouse reference. Handles GPU-aware NUMSTREAMS capping so the deployment matches what the perception pipeline can actually…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill to deploy the vss-behavior-analytics service standalone (entrypoint, config-source, optional calibration). Not for the full warehouse deploy.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use to deploy the vss-video-analytics-api REST service standalone with its Elasticsearch ingest-pipeline, selectable Kafka/Redis stream type, and Kafka-topic readiness gates when Kafka is selected. Not for full warehouse deploy.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when producing a VSS analysis report — Mode A per-clip VLM, Mode B incident-range via video-analytics, Mode C SOP compliance via the SOP tools. Not for standalone video summarization, real-time alerts or ad-hoc Q&A.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when operating VSS alert workflows — real-time monitoring, Alert-Bridge subscriptions, verification verdicts, on-demand verification, always-on operation, Slack notifications, incident queries, or camera onboarding. Not for non-alert analytics.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use to call the VIOS REST API (sensor list, timelines, clip extraction, snapshots, add/delete sensors and streams) and to provision a source and fan it out to a headless (no-agent) build's perception consumers (RT-CV/RT-Embed/RT-VLM). Not for VLM inference, semantic search, or agent-backed ingestion.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when reading video-analytics metrics, incidents, alerts, and sensor data via VA-MCP (Docker :9901 or Kubernetes ${VSSPUBLICURL}/va-mcp). Not for live VLM or incident-range narrative reports.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use this skill when a user wants to search archived VSS video or ingest or delete a source for search. Do not use it for visual Q&A, live captioning, or video summarization.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Use when summarizing a recorded video through HITL-gated LVS, with an explicitly approved VLM fallback. Not for reports, archive search, or live RTSP captioning.
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Add agent-ready vision capabilities — dense captioning, detection, search, alerting, summarization — to an agent or application through a customizable, self-contained vision stack built on the NVIDIA VSS Blueprint. Use this skill when a developer or agent wants to give their app vision: pick capabilities via guided…
NVIDIA-AI-Blueprints/video-search-and-summarization
Skill Claude CodeCodex
Benchmark video Q&A accuracy and latency of a deployed RT-VLM (Cosmos Reason 3) via vss vlm run, using questions and videos from the DSS vss-devx-base dataset. Replaces the deprecated nat eval / vss-agent QA path. Not for tool-calling or trajectory evaluation, and not for LVS summarization throughput.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: