video-understanding

video-understanding is a skill for Claude Code from zenstory-ai/oh-story-dsh. It costs 126 tokens per session (1,140 once invoked), scanned A, a copy of video-understanding, MIT.

A video-analysis tool that detects scenes, transcribes speech, examines visual frames, finds silent periods, and combines the results into a timeline and writing brief.

In plain words
What is it for?
Use it to understand, index, summarise, or prepare narration and other creative work from a video.
Why use it?
It turns a video into structured information, so later work does not require repeatedly watching the source to find scenes, dialogue, or important moments.

Skill for Claude Code

Written for Claude Code: user-invocable in frontmatter.

Good fit Use it to understand, index, summarise, or prepare narration and other creative work from a video.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/zenstory-ai/oh-story-dsh/video-understanding
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add zenstory-ai/oh-story-dsh --skill video-understanding
Clone the repo
git clone --depth 1 https://github.com/zenstory-ai/oh-story-dsh

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for video-understanding

README.md
[![agentmods](https://agentmods.dev/badge/skills/zenstory-ai/oh-story-dsh/video-understanding/github.svg)](https://agentmods.dev/skills/zenstory-ai/oh-story-dsh/video-understanding)
Your own site
<a href="https://agentmods.dev/skills/zenstory-ai/oh-story-dsh/video-understanding"><img src="https://agentmods.dev/badge/skills/zenstory-ai/oh-story-dsh/video-understanding/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for video-understanding

Your own site · 80×15
<a href="https://agentmods.dev/skills/zenstory-ai/oh-story-dsh/video-understanding"><img src="https://agentmods.dev/badge/skills/zenstory-ai/oh-story-dsh/video-understanding.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 126 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,140 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin 100% copy Near-identical to another mod in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00126 $0.01140
Opus 5 $0.00063 $0.00570
Sonnet 5 $0.00025 $0.00228
Haiku 4.5 $0.00013 $0.00114

Measured 7d ago against content hash 86c395f032d9, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-12, from the pricing page.

Security

Grade A, and why

video-understanding scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

The scan reads SKILL.md. This mod also ships 22 executable files (scripts/agent_brief.py, scripts/agent_text.py, scripts/asr.py, …), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

This is a copy

100% identical to video-understanding — 0 lines differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.

packages/knowledge/video-recap/skills/video-understanding/SKILL.md · 76 lines

What it actually says

1. 定位

本技能把源视频转成 Agent 与下游阶段可读取的理解索引。它的创作角色是素材观察员 / 场记,不是导演:

  • 先观察,再解释;事实与推断分开。
  • 除了“发生了什么”,还要让下游看见知识、权力、目标、关系或情绪在哪一刻变化。
  • 标出由谁的 POV 承载变化、哪个反应或表演不可替代,以及哪里存在完整台词/动作的自然剪辑边界。
  • 证据不足时保留不确定性,不制造戏剧结论。

2. 处理阶段

  1. 场景检测:写 scenes.json,包含切点、时长和废片段过滤结果。
  2. 抽帧:为视觉分析提取代表帧。
  3. ASR:通过 mimo-v2.5-asr 写时间戳对白 asr_result.json
  4. 静音检测:写 silence_periods.json,标注安静窗口与 has_speech
  5. VLM 观察:写 vlm_analysis.json,包含场景描述、深层分析和 frame_facts
  6. 时间线融合与创作 brief:写 timeline_fusion.jsonasr_writing_chunks.jsonagent_narration_brief.md

各阶段只有在输出产物与 provenance sidecar 同时匹配当前视频及影响结果的设置时才会复用;--force 强制重算。

3. 环境要求

# ffmpeg: brew install ffmpeg | apt install ffmpeg | choco install ffmpeg
export MIMO_API_KEY=***

ASR 使用 mimo-v2.5-asr;VLM 使用 mimo-v2.5--skip-asr 可跳过对白转写,但完整理解仍需要 MIMO_API_KEY 运行 VLM。--mimo-video-overview 可开启按场景块的视频概览。

work_dir/background_research.json 存在,本技能会把剧情梗概和角色名折入 VLM 上下文;--context 可补充一条简短提示。

下面的 scripts/... 均相对于本技能目录。若执行器从仓库根目录启动,请给脚本路径加上本技能的绝对目录。脚本不从其他技能目录读取文件;外部输入仅限命令显式传入的视频、参数与 work_dir 产物。

4. 运行命令

python3 scripts/understand.py <video> --work-dir <work_dir> \
  [--context "节目名/角色名"] [--scene-threshold 0.1] [--skip-asr] [--mimo-video-overview] [--force]

5. 输出契约

文件 内容
scenes.json 场景切点、起止时间与时长
asr_result.json [{start, end, text}] 时间戳对白
vlm_analysis.json 逐场景描述、深层分析与 frame_facts
silence_periods.json [{start, end, duration, has_speech}] 安静窗口
timeline_fusion.json VLM、ASR 与静音信息的统一时间线
asr_writing_chunks.json 按句界和场景切分的 ASR 写作块
agent_narration_brief.md Agent 首先阅读的创作简报

后续写作阶段根据创作简报与索引制定方案并写 narration.json

6. 参考资料

  • 背景调研:references/research-guide.md,产出 background_research.json
  • JSON 结构:references/data-schema.md

7. 能力边界

  • 不写解说词,也不做解说评分;只负责生成理解索引与创作简报。
  • 不剪辑、不配音、不合成视频。
  • 不编造信号无法支持的剧情;当 ASR / VLM 过薄时输出素材警告。
  • 不发布、不调度,只向 work_dir 写产物并停止。
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 76 lines · 126 tokens per session scan A 86c395f032d9

Subscribe to this mod's changes

video-understanding is a skill published in the GitHub repository zenstory-ai/oh-story-dsh (338 stars, last pushed yesterday), licensed MIT. It adds 126 tokens to every session and 1,140 once invoked, about $0.0006 per session on Opus 5. A static security scan graded it A with 0 findings. It is 100% identical to video-understanding, differing in 0 lines, and is treated as a copy.

Related

Other skills, from other repositories

story-long-analyze

A long-form fiction analysis workflow for breaking down a novel’s opening chapters, characters, pacing, turning points, relationships, and overall structure.

zenstory-ai/oh-story-claudecode · 173 tokens

story-deslop

A writing editor for Chinese web novels that detects writing patterns often associated with AI-generated text and makes the prose feel more natural.

zenstory-ai/oh-story-claudecode · 62 tokens

story-short-analyze

A Chinese-language guide for analysing short popular web fiction, such as stories published on 番茄, 故事会, or 知乎盐选. It examines the core premise, plot structure, emotional arc, twists, writing techniques, and reader appeal.

zenstory-ai/oh-story-claudecode · 226 tokens

browser-cdp

Use this skill when you need to control a Chrome browser via CDP (Chrome DevTools Protocol) to reuse existing login sessions. Covers: launching Chrome in debug mode, opening URLs, waiting for page load, evaluating JavaScript, taking snapshots, and extracting auth tokens. Trigger phrases: browser automation, CDP…

uu201/character-arc · 94 tokens

novel-language-style

A guide to choosing and controlling the writing style of online fiction. It covers narration, word choice, figurative language, dialogue, and techniques for making scenes easier to picture.

uu201/character-arc · 102 tokens

style-fingerprint

A Chinese-language system for measuring the writing style of a novel from a sample of its text. It records patterns in viewpoint, timing, sentences, word choice, dialogue, description, themes, and chapter structure.

uu201/character-arc · 70 tokens