audio-to-subtitles

Audio To Subtitles

Use this skill to:

• turn local audio/video files or public media URLs into subtitle files through AI MediaKit;
• turn text into MiniMax TTS audio;
• optionally generate subtitles from the TTS audio in the same run.

Workflow

For media inputs:

1. If the input is a local file, upload it to Cloudflare R2 first.
2. Submit the public audio_url or video_url to AI MediaKit ASR subtitles.
3. Poll the async task until it is completed or failed.
4. Save .json, .srt, and .vtt outputs.

For local video-engine projects:

1. If the media belongs to a talking-head-hyperframes project under <VIDEO_WORKSPACE>, save subtitles under that project's work/captions/.
2. Use captions.srt and captions.vtt as the main cleaned files, keep raw ASR backups as captions.raw.srt and captions.raw.vtt, and keep the MediaKit payload as asr-result.json.
3. Also write captions_aligned.json parsed from the cleaned SRT so video-script, talking-head-hyperframes, and hyperframes-scene-animator share the same locked timeline.
4. The project-local output convention is:

<VIDEO_WORKSPACE>/<project>/work/captions

For text inputs:

1. Generate audio through MiniMax TTS.
2. Save the audio file.
3. If --subtitles is set, upload the audio to R2 and run the same AI MediaKit subtitle workflow.

CLI

# Set this to the directory containing this installed skill (not the current working directory).
SKILL_DIR="<SKILL_ROOT>/audio-to-subtitles"

# Local audio/video: upload to R2, then transcribe
npx -y bun "$SKILL_DIR/scripts/main.ts" audio.mp3 --language zh-CN --out-dir subtitles

# Existing public URL: skip R2 upload
npx -y bun "$SKILL_DIR/scripts/main.ts" "https://example.com/audio.mp3" --out-dir subtitles

# Batch files/URLs
npx -y bun "$SKILL_DIR/scripts/main.ts" a.mp3 b.m4a "https://example.com/video.mp4" --out-dir subtitles

# Batch from manifest
npx -y bun "$SKILL_DIR/scripts/main.ts" --manifest inputs.txt --out-dir subtitles

# Speaker diarization
npx -y bun "$SKILL_DIR/scripts/main.ts" interview.mp3 --speaker --language zh-CN

# Text to audio only
npx -y bun "$SKILL_DIR/scripts/main.ts" --text "你好，欢迎收听。" --voice-id female-shaonv --out-dir audio

# Text file to audio + subtitles
npx -y bun "$SKILL_DIR/scripts/main.ts" --text-file script.md --subtitles --language zh-CN --out-dir audio