Auto-Generating Bilingual Video Subtitles with Claude Code and Publishing via IIIF v3 Manifests
Adding subtitles to video content is time-consuming work. This article introduces how to efficiently generate multilingual subtitles (VTT) from video frame analysis to IIIF v3 manifest creation using Claude Code (CLI version of Claude). For the actual project, see the project introduction article. Overall Workflow 1. Prepare a video file (mp4) 2. Detect scene changes with ffmpeg 3. Extract frames at scene change points 4. Read frame images with Claude Code to understand content 5. Create VTT files based on scene change timestamps 6. Create English subtitles similarly 7. Create IIIF v3 manifests 8. Sync video, subtitles, and speech in HTML player Prerequisites Claude Code (CLI version) ffmpeg / ffprobe Video file (mp4) to add subtitles to # macOS brew install ffmpeg Step 1: Scene Change Detection Auto-detect the timing of screen transitions in the video. These become the basis for subtitle timestamps. ...
