플러그인

동영상(로컬 파일 또는 Bilibili/yt-dlp 링크)을 번호와 정확한 타임스탬프가 있는 참조 가능한 스토리보드 그리드로 변환합니다. 각 셀에는 같은 시간선의 대본과 오디오 엔벌로프가 표시됩니다. video_zoom은 원하는 구간을 고해상도로 다시 읽어 텍스트 전용 모델도 요약만 읽는 대신 동영상을 살펴볼 수 있게 합니다.

SAOS-3624/dsh-video-storyboard의 고성능 fork입니다. 이 플러그인과 upstream 중 하나만 설치하세요. 영상을 주소 지정 가능한 스토리보드 그리드(번호 셀, 셀별 타임스탬프와 대사 줄, 오디오 엔벌로프)로 변환합니다. Node 20+와 PATH의 ffmpeg/ffprobe가 필요하며 영상에 자막 트랙이 없으면 설정된 ASR endpoint도 필요합니다.

Five tools for reading a video as raw material rather than as something to watch. video_outline maps a whole file as text and draws nothing at all: 4-60 equal windows, each with its cut count, speech share, intensity bar and tags, then the windows worth opening and the exact start/end for the call that follows -- zero image tokens. video_probe returns metadata and a reading plan without decoding frames. video_storyboard turns a window into one contact sheet plus a text index binding every cell to its timecode, cut count and frame time; cells whose text would be illegible at that scale are marked zoom, and dedupe global folds a picture that comes back after a cut. video_zoom re-renders 1-9 cells from a short window at a larger scale. video_read decodes only keyframes, OCRs each screen, and returns an outline plus \[mm:ss] text -- the path for lectures, slide decks and screen recordings, where the words are the content. It also reads a file with sound and no picture as a transcript (subtitle track, then DSH_ASR_CMD, then a transcript file you pass; long audio is cut at 45 s onto silence), composes six changed frames into one sheet when a file has no readable text at all, and can write the result out as SRT, WebVTT or text. Cuts, dissolves and one-frame flashes are found in a single ffmpeg pass; from ten minutes up a file is analysed on its keyframes only, 2.7x faster on a two-hour lecture; and a cell is never shrunk below a fifth of the source, so a 1440p sheet spends the same tokens on fewer, bigger cells. OCR is the engine Windows ships, tesseract with line boxes, or DSH_OCR_CMD. It takes a B station link (bilibili.com/video/BV..., a bare BV id, an av id or a b23.tv short link) wherever it takes a file: up to 300 seconds is read from the CDN in place with nothing written to disk, longer videos are downloaded once and cached within a 4 GB / 24 video budget, play URLs are cached for ten minutes, and a link that is not a single video says what it is. Needs ffmpeg, uses ffprobe when present, and has no other runtime dependencies. It is a wire-compatible reimplementation of SAOS-3624/dsh-video-storyboard: it registers the same video_probe / video_storyboard / video_zoom tool names, so the two cannot be enabled together.