Plugins

Transforma um vídeo (ficheiro local ou ligação Bilibili/yt-dlp) numa grelha de storyboard navegável: células numeradas, marcas temporais exatas, transcrição por célula e envelope de áudio na mesma linha temporal. video_zoom volta a ler qualquer intervalo com maior resolução, para que um modelo apenas de texto possa examinar o vídeo em vez de ler um resumo.

Fork de alto desempenho do SAOS-3624/dsh-video-storyboard: instale este plugin ou o upstream, nunca ambos. Converte vídeo em grades de storyboard endereçáveis (células numeradas, timestamp e linha da transcrição por célula, envelope de áudio). Requer Node 20+ e ffmpeg/ffprobe no PATH; se o arquivo não tiver faixa de legendas, exige endpoint ASR configurado.

Five tools for reading a video as raw material rather than as something to watch. video_outline maps a whole file as text and draws nothing at all: 4-60 equal windows, each with its cut count, speech share, intensity bar and tags, then the windows worth opening and the exact start/end for the call that follows -- zero image tokens. video_probe returns metadata and a reading plan without decoding frames. video_storyboard turns a window into one contact sheet plus a text index binding every cell to its timecode, cut count and frame time; cells whose text would be illegible at that scale are marked zoom, and dedupe global folds a picture that comes back after a cut. video_zoom re-renders 1-9 cells from a short window at a larger scale. video_read decodes only keyframes, OCRs each screen, and returns an outline plus \[mm:ss] text -- the path for lectures, slide decks and screen recordings, where the words are the content. It also reads a file with sound and no picture as a transcript (subtitle track, then DSH_ASR_CMD, then a transcript file you pass; long audio is cut at 45 s onto silence), composes six changed frames into one sheet when a file has no readable text at all, and can write the result out as SRT, WebVTT or text. Cuts, dissolves and one-frame flashes are found in a single ffmpeg pass; from ten minutes up a file is analysed on its keyframes only, 2.7x faster on a two-hour lecture; and a cell is never shrunk below a fifth of the source, so a 1440p sheet spends the same tokens on fewer, bigger cells. OCR is the engine Windows ships, tesseract with line boxes, or DSH_OCR_CMD. It takes a B station link (bilibili.com/video/BV..., a bare BV id, an av id or a b23.tv short link) wherever it takes a file: up to 300 seconds is read from the CDN in place with nothing written to disk, longer videos are downloaded once and cached within a 4 GB / 24 video budget, play URLs are cached for ten minutes, and a link that is not a single video says what it is. Needs ffmpeg, uses ffprobe when present, and has no other runtime dependencies. It is a wire-compatible reimplementation of SAOS-3624/dsh-video-storyboard: it registers the same video_probe / video_storyboard / video_zoom tool names, so the two cannot be enabled together.