Idsh-video-understand
ilps2/dsh-video-understand
Low-cost video understanding tool: a video_understand tool turns a Bilibili link / BV / local video into an AVIS info layer (ASR + scene structure + object tracks + YOLO labels) and returns summary + Q&A. Question-driven dynamic routing across layers (L0 ASR / L1 object tracks / L2 key-frame VLM), semantic-layer reuse for repeat questions, per-question budget cap. Python engine: core layer needs faster-whisper / opencv / yt-dlp (~200-300MB); the optional semantic layer adds ~2GB of torch / transformers / ultralytics. A bundled doctor --fix sets up the venv and installs both.
8last monthTools & Capabilities