Plugins

Análise de vídeos do Bilibili: metadados, transcrição (fallback de ASR via Bijian/sherpa-onnx/whisper.cpp), comentários, danmaku e keyframes nítidos com descrições de visão local opcionais.

Full-duplex voice mode for the Web UI: a composer mic (RMS endpoint detection) transcribes speech with whisper running locally in the browser, assistant replies stream back as spoken audio sentence-by-sentence, and speaking interrupts playback and the running turn (true barge-in). No API key.