Plugins

Análisis de vídeos de Bilibili: metadatos, transcripción (con respaldo ASR vía Bijian/sherpa-onnx/whisper.cpp), comentarios, danmaku y fotogramas clave nítidos con descripciones de visión local opcionales.

Full-duplex voice mode for the Web UI: a composer mic (RMS endpoint detection) transcribes speech with whisper running locally in the browser, assistant replies stream back as spoken audio sentence-by-sentence, and speaking interrupts playback and the running turn (true barge-in). No API key.