Plugins

Full-duplex voice mode for the DeepSeek Harness Web UI: toggle (2s-pause auto-send) or hold-to-talk dictation into an editable draft with zipformer2 streaming ASR, optional wake word; sentence-by-sentence Edge TTS read-aloud with live captions, and speaking interrupts playback and the running turn (true barge-in). On-device ASR, no API key.

Voice input for the web UI: dictation chunked by pauses and voice messages, each with its own provider fallback chain (Deepgram, Groq, HuggingFace, local whisper.cpp, or an OpenAI-compatible endpoint).

Full-duplex voice mode for the Web UI: tap-to-toggle or hold-to-talk dictation (send key or `Ctrl`) with a live caption, host-side SenseVoice ASR via sherpa-onnx, sentence-by-sentence spoken replies, and speaking interrupts playback and the running turn (true barge-in). No API key.

Hold-to-talk dictation in the composer that ships no recognizer of its own and reuses the speech service the official voice-input bundle already mounts - long-press the input box with mouse or touch, release to write the transcript into the draft, slide up to cancel, and it never sends.

One-handed, keyboard-free input for the composer: press and hold the mouse on the input box, speak, release — the text lands in the draft, and sliding up cancels without leaving a half sentence behind. No mic button to aim at and no shortcut to remember; the hand never has to leave the input area, which is the point when the other hand is busy. Recognition runs fully offline (SenseVoice via sherpa-onnx, no API key, audio never leaves the machine).

Voice assistant for dsh web: say the wake phrase (e.g. "小鲸") to activate hands-free dictation — what you say is transcribed and typed into the chat box automatically. Supports spoken edit commands (send, clear, new line, stop reading) and reads assistant replies aloud in Chinese. Speech recognition runs locally in-browser via sherpa-onnx WASM, so it works offline without an API key.

Voice input for the Web UI: a mic button that drives local VocoType offline speech recognition and auto-inserts recognized text into the composer (auto-deploy, dedupe, continuous dictation).

Adds a terminology-aware correction pass to the built-in local speech-to-text: keeps DSH's own microphone and SenseVoice engine (audio never leaves the machine) and fixes homophones, domain terms and malformed numbers in the finished transcript.

English word bank for one or more children, built for DSH 0.2 and newer (0.2.0-rc.1 and 0.2.0-rc.2 verified, including the desktop shell; 0.1.7 through 0.2.x all work). 1.10 added pronunciation: in the memory cards and in the online quiz every word and every example sentence has a speaker button that reads it aloud with the built-in Windows voice - offline, with no network call and no model call - and the whole batch of audio is pre-rendered in the background whenever cards or an exam are generated, so a click starts instantly. 1.11 adds: pick words in bulk straight from the library (10 at a time, top-down, up to 50 selected, with a live counter); turn the words a child got wrong in a quiz into a one-click review set - an online card page that speaks plus a printable PDF; and every card example sentence now carries its Chinese translation underneath. Words marked on textbook or workbook photos (highlighter, red pen) are found by their marks, then translated and stored in a local SQLite bank with an occurrence count; the clipboard picker, the photo route and dictation all land in the same bank. High-frequency words surface by count, three correct answers in a row flag a word as learned, and any selection prints as a memory card set (a word split into chunks, real IPA per chunk, a grade-7 example sentence, a mnemonic hook, an A4 sheet of eight) in HTML, PDF or Word, with a print-and-answer exam page whose four options are set against each other for meaning. On 0.1.5 the settings panel does not appear - install dsh-word-vault@1.0.2 instead.

Live speech-to-text dictation into the dsh web composer via OpenRouter STT

Read-aloud and dictation for the DSH web UI with 23 TTS and STT provider types configured side by side, per-language routing, in-text language markers, per-sentence language detection, word highlighting and a TTS Reader sidebar tab (the tab requires dsh-better-sidebar; everything else works without it).

Dictation that ends up in the repository instead of the chat log: hold the button (or import a WAV), and the plugin archives voice-memos/<id>/ with audio.wav, a rendered waveform.png, memo.md (frontmatter, per-segment timestamps, ready-to-paste quote blocks) and meta.json. Audio is resampled to 16 kHz mono in the browser before it is sent. Transcription stays local — the harness speechToText service with silence-split windows, or a command worker such as faster-whisper — and when no engine is available the memo is still filed with an explicit status and reason rather than a fabricated transcript. Ships a conversation-view 口述 tab with click-to-seek playback and per-segment quote copy, three agent tools (voice_memo_save / voice_memo_list / voice_memo_read) and HTTP routes. Zero runtime dependencies, 52 node:test cases, real screenshots in docs/.

Push-to-talk dictation for the Web composer: hold a hotkey to record and the transcript is written into the draft through DSH's own speech Remote (local SenseVoice), with an optional auto-send.

MiMo voice for DeepSeek Harness — reads each finished answer aloud, turns composer dictation into text, and offers nine built-in voices plus a cloned-voice slot.

DSH voice input plugin: browser realtime + VAD dictation + local/cloud ASR + DeepSeek AI polish

Editable local and desktop dictation for DeepSeek Harness

Dictate prompts into the DeepSeek Harness Web Client — a microphone in the composer, with swappable transcription: hosted Whisper API, self-hosted server, or a fully offline whisper.cpp binary.

Browser Web Speech dictation for the Composer: recognition needs no dedicated ASR server, key, or model download; reuses Session text and a configured DSH model for contextual phrase hints and optional transcript polishing.