Skip to main content

Vision, Voice & Multimodal

Vision, Voice & Multimodal plugins give the text-only DeepSeek models in DeepSeek-Harness (dsh) eyes, ears, and a voice. Find vision tools and provider routes that OCR and describe pasted screenshots via Zhipu GLM, Gemini, Doubao, or local Ollama, microphone voice input via the browser Web Speech API or Whisper-compatible APIs, read-aloud TTS with Edge TTS or custom voices, full-duplex voice modes, and generators for images, video, and music.

610 plugins found

O

dsh-paddle-ocr

omdsh-dev/dsh-paddle-ocr

33 months agoVision, Voice & MultimodalBSD-3-Clause
H

dsh-plugin-aigc-canvas

huanlinoto/dsh-plugin-aigc-canvas

provider-agnostic AIGC HTTP 桥 + 无限画布 + ffmpeg 后处理,13 个工具含画布连边/reroll/媒体编辑 | Provider-agnostic AIGC HTTP bridge + infinite canvas + ffmpeg post-processing; 13 tools incl. canvas linking/reroll/media-edit

33 months agoVision, Voice & Multimodal
J

dsh-voice

jesse-njx/dsh-voice

Voice notes in, spoken answers out: dictate audio that becomes user messages (transcribe), have the agent read replies aloud (speak), local-first under ~/.dsh/voice.

33 months agoVision, Voice & MultimodalMIT
E

dsh-llm-vision-bridge

einskyle/dsh-llm-vision-bridge

Native LLM-provider vision bridge: images pasted in the chat are described by a vision model (Qwen3-VL via pi-ai/llama.cpp) and the text description is fed to text-only DeepSeek for the reply — image admission, routing and compaction all run through harness-native mechanisms, with an LRU description cache and 503 retry.

3last monthVision, Voice & MultimodalMITArchived
Q

dsh-mic-input

qt-chen/dsh-mic-input

Microphone voice input for the composer: browser Web Speech API live transcription, dedupe/auto-continue, smart punctuation, language and auto-send settings.

33 months agoVision, Voice & MultimodalMIT
A

dsh-ppt-image-studio

amesawa-000/dsh-ppt-image-studio

Configures an OpenAI Images-compatible or Gemini image API in Settings, and adds agent tools that write prompts, generate illustrations for presentation slides, and return the original local image paths.

25 days agoVision, Voice & MultimodalMIT
J

voice_for_dsh

junarch/voice_for_dsh

DSH web plugin: read aloud each DeepSeek turn output after spoken-style transcription (code/table/markdown aware), with per-message manual read buttons and an auto-read toggle.

26 days agoVision, Voice & MultimodalMIT
P

dsh-sound-atelier

puffdog-git/dsh-sound-atelier

Reads assistant replies aloud using Edge, cloud and local speech engines, with per-persona voices, Chinese/Japanese dubbing, cloud voice management, RVC voice conversion and a speech API other plugins can call.

26 days agoVision, Voice & MultimodalMIT
F

dsh-teardown-studio

feely0208/dsh-teardown-studio

DeepWhale Teardown Studio: upload a pre-separated 3D model, render a teardown video locally.

217 days agoVision, Voice & MultimodalMIT
C

dsh-big-fish-speak

chaowei08/dsh-big-fish-speak

Makes the dsh-pet desktop pet read model replies aloud in its own configured voice. Newer dsh-pet gets the whole text in one request (up to its 500-char cap); older versions automatically fall back to 60-char chunks. Each piece is verified against the pet log to confirm it actually played.

210 days agoVision, Voice & MultimodalMIT
E

dsh-breeze-tts

eslaykey/dsh-breeze-tts

Breeze Blue text-to-speech for DeepSeek Harness: agent tools, reply playback, voice design and a settings page.

223 days agoVision, Voice & MultimodalMIT
S

dsh-recorder-card

synswarm/dsh-recorder-card

Development-preview DSH plugin to import recordings from compatible BLE recorder cards, with optional transcription and fingerprint-linked archives. Requires recorder hardware, Host Bluetooth and Python dependencies.

220 days agoVision, Voice & MultimodalMIT
T

dsh-littlestar-anything-voice

theskywilldawn/dsh-littlestar-anything-voice

Click the chibi mascot and it reads the assistant reply aloud through your local IndexTTS 2.5 install. One character = one reference clip; a missing portrait just shows a placeholder. Ships no voices or artwork — the library lives on the user's own machine. Requires a local IndexTTS 2.5 install.

220 days agoVision, Voice & Multimodal
J

voice_for_dsh (voice-for-dsh)

junarch/voice_for_dsh

Reads each reply aloud in natural spoken language, summarizing structured content such as tables and code blocks, with an adjustable script length — from detailed narration close to the source length down to a minimal briefing. Engines: system TTS, the DeepSeek TTS API, Doubao (dialects and expressive delivery), or the local Kokoro model, which synthesizes offline in-process. It also provides three session sounds — a repeating tone while the agent works, a completion tone at the end of a turn, and a question tone when it needs your answer; built-in tones can be switched and custom audio uploaded, with files kept on the local machine.

26 days agoVision, Voice & MultimodalMIT
M

dsh-synthv-studio

making-acid/dsh-synthv-studio

Connects a local Synthesizer V Studio 2 Pro to the agent through its own Lua script API, with five tools for discovery, a persistent bridge, voice composition, note editing and DAW (VST3/ARA + MIDI) integration. Windows 10/11 only; requires Synthesizer V Studio 2 Pro 2.1.2+ with a project open.

213 days agoVision, Voice & MultimodalApache-2.0
C

dsh-model-vision

charovo0059/dsh-model-vision

Fills in the vision capability that DSH's "fetch models" step drops, so image-capable models stop being declared text-only, and marks them in the model name.

226 days agoVision, Voice & MultimodalMIT
S

dsh-imagegen

say007go/dsh-imagegen

DSH text-to-image/image-to-image plugin: compatible with OpenAI-style image generation APIs, with 多米API as the default; standard OpenAI endpoints may require protocol, image-to-image mode and size adjustments; text-to-image and URL reference images do not use COS, while local reference images can be compressed and stored in COS; custom prompt suffixes are supported.

226 days agoVision, Voice & MultimodalMIT
N

dsh-gptsovits-tts

nuoyi207/dsh-gptsovits-tts

Local GPT-SoVITS text-to-speech for DSH: reads replies aloud, switches voices from the right sidebar, and trains a new voice from a dropped audio sample. First run downloads an 11.4 GB engine and needs an NVIDIA CUDA GPU.

229 days agoVision, Voice & Multimodal
T

dsh-video-vision

tests4gptplay/dsh-video-vision

Give DSH AI timestamped video frames, audio and lyric analysis for Bilibili, YouTube and local files, with encrypted browser-session import, continued viewing, saved site resolvers and native cache management. Requires FFmpeg and ffprobe on PATH or configured in the plugin settings.

212 days agoVision, Voice & MultimodalMIT
N

dsh-screenshot-xn

ntesicn/dsh-screenshot-xn

Full-screen screenshot panel for the DSH composer: marquee selection with rectangle, ellipse, arrow, pen, mosaic and text annotation, then insert into the conversation, copy or save. The selected region can also be recognized offline — PP-OCRv6 through onnxruntime-node, falling back to the built-in Windows OCR engine — and translated into nine languages with the model already configured in DSH. On Windows the marquee covers the whole screen including the taskbar and hides the DSH window first, so the capture is of the real desktop. The panel runs in an Edge or Chrome kiosk window, and falls back to an in-DSH capture flow when no browser can be launched. Note that DSH Desktop denies ordinary browser access by default, so the full-screen panel also needs "Allow opening this Profile in a browser" (compatibility mode) enabled in the profile settings; without it every capture goes through the in-DSH fallback. Windows only (DSH Desktop); the PP-OCRv6 models are downloaded from ModelScope on first recognition.

2last monthVision, Voice & Multimodal
A

dsh-audiobook

aicivilization/dsh-audiobook

Search public-domain libraries (Project Gutenberg, Wikisource, Internet Archive, Standard Ebooks) by title, author, character or half-remembered plot, or import EPUB / PDF / TXT / DOCX / Markdown, and listen in the sidebar with Microsoft Edge neural voices, offline Kokoro or the device voices; keeps your position, takes voice notes anchored to what you just heard, and discusses the book with your DSH model.

29 days agoVision, Voice & MultimodalMIT
Y

dsh-image-lite

yupaoa/dsh-image-lite

Image generation for DSH in two modes — an image_generate_lite tool the model calls from chat, and a right-sidebar studio for manual runs; up to five reference images, the OpenAI images API format, keys kept in the DSH credential service.

23 days agoVision, Voice & MultimodalMIT
H

imgpost

hige6/imgpost

Let the DSH assistant send local, web, and AI-generated images directly to users in chat, with external vision support for text-only models. On Windows it runs through PowerShell.

2last monthVision, Voice & MultimodalMIT
H

dsh-plugin-mynah

honwee/dsh-plugin-mynah

Give the agent a talking face: seven tools that drive a self-hosted Mynah realtime digital human — speak (queued or interrupting), play a gesture clip, interrupt, list live sessions and channels, check health, add text to its knowledge base.

2last monthVision, Voice & MultimodalMIT