- Home
- Categories
- Vision, Voice & Multimodal
Vision, Voice & Multimodal
Vision, Voice & Multimodal plugins give the text-only DeepSeek models in DeepSeek-Harness (dsh) eyes, ears, and a voice. Find vision tools and provider routes that OCR and describe pasted screenshots via Zhipu GLM, Gemini, Doubao, or local Ollama, microphone voice input via the browser Web Speech API or Whisper-compatible APIs, read-aloud TTS with Edge TTS or custom voices, full-duplex voice modes, and generators for images, video, and music.
610 plugins found
dsh-paddle-ocr
omdsh-dev/dsh-paddle-ocr
dsh-plugin-aigc-canvas
huanlinoto/dsh-plugin-aigc-canvas
provider-agnostic AIGC HTTP 桥 + 无限画布 + ffmpeg 后处理,13 个工具含画布连边/reroll/媒体编辑 | Provider-agnostic AIGC HTTP bridge + infinite canvas + ffmpeg post-processing; 13 tools incl. canvas linking/reroll/media-edit
dsh-voice
jesse-njx/dsh-voice
Voice notes in, spoken answers out: dictate audio that becomes user messages (transcribe), have the agent read replies aloud (speak), local-first under ~/.dsh/voice.
dsh-llm-vision-bridge
einskyle/dsh-llm-vision-bridge
Native LLM-provider vision bridge: images pasted in the chat are described by a vision model (Qwen3-VL via pi-ai/llama.cpp) and the text description is fed to text-only DeepSeek for the reply — image admission, routing and compaction all run through harness-native mechanisms, with an LRU description cache and 503 retry.
dsh-mic-input
qt-chen/dsh-mic-input
Microphone voice input for the composer: browser Web Speech API live transcription, dedupe/auto-continue, smart punctuation, language and auto-send settings.
dsh-ppt-image-studio
amesawa-000/dsh-ppt-image-studio
Configures an OpenAI Images-compatible or Gemini image API in Settings, and adds agent tools that write prompts, generate illustrations for presentation slides, and return the original local image paths.
voice_for_dsh
junarch/voice_for_dsh
DSH web plugin: read aloud each DeepSeek turn output after spoken-style transcription (code/table/markdown aware), with per-message manual read buttons and an auto-read toggle.
dsh-sound-atelier
puffdog-git/dsh-sound-atelier
Reads assistant replies aloud using Edge, cloud and local speech engines, with per-persona voices, Chinese/Japanese dubbing, cloud voice management, RVC voice conversion and a speech API other plugins can call.
dsh-teardown-studio
feely0208/dsh-teardown-studio
DeepWhale Teardown Studio: upload a pre-separated 3D model, render a teardown video locally.
dsh-big-fish-speak
chaowei08/dsh-big-fish-speak
Makes the dsh-pet desktop pet read model replies aloud in its own configured voice. Newer dsh-pet gets the whole text in one request (up to its 500-char cap); older versions automatically fall back to 60-char chunks. Each piece is verified against the pet log to confirm it actually played.
dsh-breeze-tts
eslaykey/dsh-breeze-tts
Breeze Blue text-to-speech for DeepSeek Harness: agent tools, reply playback, voice design and a settings page.
dsh-recorder-card
synswarm/dsh-recorder-card
Development-preview DSH plugin to import recordings from compatible BLE recorder cards, with optional transcription and fingerprint-linked archives. Requires recorder hardware, Host Bluetooth and Python dependencies.
dsh-littlestar-anything-voice
theskywilldawn/dsh-littlestar-anything-voice
Click the chibi mascot and it reads the assistant reply aloud through your local IndexTTS 2.5 install. One character = one reference clip; a missing portrait just shows a placeholder. Ships no voices or artwork — the library lives on the user's own machine. Requires a local IndexTTS 2.5 install.
voice_for_dsh (voice-for-dsh)
junarch/voice_for_dsh
Reads each reply aloud in natural spoken language, summarizing structured content such as tables and code blocks, with an adjustable script length — from detailed narration close to the source length down to a minimal briefing. Engines: system TTS, the DeepSeek TTS API, Doubao (dialects and expressive delivery), or the local Kokoro model, which synthesizes offline in-process. It also provides three session sounds — a repeating tone while the agent works, a completion tone at the end of a turn, and a question tone when it needs your answer; built-in tones can be switched and custom audio uploaded, with files kept on the local machine.
dsh-synthv-studio
making-acid/dsh-synthv-studio
Connects a local Synthesizer V Studio 2 Pro to the agent through its own Lua script API, with five tools for discovery, a persistent bridge, voice composition, note editing and DAW (VST3/ARA + MIDI) integration. Windows 10/11 only; requires Synthesizer V Studio 2 Pro 2.1.2+ with a project open.
dsh-model-vision
charovo0059/dsh-model-vision
Fills in the vision capability that DSH's "fetch models" step drops, so image-capable models stop being declared text-only, and marks them in the model name.
dsh-imagegen
say007go/dsh-imagegen
DSH text-to-image/image-to-image plugin: compatible with OpenAI-style image generation APIs, with 多米API as the default; standard OpenAI endpoints may require protocol, image-to-image mode and size adjustments; text-to-image and URL reference images do not use COS, while local reference images can be compressed and stored in COS; custom prompt suffixes are supported.
dsh-gptsovits-tts
nuoyi207/dsh-gptsovits-tts
Local GPT-SoVITS text-to-speech for DSH: reads replies aloud, switches voices from the right sidebar, and trains a new voice from a dropped audio sample. First run downloads an 11.4 GB engine and needs an NVIDIA CUDA GPU.
dsh-video-vision
tests4gptplay/dsh-video-vision
Give DSH AI timestamped video frames, audio and lyric analysis for Bilibili, YouTube and local files, with encrypted browser-session import, continued viewing, saved site resolvers and native cache management. Requires FFmpeg and ffprobe on PATH or configured in the plugin settings.
dsh-screenshot-xn
ntesicn/dsh-screenshot-xn
Full-screen screenshot panel for the DSH composer: marquee selection with rectangle, ellipse, arrow, pen, mosaic and text annotation, then insert into the conversation, copy or save. The selected region can also be recognized offline — PP-OCRv6 through onnxruntime-node, falling back to the built-in Windows OCR engine — and translated into nine languages with the model already configured in DSH. On Windows the marquee covers the whole screen including the taskbar and hides the DSH window first, so the capture is of the real desktop. The panel runs in an Edge or Chrome kiosk window, and falls back to an in-DSH capture flow when no browser can be launched. Note that DSH Desktop denies ordinary browser access by default, so the full-screen panel also needs "Allow opening this Profile in a browser" (compatibility mode) enabled in the profile settings; without it every capture goes through the in-DSH fallback. Windows only (DSH Desktop); the PP-OCRv6 models are downloaded from ModelScope on first recognition.
dsh-audiobook
aicivilization/dsh-audiobook
Search public-domain libraries (Project Gutenberg, Wikisource, Internet Archive, Standard Ebooks) by title, author, character or half-remembered plot, or import EPUB / PDF / TXT / DOCX / Markdown, and listen in the sidebar with Microsoft Edge neural voices, offline Kokoro or the device voices; keeps your position, takes voice notes anchored to what you just heard, and discusses the book with your DSH model.
dsh-image-lite
yupaoa/dsh-image-lite
Image generation for DSH in two modes — an image_generate_lite tool the model calls from chat, and a right-sidebar studio for manual runs; up to five reference images, the OpenAI images API format, keys kept in the DSH credential service.
imgpost
hige6/imgpost
Let the DSH assistant send local, web, and AI-generated images directly to users in chat, with external vision support for text-only models. On Windows it runs through PowerShell.
dsh-plugin-mynah
honwee/dsh-plugin-mynah
Give the agent a talking face: seven tools that drive a self-hosted Mynah realtime digital human — speak (queued or interrupting), play a gesture clip, interrupt, list live sessions and channels, check health, add text to its knowledge base.