Skip to main content

Vision, Voice & Multimodal

Vision, Voice & Multimodal plugins give the text-only DeepSeek models in DeepSeek-Harness (dsh) eyes, ears, and a voice. Find vision tools and provider routes that OCR and describe pasted screenshots via Zhipu GLM, Gemini, Doubao, or local Ollama, microphone voice input via the browser Web Speech API or Whisper-compatible APIs, read-aloud TTS with Edge TTS or custom voices, full-duplex voice modes, and generators for images, video, and music.

610 plugins found

L

dsh-doubao-image-free

linling4285/dsh-doubao-image-free

DeepSeek Harness 插件:把网页版豆包与网页版 ChatGPT 免费账户的生图能力接进 DSH(含图生图、生视频与 Web 设置页)。

325 days agoVision, Voice & MultimodalMIT
C

dsh-vidlens

cctv2333/dsh-vidlens

Samples a video the way a person does instead of downloading it: metadata and chapters first, then timestamped frames as images, subtitle-first transcripts (local ASR only when the platform carries no subtitles), AudioSet 527-class sound tags and top comments — 21 tools sharing one on-disk cache behind a cross-process lock. Needs Python 3.10+, ffmpeg and the vidlens package (pip install vidlens-mcp); a missing install comes back with the two ways to fix it instead of a bare ImportError.

322 days agoVision, Voice & MultimodalMIT
D

dsh-media-lens

drscrewdriver/dsh-media-lens

All-media (video/audio/image) sibling of liustack/modlens: turns local media into structured evidence (timeline / transcript / layout regions) injected into the conversation so text-only models can cite concrete frames, seconds and speakers — Evidence, not imagination. One failover chain per media, recorded hop-by-hop in meta.attempts (a fallback is never silent): host-registered multimodal models first, then a configured OpenAI-compatible endpoint (comma-separated multi-key rotation), then local ffmpeg frame-sampling / a local ASR CLI, degrading to metadata-only as a last resort. Absorbs modlens battle-tested rules — cooldown keyed only on auth/quota failures and softened to chain-tail (never dropped), redact-before-clip error text, magic-byte sniff that never trusts file extensions. Optional vision-bridge registers a media-lens wrapper into the host model selector so a pure-text model gains image/audio/video sight. Registering / authenticating multimodal models and true inline audio-video upload lean on two companion plugins, declared as optional peers (absence auto-degrades, never errors): dsh-thinking-levels fronts the model config / registration surface, dsh-llm-openai-completions takes over the OpenAI-compatible transport that serializes file blocks into video_url / input_audio. Privacy: media goes to remote providers by default; strictLocalOnly keeps content on-machine. Prerequisites not shipped with the package: ffmpeg/ffprobe on PATH (frame sampling / reencode / duration probe; degrades to metadata when missing) and a user-configured local ASR CLI for the audio fallback. Hosts 0.1.7 / 0.2.0 / 0.2.1 (6 rc, exact engines.dsh enum). npm: dsh-media-lens.

34 days agoVision, Voice & Multimodal
Q

dsh-comfyui-image

qxingyshu/dsh-comfyui-image

Generate images from the agent on the user's own GPU by queueing a workflow on a local ComfyUI install over its HTTP API: Z-Image-Turbo for fast drafts and Qwen-Image-2.1 for final assets and legible in-image text. Registers comfyui_generate and comfyui_status plus a skill covering model selection and prompt craft, has no runtime dependencies, and starts ComfyUI headless when no server is listening.

3last monthVision, Voice & MultimodalMIT
W

dsh-hold-to-talk

wangzhanchao883/dsh-hold-to-talk

One-handed, keyboard-free input for the composer: press and hold the mouse on the input box, speak, release — the text lands in the draft, and sliding up cancels without leaving a half sentence behind. No mic button to aim at and no shortcut to remember; the hand never has to leave the input area, which is the point when the other hand is busy. Recognition runs fully offline (SenseVoice via sherpa-onnx, no API key, audio never leaves the machine).

32 months agoVision, Voice & MultimodalMIT
N

dsh-plugin-speech

nakamuraia/dsh-plugin-speech

Read assistant replies aloud in DeepSeek Harness: text-to-speech providers with streaming playback.

32 months agoVision, Voice & MultimodalMIT
B

dsh-voice-call

biliye/dsh-voice-call

Voice call assistant for the DSH desktop app and the Web GUI (the same plugin, only the profile name differs): a draggable floating call ball, browser-side VAD that sends each utterance after a pause, speech recognition through the local SenseVoice model already downloaded by the official voice-input plugin (no second model), FunASR HTTP or streaming, or a cloud-compatible API, MiniMax / MiMo-V2.5-TTS (director mode and voice clone) / OpenAI-compatible TTS replies, an optional wake-word mode with auto-sleep, and task dispatch to separate sessions with progress, stop, and spoken completion reports.

32 months agoVision, Voice & MultimodalMIT
Y

dsh-tool-lipsync

yu-wenchao/dsh-tool-lipsync

Free lip-sync video generation plugin for DSH with 3000+ voices and 500+ languages.

33 months agoVision, Voice & MultimodalMIT
L

dsh-voco

lgquan/dsh-voco

Continuous voice conversations for DSH with hands-free listening, push-to-talk, speech recognition, TTS replies, and background Agent delegation.

326 days agoVision, Voice & MultimodalMIT
T

taxue-dsh-artisan

taxueseek/taxue-dsh-artisan

Integrated visual creation toolchain for DSH: prompt reverse-engineering and audit optimization plus multi-provider image generation with async background rendering.

3last monthVision, Voice & MultimodalMIT
X

dsh-image-vision

xiaoyuink/dsh-image-vision

Image understanding for any DSH model: vision, OCR, grounding, and crop tools with domain presets for histopathology, cell biology, anatomy, clinical images and scientific figures.

33 months agoVision, Voice & Multimodal
L

Deepseek-Continuity

linxuhao/deepseek-continuity

Local image, voice, music and SFX generation plus transcription, with pinned identity: characters, animals, objects and actor voices are defined once and reused on every later call, degenerate output (a near-flat image, silent audio) is rejected instead of returned as success, and a generated line can be read back as text so a clone that swallowed its ending becomes visible. The engines unload when idle, and image generation and transcription can each be pointed at an OpenAI-shaped API instead of the local Vulkan backend.

32 months agoVision, Voice & MultimodalMIT
I

dsh-tool-visual-primitives

inkshadewoods/dsh-tool-visual-primitives

Analyzes conversation images through mode-specific prompts (caption, UI, document, grounding, topology, etc.) and injects structured evidence with coordinate primitives (boxes, points, refs) as text, with session-level caching for reuse across replay and compaction.

3last monthVision, Voice & MultimodalMIT
G

dsh-vision-bridge

goodandready/dsh-vision-bridge

Routes images to a vision model of your choice - auto-rewrite, explicit tools, or hybrid - so a text-only chat model does not fail a turn that contains a picture.

317 days agoVision, Voice & MultimodalMIT
Y

dsh-ui-spec

yumimanji/dsh-ui-spec

DeepSeek Harness plugin that turns UI screenshots into implementation-grade web specs using OCR, deterministic geometry, scene graphs, assets, and render comparison.

33 months agoVision, Voice & MultimodalMIT
D

deepseekeyes

dttxorg/deepseekeyes

Auditable vision and cross-platform Computer Use runtime for DeepSeek Harness with source-preserving evidence.

33 months agoVision, Voice & MultimodalMIT
N

voco-input-sh

nothree-code/voco-input-sh

Voice input for the Web UI: a mic button that drives local VocoType offline speech recognition and auto-inserts recognized text into the composer (auto-deploy, dedupe, continuous dictation).

32 months agoVision, Voice & MultimodalMIT
B

dsh-stt-input

baisama-cloud/dsh-stt-input

Speech-to-text voice input for the web UI: a mic button in the composer transcribes speech into the draft via the browser Web Speech API (zero-config) or an OpenAI-compatible Whisper API (OpenAI / Groq), with a selectable model and language in Settings.

33 months agoVision, Voice & MultimodalMIT
T

dsh-plugins (dsh-vision)

tzhr-invest/dsh-plugins

Agent-callable vision tool that describes local images via any OpenAI-compatible vision endpoint you configure, with an optional multi-model cross-check and no built-in keys.

3last monthVision, Voice & MultimodalMIT
M

dsh-vision-tools

moon09300731/dsh-vision-tools

Full vision-capability bundle for DeepSeek Harness: a vision_understand tool (OpenAI-compatible vision APIs, free Zhipu GLM-4V-Flash by default) plus paste/drag-and-drop/button entry points for image recognition.

33 months agoVision, Voice & MultimodalMIT
L

dsh-plugin-grok2api-media-tool

lsjspl/dsh-plugin-grok2api-media-tool

Gives dsh the ability to generate images and videos through the grok2api API.

33 months agoVision, Voice & Multimodal
H

dsh-vision-mix

haiziyao/dsh-vision-mix

Combine text, vision, and image-generation APIs into one Mix model with automatic routing: text-only requests go to the chat model, user images and agent screenshots go to the vision model, follow-ups keep using the same session image, and agents can generate or edit images with session-scoped call history.

32 months agoVision, Voice & MultimodalMIT
O

dsh-ernie-image

omdsh-dev/dsh-ernie-image

33 months agoVision, Voice & MultimodalBSD-3-Clause
Z

openflowframes

zerohackz/openflowframes

33 months agoVision, Voice & MultimodalGPL-3.0