- Home
- Categories
- Vision, Voice & Multimodal
Vision, Voice & Multimodal
Vision, Voice & Multimodal plugins give the text-only DeepSeek models in DeepSeek-Harness (dsh) eyes, ears, and a voice. Find vision tools and provider routes that OCR and describe pasted screenshots via Zhipu GLM, Gemini, Doubao, or local Ollama, microphone voice input via the browser Web Speech API or Whisper-compatible APIs, read-aloud TTS with Edge TTS or custom voices, full-duplex voice modes, and generators for images, video, and music.
610 plugins found
dsh-doubao-image-free
linling4285/dsh-doubao-image-free
DeepSeek Harness 插件:把网页版豆包与网页版 ChatGPT 免费账户的生图能力接进 DSH(含图生图、生视频与 Web 设置页)。
dsh-vidlens
cctv2333/dsh-vidlens
Samples a video the way a person does instead of downloading it: metadata and chapters first, then timestamped frames as images, subtitle-first transcripts (local ASR only when the platform carries no subtitles), AudioSet 527-class sound tags and top comments — 21 tools sharing one on-disk cache behind a cross-process lock. Needs Python 3.10+, ffmpeg and the vidlens package (pip install vidlens-mcp); a missing install comes back with the two ways to fix it instead of a bare ImportError.
dsh-media-lens
drscrewdriver/dsh-media-lens
All-media (video/audio/image) sibling of liustack/modlens: turns local media into structured evidence (timeline / transcript / layout regions) injected into the conversation so text-only models can cite concrete frames, seconds and speakers — Evidence, not imagination. One failover chain per media, recorded hop-by-hop in meta.attempts (a fallback is never silent): host-registered multimodal models first, then a configured OpenAI-compatible endpoint (comma-separated multi-key rotation), then local ffmpeg frame-sampling / a local ASR CLI, degrading to metadata-only as a last resort. Absorbs modlens battle-tested rules — cooldown keyed only on auth/quota failures and softened to chain-tail (never dropped), redact-before-clip error text, magic-byte sniff that never trusts file extensions. Optional vision-bridge registers a media-lens wrapper into the host model selector so a pure-text model gains image/audio/video sight. Registering / authenticating multimodal models and true inline audio-video upload lean on two companion plugins, declared as optional peers (absence auto-degrades, never errors): dsh-thinking-levels fronts the model config / registration surface, dsh-llm-openai-completions takes over the OpenAI-compatible transport that serializes file blocks into video_url / input_audio. Privacy: media goes to remote providers by default; strictLocalOnly keeps content on-machine. Prerequisites not shipped with the package: ffmpeg/ffprobe on PATH (frame sampling / reencode / duration probe; degrades to metadata when missing) and a user-configured local ASR CLI for the audio fallback. Hosts 0.1.7 / 0.2.0 / 0.2.1 (6 rc, exact engines.dsh enum). npm: dsh-media-lens.
dsh-comfyui-image
qxingyshu/dsh-comfyui-image
Generate images from the agent on the user's own GPU by queueing a workflow on a local ComfyUI install over its HTTP API: Z-Image-Turbo for fast drafts and Qwen-Image-2.1 for final assets and legible in-image text. Registers comfyui_generate and comfyui_status plus a skill covering model selection and prompt craft, has no runtime dependencies, and starts ComfyUI headless when no server is listening.
dsh-hold-to-talk
wangzhanchao883/dsh-hold-to-talk
One-handed, keyboard-free input for the composer: press and hold the mouse on the input box, speak, release — the text lands in the draft, and sliding up cancels without leaving a half sentence behind. No mic button to aim at and no shortcut to remember; the hand never has to leave the input area, which is the point when the other hand is busy. Recognition runs fully offline (SenseVoice via sherpa-onnx, no API key, audio never leaves the machine).
dsh-plugin-speech
nakamuraia/dsh-plugin-speech
Read assistant replies aloud in DeepSeek Harness: text-to-speech providers with streaming playback.
dsh-voice-call
biliye/dsh-voice-call
Voice call assistant for the DSH desktop app and the Web GUI (the same plugin, only the profile name differs): a draggable floating call ball, browser-side VAD that sends each utterance after a pause, speech recognition through the local SenseVoice model already downloaded by the official voice-input plugin (no second model), FunASR HTTP or streaming, or a cloud-compatible API, MiniMax / MiMo-V2.5-TTS (director mode and voice clone) / OpenAI-compatible TTS replies, an optional wake-word mode with auto-sleep, and task dispatch to separate sessions with progress, stop, and spoken completion reports.
dsh-tool-lipsync
yu-wenchao/dsh-tool-lipsync
Free lip-sync video generation plugin for DSH with 3000+ voices and 500+ languages.
dsh-voco
lgquan/dsh-voco
Continuous voice conversations for DSH with hands-free listening, push-to-talk, speech recognition, TTS replies, and background Agent delegation.
taxue-dsh-artisan
taxueseek/taxue-dsh-artisan
Integrated visual creation toolchain for DSH: prompt reverse-engineering and audit optimization plus multi-provider image generation with async background rendering.
dsh-image-vision
xiaoyuink/dsh-image-vision
Image understanding for any DSH model: vision, OCR, grounding, and crop tools with domain presets for histopathology, cell biology, anatomy, clinical images and scientific figures.
Deepseek-Continuity
linxuhao/deepseek-continuity
Local image, voice, music and SFX generation plus transcription, with pinned identity: characters, animals, objects and actor voices are defined once and reused on every later call, degenerate output (a near-flat image, silent audio) is rejected instead of returned as success, and a generated line can be read back as text so a clone that swallowed its ending becomes visible. The engines unload when idle, and image generation and transcription can each be pointed at an OpenAI-shaped API instead of the local Vulkan backend.
dsh-tool-visual-primitives
inkshadewoods/dsh-tool-visual-primitives
Analyzes conversation images through mode-specific prompts (caption, UI, document, grounding, topology, etc.) and injects structured evidence with coordinate primitives (boxes, points, refs) as text, with session-level caching for reuse across replay and compaction.
dsh-vision-bridge
goodandready/dsh-vision-bridge
Routes images to a vision model of your choice - auto-rewrite, explicit tools, or hybrid - so a text-only chat model does not fail a turn that contains a picture.
dsh-ui-spec
yumimanji/dsh-ui-spec
DeepSeek Harness plugin that turns UI screenshots into implementation-grade web specs using OCR, deterministic geometry, scene graphs, assets, and render comparison.
deepseekeyes
dttxorg/deepseekeyes
Auditable vision and cross-platform Computer Use runtime for DeepSeek Harness with source-preserving evidence.
voco-input-sh
nothree-code/voco-input-sh
Voice input for the Web UI: a mic button that drives local VocoType offline speech recognition and auto-inserts recognized text into the composer (auto-deploy, dedupe, continuous dictation).
dsh-stt-input
baisama-cloud/dsh-stt-input
Speech-to-text voice input for the web UI: a mic button in the composer transcribes speech into the draft via the browser Web Speech API (zero-config) or an OpenAI-compatible Whisper API (OpenAI / Groq), with a selectable model and language in Settings.
dsh-plugins (dsh-vision)
tzhr-invest/dsh-plugins
Agent-callable vision tool that describes local images via any OpenAI-compatible vision endpoint you configure, with an optional multi-model cross-check and no built-in keys.
dsh-vision-tools
moon09300731/dsh-vision-tools
Full vision-capability bundle for DeepSeek Harness: a vision_understand tool (OpenAI-compatible vision APIs, free Zhipu GLM-4V-Flash by default) plus paste/drag-and-drop/button entry points for image recognition.
dsh-plugin-grok2api-media-tool
lsjspl/dsh-plugin-grok2api-media-tool
Gives dsh the ability to generate images and videos through the grok2api API.
dsh-vision-mix
haiziyao/dsh-vision-mix
Combine text, vision, and image-generation APIs into one Mix model with automatic routing: text-only requests go to the chat model, user images and agent screenshots go to the vision model, follow-ups keep using the same session image, and agents can generate or edit images with session-scoped call history.
dsh-ernie-image
omdsh-dev/dsh-ernie-image
openflowframes
zerohackz/openflowframes