Skip to main content

Vision, Voice & Multimodal

Vision, Voice & Multimodal plugins give the text-only DeepSeek models in DeepSeek-Harness (dsh) eyes, ears, and a voice. Find vision tools and provider routes that OCR and describe pasted screenshots via Zhipu GLM, Gemini, Doubao, or local Ollama, microphone voice input via the browser Web Speech API or Whisper-compatible APIs, read-aloud TTS with Edge TTS or custom voices, full-duplex voice modes, and generators for images, video, and music.

610 plugins found

Z

dsh-file-convert

zzy-12345678/dsh-file-convert

Local image, PDF, data, audio/video and Office file conversion through agent tools and a drag-and-drop interface; v1.2.1 supports DSH Desktop 0.2.1-rc.5 and 0.2.2-rc.1 through rc.5, with external tools required for some conversions.

4yesterdayVision, Voice & Multimodal
S

dsh-voice-assistant

supersyh-sss/dsh-voice-assistant

Voice assistant for dsh web: say the wake phrase (e.g. "小鲸") to activate hands-free dictation — what you say is transcribed and typed into the chat box automatically. Supports spoken edit commands (send, clear, new line, stop reading) and reads assistant replies aloud in Chinese. Speech recognition runs locally in-browser via sherpa-onnx WASM, so it works offline without an API key.

43 months agoVision, Voice & MultimodalMIT
S

dsh-audiogen

shimingming520/dsh-audiogen

AI audio generation for the DeepSeek Harness web GUI — multi-vendor TTS, music, sound effects and voice design with a sidebar panel, model comparison, resource library and Agent tools.

42 months agoVision, Voice & MultimodalApache-2.0
W

dsh-image-viewer

wsl043/dsh-image-viewer

Upgrades DSH image viewing with pointer-centered zoom, pan, galleries, downloads, keyboard support, and inline region notes.

416 days agoVision, Voice & MultimodalMIT
L

deepseek-vl-support

limccn/deepseek-vl-support

Give DeepSeek (text-only) models vision in Claude Code, Codex, and Agent Plugins clients: describe images via any OpenAI-compatible vision endpoint.

43 months agoVision, Voice & MultimodalMIT
J

dsh-ximalaya

jerryqx/dsh-ximalaya

Listen to Ximalaya podcasts and audiobooks inside the DSH web UI: search albums, browse paginated tracks, and play through a now-playing bar (prev/play/next, seek, volume, rate). After QR login the "Mine" page lists your liked tracks (click to play), subscribed albums with latest-episode hints, and followed anchors with their public albums; the host relays audio streams with Range support and registers an `ximalaya_play` tool so the agent can search and play on request.

43 months agoVision, Voice & MultimodalMIT
B

phone-eye

boheastill/phone-eye

Let your AI agent see and operate a real Android phone: phone_look (vision + UI-tree fusion), tap/swipe/type, screenshot — over adb, for any MCP client.

43 months agoVision, Voice & MultimodalMIT
X

dsh-vision-hub (tool-vision)

xing666173/dsh-vision-hub

Enhanced vision toolbox: 14 pixel-level vision tools (describe, ground, detect, crop, pixel-diff, OCR, long-screenshot OCR, vectorize, colors, cutout, screenshot, present, materialize, html-screenshot) driven by one OpenAI-compatible endpoint, with clean \[图片: path] bridge markers, content-safety classification and rate-limit auto-retry.

43 months agoVision, Voice & Multimodal
P

dsh-voice-call

pandapolo/dsh-voice-call

Agent-initiated voice calls: `offer_call` rings the human (接听/拒接/稍后再说); accepted calls synthesize and play locally via CrispASR + Qwen3-TTS (9 speakers, 2 Chinese dialects), rejected calls return the decision to the agent.

416 days agoVision, Voice & MultimodalMIT
F

dsh-chatvoice

fuzzysoul/dsh-chatvoice

Free voice closed loop for the Web UI: browser SpeechRecognition mic input with live interim results plus read-aloud speaker buttons and auto-read for assistant replies, zero configuration and no API key.

43 months agoVision, Voice & MultimodalMIT
X

dsh-draw-router

xiaozhe7772222/dsh-draw-router

Unified image generation router for DeepSeek Harness (DSH): auto-discovers image models from any OpenAI-compatible endpoint, provides draw_image and draw_list_sources tools, supports SenseNova, StepFun, Agnes, Qwen, Flux, SD, Imagen and more.

43 months agoVision, Voice & MultimodalMIT
S

dsh-plugin-multimodal

shinjiyu/dsh-plugin-multimodal

Advertise image paste on text-only DeepSeek routes, describe attachments with a vision sidecar, and leave native vision models untouched.

43 months agoVision, Voice & MultimodalMIT
N

free-vision-skill

niyongsheng/free-vision-skill

Fully-local image understanding & OCR via macOS Vision Framework: `ocr_image` (text, table layout + coordinates) and `view_image` (scene, faces, QR) — paste multiple images into the web input box or pass path/URL/base64; images never leave your Mac.

43 months agoVision, Voice & MultimodalMIT
G

deepseek-vision (dsh-plugin-deepseek-vision)

gou-gee/deepseek-vision

Vision MCP and DSH bundle for text-only DeepSeek: analyze_image, analyze_clipboard, compare_images and vision_status tools, a visual settings page, free GLM-4.6V-Flash by default, result caching and rate-limit tolerance; keys stay out of logs.

43 months agoVision, Voice & MultimodalMIT
F

dsh-plugin-deepeye

favio8/dsh-plugin-deepeye

DeepEye vision plugin for DeepSeek Harness (DSH): image description, OCR, VQA, UI layout, and clipboard analysis.

43 months agoVision, Voice & Multimodal
H

dsh-her-eyes

huashenglian/dsh-her-eyes

一个可以让ai自动调用VLM(多模态模型)进行视觉分析的dsh插件。A dsh plugin that allows AI to automatically invoke VLMs (multimodal models) for visual analysis.

43 months agoVision, Voice & MultimodalMIT
1

dsh-vision-sidecar

121103qwq/dsh-vision-sidecar

Hosted free vision sidecar for DeepSeek Harness with durable session evidence

43 months agoVision, Voice & MultimodalMIT
Y

dsh-image-subagent

yuqingsh/dsh-image-subagent

43 months agoVision, Voice & MultimodalMIT
G

dsh-vision-bridge

gxx182/dsh-vision-bridge

Bridges session images to configurable vision providers and returns text-only analysis to eligible DeepSeek Harness model routes.

43 months agoVision, Voice & MultimodalMIT
E

dsh-comfy-suite

elgwia-dsh/dsh-comfy-suite

Merges three MIT ComfyUI plugins into one bundle: workflow library, local image generation and editing (draw, inpaint, outpaint, character, upscale) through a local ComfyUI, plus a service launcher, gallery, style library and prompt wardrobe. Personal merge project, not the upstream version.

3yesterdayVision, Voice & Multimodal
C

voice-call

crease123/voice-call

Start with the author tutorial: https://www.bilibili.com/video/BV1t9sJ6NErV/ . Talk to your current DSH Agent without switching presets: automatic speech transcription and sending, streamed spoken replies, voice interruption, and a five-bar microphone meter. Choose DeepSeek or Doubao independently for ASR and TTS, configure your own credentials, and edit instructions applied only during calls. Includes a Bilibili usage tutorial, phone-button screenshots, and a Restore defaults action for call instructions.

33 days agoVision, Voice & MultimodalMIT
R

dsh-plugins (session-video-intake)

redheartsecretman/dsh-plugins

Per-route video input for DSH: native video on capable routes, a storyboard fallback for image-only routes, and explicit failures otherwise, without registering another provider.

36 days agoVision, Voice & MultimodalMIT
L

dsh-dafeiyu-emotion

lidu-china/dsh-dafeiyu-emotion

Adds a fish-ear microphone to DSH that transcribes speech locally, estimates tone and emotion, and lets BigFish reply with an emotion-aware prompt.

316 days agoVision, Voice & MultimodalMIT
S

dsh-gpt-image-playground

southcul/dsh-gpt-image-playground

Image generation and editing for GPT Image, Gemini (Nano Banana) and Grok, with official, OpenAI-compatible, api.toolify-ai.com and custom HTTP providers. Text-to-image, reference-image editing, canvas annotation, mask editing and Agent multi-turn chat, with images and history kept on your machine. The workbench UI is the MIT-licensed GPT Image Playground v0.9.0 build by CookSleep, bundled unchanged; that upstream is a standalone web app, not a DSH plugin.

37 days agoVision, Voice & MultimodalMIT