ビジョン、音声とマルチモーダル

FAL image generation for DeepSeek Harness: a generate_image tool backed by the FAL queue API (default model fal-ai/flux-2/klein/9b). Images render directly in the conversation, are saved to the workspace, and all settings are editable from the Web GUI.

Vision bundle + plugin for DeepSeek Harness: the describe_image tool reads local images and asks any configured multimodal route, with zero core changes

DeepSeek Harness 插件：以 MindSee 为后端，为 DeepSeek 提供图片相关能力

SenseVoice 语音输入插件 for DeepSeek Harness：在对话输入框旁添加麦克风按钮，录音后调用本地 SenseVoice 服务转成文本填入输入框。首次使用自动下载模型并显示进度，后端由插件自动启动。

DeepSeek Harness plugin: multimodal tools (image/audio/video/document understanding, transcription, image generation) via Gemini API or the local Antigravity CLI.

DSH tool plugin: generate images through ToAPIs async GPT-Image-2 API (submit task, poll, download).

DSH-native video understanding with configurable multimodal providers

Real-time duplex voice over Volcengine streaming ASR/TTS: agent reply narration, barge-in, wake word, live captions, 30 Chinese voices and a reply-first acknowledgment; builds in the DSH monorepo.

Voice input for the web UI: a mic button in the composer that transcribes speech into the draft via the Web Speech API, with an optional auto-send toggle.

Give text-only models vision: a describe_image tool that delegates images to a vision model from your dsh model list over the harness's own LLM runtime.

Lets a text-only DeepSeek agent read images in the same session by delegating to a vision-capable subagent, with send-time image-to-path conversion.

Hands repetitive text and vision labor (OCR, image analysis, comparison) to a locally running Unsloth Desktop (Unsloth Studio) server through unsloth_run and unsloth_vision tools; pure HTTP client, never spawns or owns processes.

Hands repetitive text and vision labor (OCR, image analysis, comparison) to a local KoboldCpp (llama.cpp) server through koboldcpp_run and koboldcpp_vision tools, with on-demand server lifecycle management.

Windows組み込みエンジン(Windows.Media.Ocr)による添付画像のローカルOCR:モデルに送信されるのは認識されたテキストのみで、画像バイトは送信されません。ビジョンパススルーはオプトインです。

Tesseract による添付画像のローカル OCR。認識されたテキストのみを model に送り、画像バイト列は送らない。vision passthrough は任意。

Give your text-only model eyes - chat image attachments are auto-described via a vision model (default prompt), with iterative re-parsing through model-generated prompts when details are missing; system/custom model modes + GUI config panel, key-safe secret handling, and a small host patch for DSH 0.1.0-rc.6 (see repo README).

Two-tier image reading for text-only models: fast local OCR (RapidOCR, offline) first, vision-model fallback (modlens).

Transparent image guard for text-only routes: paste images without the 400 session deadlock, plus a vision_analyze tool for OCR/PDF/docx/pptx/video.

Image-to-text input for the Web UI: paste or drag an image and it is transcribed into structured text and sent, giving text-only LLMs image-input takeover (OpenAI-compatible vision API).

Give DSH text-only models vision: an image/OCR/document recognition skill (race pool → custom channels → local) plus an idempotent host patch so image messages reach the model.

テキスト専用 LLM 向けのビジョン機能。無料の Gemini と GLM のビジョン API を利用した、画像説明/OCR/視覚質問応答(VQA)に対応します。

DeepSeek Harness 向けの、会話形式による UI/UX ビジュアルレビュープラグイン。vision_review / vision_ask ツールは、任意の OpenAI 互換マルチモーダルエンドポイント(例: agnes-2.5-flash)を利用します。

NanoBananaPro API を通じて、DeepSeek Harness で画像と動画を生成できます。

Seedance 2 AI API を通じて、DeepSeek Harness で画像と Seedance 動画を生成できます。