Plugins

Local model plugin for DeepSeek Harness: manage GGUF models in settings, auto-launch llama.cpp on first message, and auto-unload after 5 minutes of idle time to free VRAM.

Floating GPU monitor for the DSH Web UI: a compact, draggable strip with one row per discrete GPU (exact name, utilization, VRAM, temperature, power draw) from nvidia-smi, stays visible over side panels and side cards, with a top-VRAM-process list when the driver reports it; degrades to an n/a pill on machines without an NVIDIA driver.

Control panel for local LLM inference servers in the DSH web view: service registry with health checks and stop controls, named parameter profiles for llama.cpp, SGLang and vLLM with pre-save KV/VRAM validation, GPU detection, and tok/s benchmarks.