Plugins

DSH plugin for bounded agent evaluation: compare an original with candidate prompt or supported configuration changes against user-supplied checks, record evidence and costs, and leave adoption to the user.

DSH web plugin: a LiveBench tab in the Trajectory view (right of 对话/轨迹). Run LiveBench evaluations against every model configured in the DeepSeek Harness — pick provider/model, category, task, release and question range from dropdowns, watch progress, and

Paired experiments and promotion gates for DSH plugins.

Runs one coding prompt across multiple configured models in isolated Git worktrees, streams side-by-side tool traces and results, and commits the candidate the user adopts for later rounds.

Evidence-first multi-model coding comparison workbench for DeepSeek Harness

Audit an agent harness against the harness-evaluation criteria, with machine-enforced evidence validation.

Plataforma de avaliação de agentes: benchmarks em YAML, orquestração de execuções headless, métricas baseadas em traces e relatórios de execução