dsh-models-input-modalities

DSH PLUGIN视觉与多模态

仓库 DamonBao/dsh-models-input-modalities

视觉与多模态 L5 · 运行验证通过 安全审查:低风险 可信度:金 可安装插件
安装这个插件

为 DSH 的模型设置页第三方提供商卡片补充「模型能力」折叠区,逐模型声明可接受的输入模态(是否支持图片)与推理等级。

一句话选型结论

按资料字段整理

dsh-models-input-modalities 是视觉与多模态类的 DSH 可安装插件,验证等级 L5 · 运行验证通过,安全审查为低风险,列出 4 项功能,有可直接复制的安装命令。验证通过不等于安全:插件会读写文件、执行命令或联网,装前先到仓库确认它做了什么;涉及密钥或系统权限的,建议先在隔离环境试装。

分类视觉与多模态 收录类型可安装插件 验证等级L5 · 运行验证通过 安全审查低风险
验证等级 L5 L5 · 运行验证通过
GitHub 星标 1 复刻 0 · 未关闭 issue 0
最近更新 2026-09-29 创建于 2026-09-09
README 13.1 KB 正文体量,越大说明说明书写得越细

安装

可安装插件
在 DSH 里执行,装完用 dsh plugin list 确认已挂上;标了 L4 / L5 的命令已在沙盒里真实跑通
dsh plugin --profile web add @jcy2387/dsh-models-input-modalities@0.1.3
  1. 1
    确认版本与运行环境

    兼容的 DSH 版本为 0.2.0-rc.2 等 6 个;版本不匹配时安装会报错。

  2. 2
    执行安装命令

    在 DSH 里执行上面的命令;多包仓库要注意区分具体子包名,别装错包。

  3. 3
    确认已挂载

    用 dsh plugin list 查看列表里是否出现这个插件,出现即挂载成功。

  4. 4
    试跑并检查权限

    加载后跑一个最小用例,确认它能正常工作;同时看它申请了哪些文件、命令或网络权限。

兼容 DSH 版本0.2.0-rc.2 等 6 个版本版本不匹配时安装会报错
Node.js 要求未标注来自仓库 package.json 的 engines 字段
前置依赖无需要同时安装的同级依赖
npm 包名未发布到 npm可用 npm view 查看包信息

能做什么

4 项功能
字段来自项目仓库与公开索引,中文说明由本站标注

dsh-models-input-modalities:为 DeepSeek Harness 补齐按模型的输入模态与推理等级

  • 模型设置页新增能力折叠区
  • 逐模型声明图片输入支持
  • 逐模型配置推理等级
  • 覆盖第三方 pi-ai 提供商

适用场景

联网搜索视觉识别

上游标签

deepseek-harness-plugindsh-plugin

验证等级与安全审查

L5 · 运行验证通过
自动化流程结论,不是人工审核
验证等级L5 · 运行验证通过在 dsh 沙盒中完成安装与运行冒烟——装得上、跑得起来
安全审查低风险静态分析结论,未标注不代表已通过审查
仓库健康度活跃按仓库活跃度与最近更新时间给出
可信度金综合仓库活跃度与验证结果

上面的结论来自上游最近一次自动化验证(2026-10-08): 同一套检查会在插件发新版后重跑,页面显示的是最新一次的逐项结果。

逐项检查结果

L1 · 已找到 ✓ 通过
  • L1.0_DEFAULTED_FROM_L3 由 L3 推定 默认通过——L3 安装规范已通过(全库 L3 扫描策略)
L2 · 结构化 ✓ 通过
  • L2.0_DEFAULTED_FROM_L3 由 L3 推定 默认通过——L3 安装规范已通过(全库 L3 扫描策略)
L3 · 安装规范 ✓ 通过
  • L3.1_INSTALL_COMMAND_PARSED 安装命令已解析 方式:安装规范解析
  • L3.2_DSH_VERSION_DECLARED DSH 版本已声明 方式:DSH 版本声明
L4 · 安装已测 ✓ 通过
  • L4.1_INSTALL_EXECUTED_CONFINED 受限沙盒内执行安装 方式:沙盒安装执行
  • L4.2_INSTALL_SUCCESS 沙盒安装成功 方式:沙盒安装执行
  • L4.3_ARTIFACT_CONFIRMED 安装产物已确认 方式:沙盒安装执行
L5 · 运行已测 ✓ 通过
  • L5.1_INSTALL_PASSED_SANDBOXED 沙盒安装通过 方式:沙盒安装执行
  • L5.2_WEB_BOOT_READY Web 启动就绪 方式:Web 启动
  • L5.3_HTTP_SERVED HTTP 服务响应 方式:HTTP 请求
  • L5.4_PLUGIN_INVENTORY_ACTIVE 插件清单中已激活 方式:插件清单查询

风险详情

  • 审查结论 通过
  • 结论说明 vet 静态分析未发现可疑行为,判定为干净(clean)。
  • 风险计数 严重 0 / 高 0 / 中 0
  • 风险详情 未发现严重或警告级问题。

选择建议

装之前先看这几条
按条目字段给出的判断,不替你决定用不用

值得选的地方

  • 验证等级 L5:安装和运行都在沙盒里跑通过,装完能直接用的概率高。
  • 静态安全审查为低风险,没有发现明显可疑行为。
  • 有可直接复制的安装命令,不用自己翻文档找入口。
  • 标注了兼容的 DSH 版本(0.2.0-rc.2 等 6 个),按版本装不容易报错。
  • 列出了 4 项功能,能直接看出它解决什么问题。

先想清楚的地方

  • 没有声明 Node.js 版本要求,版本不匹配可能装不上。
  • 验证通过不等于安全:插件会读写文件、执行命令或联网,装前先到仓库确认它做了什么。

更适合

  • 需要在视觉与多模态场景里给 DSH 补能力的人。
  • 想装完就能用、不想自己排依赖的人。
  • 能接受在本地装依赖、愿意自己确认权限的人。

不太适合

  • 只使用 DSH 官方内置能力、不接受第三方插件的人。

同类对比

6 个同类
同分类里挑最接近的几条,字段以各自详情页为准
插件验证等级安全审查星标兼容版本安装命令
dsh-models-input-modalities当前 L5 · 运行验证通过 低风险 1 0.2.0-rc.2 等 6 个 有
open-design L4 · 沙盒安装通过 低风险 10.0 万 未标注 有
awesome-gpt-image-2 L3 · 安装规范通过 低风险 3.4 万 未标注 无
PicGo L3 · 安装规范通过 低风险 2.7 万 未标注 无
iPolloWork L4 · 沙盒安装通过 低风险 6,775 未标注 有
modlens L5 · 运行验证通过 低风险 4,207 0.2.0-rc.2 等 13 个 有

仓库档案

视觉与多模态
字段来自项目仓库与公开索引,中文说明由本站标注
作者 / 维护方DamonBao仓库 dsh-models-input-modalities · 默认分支 main
分类视觉与多模态vision
收录类型可安装插件声明了 dsh.bundle、可用 dsh plugin add 安装的条目
开发语言TypeScript仓库主语言
许可证MIT商用或二次分发前请确认条款原文
星标 / 复刻 / issue1 / 0 / 0收录时的数值,非实时
创建 / 更新2026-09-09 · 2026-09-29最后推送 2026-09-29
本站收录2026-09-09首次进入本站目录的时间

README 全文

13.1 KB
作者原文,中文版优先;只做安全转义,不改内容

DSH Models Input Modalities




English | 简体中文

A DeepSeek Harness (DSH) Web client plugin that adds a Model capabilities fold to every third-party (pi-ai) provider card on the Settings → Models page, declaring per model which inputs it accepts (whether images are allowed) and which reasoning levels it offers — the two per-model fields the page's own forms deliberately do not expose. Built against DSH 0.2.0-rc.2 (peer range >=0.2.0-rc.2 <0.3.0-0).

The providers themselves (provider ID, API base URL, protocol, API key, model list) are still created and edited entirely through the Models page forms; this plugin pre-writes no provider configuration.

What it does

Input modalities

  • A three-way choice per model — Provider default, Text only, or Text and image.
  • Exact adapter semantics — Text only writes input: [text], Text and image writes input: [text, image], and Provider default removes the field so the row inherits the installed catalog's modalities, then the route's defaultInput.

Reasoning levels

  • A three-way choice per model — Catalog default, Not a reasoning model, or Declare levels, which unfolds the seven levels (off, minimal, low, medium, high, xhigh, max) as a tick box plus the wire spelling to send for it.
  • Exact adapter semantics — a declared set writes the reasoningEfforts dict the adapter reads: every ticked level becomes a key whose value is the spelling dispatch sends, so max: ultra renames a level for a gateway with its own vocabulary, and an empty off stores a valueless off: — offered, and sent as no parameter at all. Not a reasoning model writes reasoningEfforts: false; Catalog default removes the field, keeping the installed catalog's capability, which for a hand-declared model is none.
  • A seed that assumes nothing about "off" — switching a row to a declared set starts from low/medium/high, each spelled as its own name, with off left unticked: on the plain reasoning_effort wire an empty off is the very same request as naming no effort, so pre-offering it would promise a stop-thinking choice the endpoint may not honour. Tick off — and spell it — once the endpoint says how.
  • This is what puts levels in the picker — the composer's model picker lists exactly the levels a model declares, so a gateway model added by hand gains its Off/Low/Medium/High choices here and nowhere else in the UI.
  • Refused before the write — the adapter rejects a declared set with no level beyond off, and any level but off with no wire value; the card names the offending row and keeps Save closed rather than answering a rejected settings mutation.

Both claims

  • One fold, one write — the two claims share the fold because they share the stored models array: two folds would each write it and fence each other into conflicts.
  • Revision-fenced writes — the whole models array is written back under the revision read when the fold was opened, with the same array semantics and conflict handling as the Models page's own cards: a concurrent edit surfaces a conflict notice and reloads instead of silently clobbering.
  • Field preservation — every other field of every row survives verbatim, including fields this card never shows.
  • Follows the page live — add or remove a model in the catalog above and the rows follow it in place: the fold listens for the pushed settings/document-updated invalidation of its own namespace, so nothing has to be closed and reopened. A commit that outruns a running read is caught by revision comparison and re-read until the fold is level. An unsaved draft is never overwritten, not even by a reopen — a change that lands mid-draft parks until the draft settles: revert the edits and the fold re-reads silently, or save and the revision fence refuses the raced write and reloads behind a conflict notice.
  • Localized UI — English and Chinese follow the Web UI's locale.

Usage

  1. Install (see below) and restart dsh web.
  2. Settings → Models: create your gateway provider with Add custom provider as usual, or open an existing one.
  3. A Model capabilities fold appears under every third-party provider card; expand it and, per model, pick its input modalities and its reasoning state — for a model that reasons, choose Declare levels and tick the levels its endpoint serves.
  4. Click Save. The claim lands in the user layer of $DSH_HOME/profiles//cordis.patch.yml; the adapter picks it up on its next request — no restart required.

A model declared here writes exactly this (other fields of the row untouched):

models:
- id: acme-think
contextWindow: 262144
maxTokens: 32768
input:
- text
- image
reasoningEfforts:
off: null      # offered, and sent as no parameter at all
low: low
medium: medium
high: high
max: ultra     # a gateway with its own vocabulary

How it works

The plugin registers its component into the settings.models.provider-card extension seat exposed by the Models page (key llm-pi-ai, i.e. the cards of the whole pi-ai adapter family). On first expansion the fold reads the provider's stored models rows through the settings Remote, edits them locally, and writes the whole array back under the revision captured at read time — the same array semantics and conflict handling as the page's own cards (a concurrent edit prompts a conflict notice and a reload). All fields other than input and reasoningEfforts are preserved verbatim in every row.

The fold also subscribes to the Host's forwarded settings/document-updated event and filters it to the provider directory’s actual settingsNs, so the page's own model-list writes reach it without a remount. An open, clean fold re-reads silently, and keeps re-reading until its data is level with the newest announced revision; a closed one parks the notice and re-reads on the next expansion; one holding an unsaved draft parks the notice until the draft settles, so a reopen never costs edits. The card's own write is recognised by the revision it just committed and does not echo back as a refresh.

Plugin settings and migration

The Plugins → Model capabilities page also lists the capability editors for configured third-party providers. The existing Settings → Models card entry remains; both edit the same configuration.

On the first start of each profile, the Host imports the old llm-pi-ai section from $DSH_HOME/settings.yaml, or settings.yaml.imported if DSH has already renamed it. Providers, model lists, input modalities, reasoning levels, and key references move into the actual pi-ai entry. The compatibility import only fills missing profile values, arrays stay intact, and successful imports record a migration marker. Failures retain the source and retry on restart. If multiple pi-ai entries have all been renamed, the plugin reports the ambiguity and leaves the source for manual assignment. It does not create extra providers or change credential storage. Back up DSH_HOME before upgrading; settings are profile-local afterward.

Plugin display metadata is exported as locale/en.json and locale/zh.json, using meta.title and meta.description. DSH localizes the plugin list, details, and component names; the ordinary package description remains English for npm.

The manifest declares a packaged SVG with icon: "./icon.svg". The plugin uses a purple image/control mark.

Installation

Prerequisites: DeepSeek Harness (dsh) >=0.2.0-rc.2 <0.3.0-0 with the web profile.

From npm:

dsh plugin --profile web add @jcy2387/dsh-models-input-modalities@0.2.0-rc.2
dsh web

From a local checkout (development):

git clone https://github.com/DamonBao/dsh-models-input-modalities.git
cd dsh-models-input-modalities
pnpm install && pnpm run build
dsh plugin --profile web add link:$PWD
  • link: references this directory directly; after a change run pnpm run build and restart dsh. Without the link: prefix the install is a copy — update it with dsh plugin --profile web update.
  • Uninstall: dsh plugin --profile web remove @jcy2387/dsh-models-input-modalities.

Development

Requirements: Node.js ^22.19.0 || >=24.0.0 and pnpm 11.7.

pnpm install
pnpm run check        # typecheck + test + build + publint, same as CI

Individual commands:

pnpm run typecheck    # host + client faces
pnpm test             # row, controller, and migration tests
pnpm run build        # tsc d.ts + tsdown (lib/index.js & lib/client.cjs)

The client artifact is a self-contained bundle: React, Cordis, ui-slots, and ui-primitives are supplied by the Web shell, CSS Modules are inlined, and every other @deepseek-ai/* package is a type-only import (enforced by a build-time purity check).

CI (.github/workflows/ci.yml) runs the same gates on Node 22.22.0 and 24.x, verifies on tag pushes that the release tag matches the package version, audits the packed tarball's file list, and runs a consumer smoke test that installs the tarball into a scratch project (resolving the published peer ranges against the real registry) and imports every Node-side entry point.

Release

Publishing is automated by the Release workflow (.github/workflows/release.yml), which runs whenever a GitHub Release is published. It requires the release tag to equal the package version (an optional v prefix is stripped), re-runs the full quality gates, packs the tarball, and publishes to npm with provenance via OIDC trusted publishing — no long-lived NPM_TOKEN secret is involved.

One-time setup: configure trusted publishing on npmjs.com for @jcy2387/dsh-models-input-modalities, authorizing repository DamonBao/dsh-models-input-modalities with workflow release.yml (no environment).

The dist-tag follows the GitHub Release's pre-release flag: a full release (checkbox unchecked) publishes under latest — including rc versions — while a pre-release publishes under the channel tag derived from the version (0.1.1-alpha.2 → alpha, 0.1.1-rc.1 → rc). The workflow is idempotent — a version that already exists on npm is skipped, so a re-run after a partial failure republishes only what is missing.

A typical release:

# bump the version in package.json, then:
pnpm run check
VERSION="$(node -p "require('./package.json').version")"
git commit -am "release: $VERSION"
git tag "$VERSION"
git push origin main --tags

Then create and publish a GitHub Release for that tag.

Dependabot checks GitHub Actions dependencies weekly. npm version updates are intentionally not enabled for Dependabot: it regenerates pnpm-lock.yaml without the workspace overrides, so its PRs cannot pass pnpm install --frozen-lockfile — bump dependencies manually with pnpm update.

Repository layout

.
├─ src/
│  ├─ index.ts             # Host half: profile-local legacy provider settings import
│  ├─ model-row.ts         # the row vocabulary both claims share
│  ├─ image-input.ts       # pure row helpers for the per-model input claim
│  ├─ reasoning-efforts.ts # pure row helpers for the per-model reasoning claim
│  └─ client/              # Web half: the capability fold (controller, card, locales)
├─ tests/                  # row, controller, and migration tests
├─ build/                  # tsdown preset for the self-contained client bundle
├─ .github/workflows/ci.yml       # validate + tarball audit + consumer smoke
├─ .github/workflows/release.yml  # npm publish on GitHub Release
├─ cordis.patch.yml
└─ README.md / README.zh.md

Known limitations

  • Dormant (not yet configured) provider cards do not render the fold; a freshly created custom provider appears after it is saved.
  • Route-level knobs — defaultInput, the default reasoning level, and the compat switches — plus modelOverrides for built-in provider-catalog models are out of this plugin's scope; set them directly in $DSH_HOME/profiles//cordis.patch.yml.
  • A declared level is a claim, not a check: nothing asks the gateway whether it serves that level or honors that spelling, and how the level travels on the wire (reasoning_effort, a thinking budget, chat-template kwargs) is compat's job. A level the endpoint refuses is refused by the provider, mid-turn.
  • A level unticked and ticked again restarts from its default spelling — its own name, empty for off — rather than reviving what it carried before.
  • In read-only settings deployments the fold is visible but cannot save.

License

MIT © jcy2387

常见问题

8 问
答案由本站依据条目字段整理,不引用上游原文
dsh-models-input-modalities 怎么安装?

在 DSH 里执行 `dsh plugin --profile web add @jcy2387/dsh-models-input-modalities@0.1.3` 即可。

dsh-models-input-modalities 的验证等级是什么意思?

L5 · 运行验证通过。在 dsh 沙盒中完成安装与运行冒烟——装得上、跑得起来

dsh-models-input-modalities 安全吗?

低风险。vet 静态分析未发现可疑行为,判定为干净(clean)。

dsh-models-input-modalities 装之前要先确认什么?

先看它会读写哪些文件、执行哪些命令、连接哪些网络地址;验证等级只说明装得上、跑得起来,不等于安全。涉及密钥或系统权限的,建议先在隔离环境试装。

dsh-models-input-modalities 支持哪些 DSH 版本?

上游记录的兼容版本包括 0.2.0-rc.2、0.1.7-rc.2、0.1.7-rc.1、0.1.7-alpha.2、0.1.6-alpha.2、0.1.6-alpha.1。

dsh-models-input-modalities 用的是什么许可证?

上游标注为 MIT。商用或二次分发前请到仓库确认许可证原文。

dsh-models-input-modalities 有哪些功能?

模型设置页新增能力折叠区、逐模型声明图片输入支持、逐模型配置推理等级、覆盖第三方 pi-ai 提供商。

这条记录的数据可靠吗?

本站按仓库名去重后合并整理,字段以作者仓库与 npm 元数据为准;安装命令、仓库地址与 README 保持原文,带 L4 / L5 标记的安装命令已在隔离沙盒里真实跑通。

视觉与多模态
按星标排序,可作替代方案

open-design

open-design

L4 · 沙盒安装通过 10.0 万 星

awesome-gpt-image-2

awesome-gpt-image-2

GPT Image 2 / 2.5 提示词与案例库,530+ 个案例、20+ 套工业级模板与可复用 Skills,新增 2.5 同提示词对比

L3 · 安装规范通过 3.4 万 星

PicGo

PicGo

L3 · 安装规范通过 2.7 万 星

iPolloWork

iPolloWork

L4 · 沙盒安装通过 6,775 星

modlens

modlens

ModLens 是 DeepSeek Harness 的视觉插件,为纯文本模型外挂视觉能力,粘贴图片即得结构化 JSON 证据(OCR、版面

L5 · 运行验证通过 4,207 星

OpenBiliClaw

OpenBiliClaw

本地私有、开源的自进化跨平台 AI 内容发现 Agent:先理解你,再主动从 B站、小红书、抖音、YouTube、X、知乎、Reddit、微

L4 · 沙盒安装通过 3,398 星

DamonBao 的其它插件

2 个

插件的元信息来自作者仓库;分类、验证等级与安全结论的中文说明为中文整理,最近核验 2026-10-08。