OpenEye

MCP开发工具

提供方 未标注

开发工具 stdio · 本地进程 API Key 社区 / 第三方 Claude DesktopClaudeCursorVS Code
查看接入方式

Give AI agents real computer vision: pull and run YOLO, RF-DETR, Grounding DINO, Depth Anything V2 and SAM 2 locally for object detection, depth and...

一句话选型结论

按资料字段整理

OpenEye 属于开发工具类 MCP 服务器,stdio · 本地进程,API Key,可直接接入 Claude Desktop、Claude、Cursor 等,有可直接执行的安装命令。接入前先确认权限范围;涉及写入、删除或付款的操作,建议先在测试环境验证。

分类开发工具 传输方式stdio · 本地进程 鉴权API Key 部署方式本地部署
GitHub 星标 未标注 仓库热度,无公开仓库时显示未标注
工具数 未标注 暴露给模型的工具数量
资源 / 提示词 0 / 0 资源与提示词模板数量
维护方 社区 / 第三方 核验等级 仅资料核对

工具与能力

开发工具
数量来自来源目录的标注,具体工具清单以官方文档为准
工具数量未标注暴露给模型可调用的工具个数
资源数量0可读取的资源条目
提示词数量0内置提示词模板数量

能力标签

支持客户端

适用场景

Development

安装与配置

stdio · 本地进程 API Key
客户端在本机拉起子进程,数据不出本机
pipx install openeye-sh

这条命令只是入口,具体启动参数请按官方文档补齐,不要直接照搬到别的服务器。

  1. 1
    准备运行环境

    stdio 服务在本地起进程,需要先装好 Node.js 等运行时,再按安装命令拉取依赖。

  2. 2
    安装服务

    复制上面的安装命令执行;命令里带占位符的位置,换成自己的密钥或路径。

  3. 3
    写入客户端配置

    在客户端的 MCP 配置里填好启动命令和参数,保存后完全退出客户端再打开,让新配置生效。

  4. 4
    验证是否可用

    连接成功后随便调一个只读工具,确认能返回结果,再接入正式流程。

典型使用场景

3 类
按分类与标签整理的常见用法,具体以官方文档为准
代码与仓库操作

在对话里直接查代码、提 issue、走 PR,省掉来回切工具。

本地命令与脚本

把构建、测试、格式化这类重复命令交给模型执行。

接口联调与测试

让模型调你的接口、跑一遍用例,快速定位问题。

选择建议

选之前先看这几条
按条目字段给出的判断,不替你决定用不用

值得选的地方

  • 有现成的安装命令,不用自己找入口,照着跑就能起服务。
  • 已适配 Claude Desktop、Claude、Cursor,换客户端不用重新研究配置。

先想清楚的地方

  • stdio 方式要求本地装好运行时(如 Node.js),换机器要重新装一遍。
  • 使用前要准备好API Key对应的凭据,并按最小权限配置。
  • 资料没标注工具数量,实际能力要装好后确认。
  • 版本更新与行为细节以官方仓库为准。

更适合

  • 需要在开发工具场景里让模型直接调用外部能力的人。
  • 已经在用 Claude Desktop、Claude 的用户,接入路径最短。
  • 想先快速试一下、能接受在本地或自有环境跑服务的人。

不太适合

  • 完全不想在本地装环境的人。
  • 不方便管理密钥或第三方授权的人。
  • 需要厂商级 SLA 和技术支持的生产环境。

同类对比

6 个同类
同分类里挑最接近的几条,字段以各自详情页为准
MCP 服务器工具数传输方式部署方式安装命令最后核验
OpenEye当前 未标注 stdio · 本地进程 本地部署 有 2026-11-20
Git 838e2ec1 12 stdio · 本地进程 本地部署 有 2026-05-17
Markitdown MCP 2c653a5f 1 stdio · 本地进程 本地部署 有 2026-05-17
JavaGuide 未标注 stdio · 本地进程 本地部署 有 2026-04-11
awesome-claude-skills 未标注 stdio · 本地进程 本地部署 有 2026-04-26
Context7 831acf40 未标注 stdio · 本地进程 本地部署 有 2026-05-17

服务器档案

开发工具
字段来自项目仓库与公开索引,中文说明由本站标注
提供方未标注上游标注的维护方 未标注
分类开发工具本站按上游分类展示
连接方式stdio · 本地进程客户端在本机拉起子进程,数据不出本机
鉴权方式API Key远程服务建议用最小权限凭据
维护方社区 / 第三方核验等级 仅资料核对
包名 / 运行时未标注 · 未标注本地安装时用到的包标识与运行时
部署类型本地部署上游给出的部署形态
最近核验2026-11-20上游最后核验时间

详细介绍

9.7 KB
来自项目仓库与上游目录的原文,未做删改

OpenEye

Open-source eyes for the agent era.

Website · Docs · Models · Blog · PyPI

OpenEye is a CLI-first perception engine that turns raw video into structured world models for robots and autonomous agents. Pull, run, and serve computer-vision models from your terminal — like Ollama, but for vision AI.

Features

  • Object Detection — YOLOv8, YOLO26 (currently ships YOLO11n weights), Grounding DINO, RF-DETR, and custom adapters
  • Depth Estimation — Monocular depth via Depth Anything V2
  • Segmentation — SAM2 segment anything
  • Scene Understanding — Spatial relationships, scene graphs, natural language queries
  • VLM Reasoning — Vision-language model integration (Nebius, OpenRouter)
  • Agentic Loop — Continuous perception → reasoning → planning pipeline
  • Safety Monitoring — Zone-based awareness with real-time human detection and robot halt
  • CLI-Native — Every capability accessible from the terminal
  • REST + WebSocket API — Serve models over HTTP with a single command
  • Fleet Management — Register, deploy, and monitor edge devices at scale
  • MLOps — Model registry, versioning, A/B testing, batch inference
  • Governance — Policy enforcement, audit logging, safety rule management
  • Hosted API — https://openeye.sh/v1 for object detection without running anything locally (pay per call in credits)
  • Web Dashboard — openeye.sh/dashboard: API keys, credits, history, fleet management, and — connected to your own openeye serve — inference, live streams, and more

Quick Install```bash

pipx install openeye-sh


With YOLO support:```bash
pipx install "openeye-sh[yolo]"

Quick Start```bash

Pull a model

openeye pull yolov8

Run inference on an image

openeye run yolov8 photo.jpg

Start the server with REST API, WebSocket, and browser dashboard

openeye serve yolov8

Live camera feed with real-time detections

openeye watch --models yolov8

Live camera feed with safety monitoring

openeye watch --models yolov8 --safety


## Give Your AI Agent Eyes (MCP)

OpenEye ships an MCP server, so Claude, Cursor, or any MCP client can pull models and run detection, depth, and segmentation on your machine:```bash
pipx install "openeye-sh[mcp]"
claude mcp add openeye -- openeye-mcp

Then ask: "Run yolov8 on ~/Pictures/desk.jpg and tell me what's on my desk." Setup for Claude Desktop and other clients: docs/claude-skill.

Hosted API Quick Start

No GPU or local install needed for detection:

  1. Sign in at openeye.sh (email/password or 1Profile).
  2. Create a key in Dashboard → Settings → API Keys (keys start with oe_ and are shown once).
  3. Buy credits in Dashboard → Settings → Credits.
  4. Call the API:```bash
    curl -X POST https://openeye.sh/v1/detect \
    -H "Authorization: Bearer oe_your_key_here" \
    -F "file=@photo.jpg"

or with the CLI

export OPENEYE_API_KEY=oe_your_key_here
openeye api detect photo.jpg
openeye api usage


| Endpoint | Status | Credits |
|----------|--------|---------|
| `POST /v1/detect` | Live (YOLOv8n, JPEG/PNG under 4 MB) | 1 |
| `POST /v1/describe` | Returns `503` until the VLM is enabled on the hosted API | 3 |
| `POST /v1/depth` | Returns `501` — self-hosted only (`openeye serve depth-anything`) | 2 |
| `GET /v1/models`, `GET /v1/usage` | Live | free |

The hosted API has no WebSocket streaming; for streaming, run `openeye serve`. See the docs for details.

## Use the Dashboard with a Local Server

`openeye serve` allows requests from `https://openeye.sh` by default, so the hosted dashboard can drive a server on your machine:```bash
openeye serve yolov8          # http://localhost:8000

Open openeye.sh/dashboard, click Server on the Overview page (the "OpenEye Server URL" dialog), and enter http://localhost:8000. Inference, Live, Scene Graph, Metrics, Benchmark, Config, Governance, MLOps, and the live agent loop then run against your server. If your browser blocks the connection from an HTTPS page to localhost, serve OpenEye over HTTPS instead.

Interactive CLI Demo

An interactive walkthrough that runs real OpenEye commands against sample images. Great for evaluating the tool, onboarding, or live presentations.

Prerequisites

  • Python 3.12+
  • jq (optional, for JSON pipeline steps — brew install jq)
  • curl (for the API server step)

Setup```bash

Install the CLI with YOLO and camera support

pipx install -e "./cli[yolo,camera]"

Pull the YOLOv8 model (6 MB)

openeye pull yolov8


### Run the Demo```bash
./demo.sh

demo.sh is a bash script: run it on macOS, Linux, WSL, or Git Bash on Windows. It uses openeye from your PATH (pipx), falling back to ./.venv or cli/.venv. In plain PowerShell or cmd, run the same steps yourself:```bash
openeye list
openeye pull yolov8
openeye run yolov8 src/assets/demo/scene-warehouse.jpg --pretty
openeye run yolov8 src/assets/demo/scene-warehouse.jpg --visualize
openeye bench yolov8 --warmup 2 --runs 5
openeye serve yolov8 --port 8111


The demo is interactive — press **Enter** to advance between steps. Each step shows the command being run and its live output.

### What the Demo Covers

Step · Command · What it demonstrates
1 · `openeye list` · Browse the model registry (7 vision models)
2 · `openeye pull yolov8` · Download a model — like `ollama pull`
3 · `openeye run yolov8 scene-warehouse.jpg --pretty` · Object detection with structured JSON output
4 · `openeye run yolov8 scene-kitchen.jpg --pretty` · Detection on a different scene (apple, cup, donut)
5 · `openeye run ... --visualize` · Save an annotated image with bounding boxes
6 · `openeye run ... \ · jq` · Unix pipeline composability — pipe JSON to jq
7 · `openeye bench yolov8` · Benchmark inference speed (latency, FPS, P95)
8 · `openeye serve yolov8` · Launch a REST API server and query it with curl
9 · Batch loop · Process all 4 demo images and summarize results

### Demo Images

Four sample images are included in `src/assets/demo/`:

| Image | Scene | Typical detections |
|-------|-------|--------------------|
| `scene-warehouse.jpg` | Warehouse with people and vehicles | person, truck, tv |
| `scene-kitchen.jpg` | Kitchen countertop | apple, cup, donut, bottle |
| `scene-workshop.jpg` | Workshop environment | person, dining table, remote, knife |
| `safety-workspace.jpg` | Safety-critical workspace | (used for safety guardian demos) |

### Output

Annotated images are saved to `demo_output/`. The API server step temporarily runs on port 8111 and shuts down automatically.

### Beyond the Demo

Commands not covered in the scripted demo that you can try interactively:```bash
# Live webcam detection with terminal overlay
openeye watch --models yolov8

# Safety Guardian — zone-based human proximity alerts
openeye watch --models yolov8 --safety --danger-m 0.5 --caution-m 1.5

# Unitree G1 robot safety demo (dry-run, no robot needed)
openeye g1-demo --control-mode dry_run --demo

# Agentic perception loop — perceive, reason, act
openeye agent run

# Edge device fleet management
openeye fleet ls

# Open-vocabulary detection with text prompts (requires grounding-dino)
openeye pull grounding-dino
openeye run grounding-dino photo.jpg --prompt "person. hard hat. forklift."

Project Structure```

openeye.sh/
├── cli/ # openeye-sh CLI & inference server (Python)
├── backend/ # Perception engine runtime (Python)
├── src/ # React web frontend (TypeScript)
├── api/ # Vercel functions (auth, data, credits, /v1 API)
├── db/ # Postgres schema
└── docs/ # MkDocs documentation site


| Package | Description | Language |
|---------|-------------|----------|
| `cli/` | CLI tool & FastAPI inference server (port 8000), MCP server (`openeye-mcp`) | Python |
| `backend/` | Perception pipeline, self-hosted fleet control plane (port 8001), governance engine | Python |
| `src/` | Website and dashboard at openeye.sh | TypeScript/React |
| `api/` | Vercel functions: Better Auth (`/api/auth`), dashboard data (`/api/data`), credits proxy (`/api/cred`), hosted inference API (`/v1`) | TypeScript |
| `db/` | Postgres schema (`schema.sql`) shared by the website and the fleet control plane | SQL |

## Tech Stack

**CLI & Backend**: Python, Typer, Rich, FastAPI, Uvicorn, Pydantic

**Frontend**: React, TypeScript, Vite, Tailwind CSS, shadcn/ui, TanStack Query

**Website & API**: Vercel (static SPA + functions in `api/`), Neon Postgres, Vercel Blob (avatars)

**Auth**: Better Auth — email/password and "Continue with 1Profile"; Google/Apple sign-in when their OAuth credentials are configured

**Credits**: Cred, proxied through `/api/cred`

**AI/ML**: Ultralytics (YOLO), Transformers, ONNX Runtime, TensorRT, LangChain

## Development

### Frontend```bash
npm install
npm run dev          # Vite only, http://localhost:8080 (no api/ functions)

To run the api/ functions too (sign-in, dashboard data, credits, /v1), use the Vercel CLI:```bash
vercel env pull .env.local # DATABASE_URL, BETTER_AUTH_SECRET, ... (see .env.example)
npm run db:migrate # apply db/schema.sql to that database
vercel dev


Without the server functions you can still use **Continue as Demo User** on the login page.

### CLI```bash
cd cli
pip install -e ".[all]" --group dev

Backend```bash

cd backend
pip install -e . --group dev
```

The fleet control plane in backend/src/fleet is self-hosted: point DATABASE_URL at a Postgres database (Neon works) with db/schema.sql applied. See backend/.env.example.

Documentation

  • openeye.sh/docs — the main docs (source: src/data/docs/)
  • docs/ — MkDocs Material site with longer guides and tutorials

License

See LICENSE for details.

常见问题

8 问
答案由本站依据条目字段整理,不引用上游原文
OpenEye 怎么安装?

在客户端按下面的安装命令接入:pipx install openeye-sh。装完在客户端配置里引用同一个包或端点。

OpenEye 怎么在 Claude Desktop、Claude、Cursor 里配置?

它的传输方式是stdio · 本地进程,在客户端的 MCP 配置里填好启动命令和参数,保存后完全退出客户端再打开,配置才会生效。

OpenEye 收费吗?

本站不代收费用,也没有标注具体价格。是否收费取决于服务本身和背后的接口额度,正式使用前按官方说明确认。

OpenEye 需要 API Key 吗?

资料标注需要API Key认证,使用前准备好对应凭据,并按最小权限配置。

OpenEye 支持哪些客户端?

资料标注支持 Claude Desktop、Claude、Cursor、VS Code、Gemini CLI、Codex;其他客户端只要能配置 MCP Server,也能用同样的命令或地址接入。

OpenEye 能提供哪些能力?

资料显示能力标签包括 Development。具体工具清单以官方文档为准。

OpenEye 需要什么运行环境?

属于本地进程,需要在本机装好运行环境。

OpenEye 是本地还是远程?

它是本地进程(stdio),由客户端在本机拉起。传输方式为stdio · 本地进程。

热门专题

按标签挑服务器
全部专题 →

服务器信息以作者仓库与官方文档为准;分类、传输方式与鉴权方式的中文说明为中文整理,最近核验 2026-11-20。