LLM MCP 76b8d59c

MCPAI代理

提供方 AuraFriday

AI代理 未标注 无需鉴权 社区 / 第三方 Claude

MCP服务器支持本地运行大型语言模型,并集成工具调用功能,实现完全离线的AI自治代理。

一句话选型结论

按资料字段整理

LLM MCP 76b8d59c 属于AI代理类 MCP 服务器,传输方式未标注,无需鉴权,可直接接入 Claude,没有现成安装命令,需按官方文档接入。接入前先确认权限范围;涉及写入、删除或付款的操作,建议先在测试环境验证。

分类AI代理 传输方式未标注 鉴权无需鉴权 部署方式未标注
GitHub 星标 2 仓库热度,无公开仓库时显示未标注
工具数 未标注 暴露给模型的工具数量
资源 / 提示词 0 / 0 资源与提示词模板数量
维护方 社区 / 第三方 核验等级 仅资料核对

工具与能力

AI代理
数量来自来源目录的标注,具体工具清单以官方文档为准
工具数量未标注暴露给模型可调用的工具个数
资源数量0可读取的资源条目
提示词数量0内置提示词模板数量

能力标签

支持客户端

适用场景

本地AIPython本地部署工具调用离线计算隐私保护自治代理

安装与配置

未标注 无需鉴权
上游未给出传输方式
  1. 1
    准备运行环境

    按官方文档确认运行环境(常见为 Node.js 或 Python),装好后再执行安装命令。

  2. 2
    安装服务

    复制上面的安装命令执行;命令里带占位符的位置,换成自己的密钥或路径。

  3. 3
    写入客户端配置

    在客户端的 MCP 配置里填好启动命令和参数,保存后完全退出客户端再打开,让新配置生效。

  4. 4
    验证是否可用

    连接成功后随便调一个只读工具,确认能返回结果,再接入正式流程。

典型使用场景

3 类
按分类与标签整理的常见用法,具体以官方文档为准
给代理接外部能力

让代理在任务中途调用搜索、数据库等真实工具。

多步任务编排

把一串操作拆成步骤,由代理按顺序执行。

自动化重复流程

把固定流程交给代理跑,减少手工操作。

选择建议

选之前先看这几条
按条目字段给出的判断,不替你决定用不用

值得选的地方

  • 已适配 Claude,换客户端不用重新研究配置。
  • 资料标注无需鉴权,装好就能连。

先想清楚的地方

  • 没有现成安装命令,需要按官方文档自己填启动命令和参数。
  • 资料没标注工具数量,实际能力要装好后确认。
  • 版本更新与行为细节以官方仓库为准。

更适合

  • 需要在AI代理场景里让模型直接调用外部能力的人。
  • 已经在用 Claude 的用户,接入路径最短。
  • 想先快速试一下、能接受在本地或自有环境跑服务的人。

不太适合

  • 需要厂商级 SLA 和技术支持的生产环境。

同类对比

6 个同类
同分类里挑最接近的几条,字段以各自详情页为准
MCP 服务器工具数传输方式部署方式安装命令最后核验
LLM MCP 76b8d59c当前 未标注 未标注 未标注 无 2026-05-17
Filesystem 560c4363 13 未标注 本地部署 无 2026-05-17
Server Everything (everything) 11 stdio · 本地进程 本地部署 有 2026-05-17
Time 7365cb6d 2 SSE · 服务端推送 远程部署 有 2026-05-18
Everything Claude Code 未标注 stdio · 本地进程 本地部署 有 2026-05-17
Openmemory 557e1585 未标注 stdio · 本地进程 本地部署 有 2026-05-17

服务器档案

AI代理
字段来自项目仓库与公开索引,中文说明由本站标注
提供方AuraFriday上游标注的维护方 AuraFriday
分类AI代理本站按上游分类展示
连接方式未标注上游未给出传输方式
鉴权方式无需鉴权远程服务建议用最小权限凭据
维护方社区 / 第三方核验等级 仅资料核对
包名 / 运行时未标注 · 未标注本地安装时用到的包标识与运行时
部署类型未标注上游给出的部署形态
最近核验2026-05-17上游最后核验时间

详细介绍

15.9 KB
来自项目仓库与上游目录的原文,未做删改

LLM — Unified AI Chat Completions with Streaming

MCP tool providing unified LLM access: local models, OpenRouter, and direct API connections — all with native tool-calling and streaming support.

> One tool. Every LLM. Local or cloud. Tool-calling built in. Run local models offline with full privacy, or connect to OpenRouter/OpenAI/Anthropic for frontier capabilities — same interface, same streaming, same tool-calling support.


Benefits

1. One Interface, Every Provider

Not locked to one backend. Local models (transformers, Ollama, llama.cpp), OpenRouter (100+ cloud models), and direct API connections (OpenAI, Anthropic, Google) all through the same operations. Switch providers by changing one parameter.

2. Streaming First

Not request-response — real-time tokens. Native SSE streaming delivers tokens as they generate, to Android apps, Chrome extensions, and desktop UIs. The tool returns a stream_id immediately; the server pushes deltas over SSE until completion.

3. Autonomous Tool-Calling

Not just text generation — AI agents. Models (local via Ollama, or cloud) can call MCP tools automatically during generation. Query databases, control browsers, show UI popups — all within a single completion request.

4. Multimodal Support

Not text-only — images too. Vision-language models (VL) accept images alongside text. Send a screenshot and ask what's on screen. Works with both local VL models and cloud multimodal APIs.

5. Complete Privacy When You Need It

Not cloud-dependent. Local models run on your hardware. Data never leaves your machine. Perfect for sensitive work, proprietary code, or air-gapped environments. Use cloud when you need frontier capabilities; use local when you need privacy.


Why This Tool Changes LLM Access

Cloud APIs are powerful but limited. OpenAI, Anthropic, Google — great models, but you pay per token, data leaves your network, and you're dependent on their availability.

Existing local LLM tools are basic. Ollama, LM Studio, llama.cpp — good for chat, but limited tool-calling, no unified MCP integration, no streaming to multiple clients.

This tool bridges both worlds. One unified interface for every LLM backend, with streaming, tool-calling, and multimodal support regardless of whether the model runs locally or in the cloud. Named endpoints in settings let you define backends once and reference them by name.

Tool-calling is cloud-only. OpenAI's function calling, Anthropic's tool use — powerful features locked to cloud APIs. Local models can't compete.

This tool solves all of that.

Run models locally with:
- Full tool-calling support (OpenAI-compatible format)
- Automatic MCP tool integration
- Hardware optimization (CUDA/CPU, quantization)
- OpenRouter-compatible interface
- Zero cloud dependencies

Your AI can now be an autonomous agent, calling tools and making decisions, all running on your hardware.


Real-World Story: The Air-Gapped Environment

The Problem:

A defense contractor needed AI assistance for code analysis. Security requirements:
- No internet connection allowed
- No data can leave the facility
- No cloud API access
- Must work on classified networks

Standard solution: None. All major AI assistants require internet.

With This Tool:```python

1. Check hardware capabilities

hardware = hardware_info()

Shows: CUDA available, 24GB VRAM, RTX 4090

2. List installed models

models = list_installed_models()

Shows: Qwen2.5-7B-Instruct (7GB), Llama-3.1-8B (8GB)

3. Run local AI with tool-calling

response = chat_completion(
model="Qwen/Qwen2.5-7B-Instruct",
messages=[
{"role": "user", "content": "Analyze the security of auth.py"}
],
tools=[
{
"type": "function",
"function": {
"name": "read_file",
"description": "Read file contents",
"parameters": {
"type": "object",
"properties": {
"path": {"type": "string"}
}
}
}
}
],
auto_execute_tools=True # Autonomous mode
)

Model reads file, analyzes code, returns findings

All local, no internet, no cloud APIs


**Result:**

- Code analysis working in air-gapped environment
- AI can read files, analyze patterns, suggest improvements
- Zero data exfiltration risk
- Unlimited usage, no costs
- Full audit trail of all operations

**The kicker:** Same setup now powers their entire development workflow. Code review, documentation generation, test creation — all local, all private, all autonomous.

---

## The Complete Feature Set

### Hardware Detection

**Check Capabilities:**```python
# Get hardware info
info = hardware_info()

# Returns:
# {
#   "cuda_available": true,
#   "cuda_version": "12.1",
#   "gpu_name": "NVIDIA RTX 4090",
#   "gpu_memory_gb": 24,
#   "cpu_cores": 16,
#   "ram_gb": 64,
#   "recommended_models": ["7B", "13B", "30B"]
# }

Why hardware detection matters: Automatically selects appropriate models and quantization based on your hardware. No manual configuration needed.

Model Management

List Installed Models:```python

See what's already downloaded

models = list_installed_models()

Returns list of cached models:

[

{

"id": "Qwen/Qwen2.5-7B-Instruct",

"size_gb": 7.2,

"type": "text-generation",

"supports_tools": true,

"cache_path": "~/.cache/huggingface/..."

}

]


**Model Information:**```python
# Get details about a specific model
info = model_info(model="Qwen/Qwen2.5-7B-Instruct")

# Returns:
# {
#   "name": "Qwen2.5-7B-Instruct",
#   "size_gb": 7.2,
#   "context_length": 32768,
#   "supports_tools": true,
#   "supports_vision": false,
#   "quantization_options": ["4bit", "8bit", "none"],
#   "recommended_vram_gb": 8
# }

Why model management matters: Know what's installed, what's possible, what will fit in your VRAM. Make informed decisions about which models to use.

Chat Completions

Basic Chat:```python

Simple text generation

response = chat_completion(
model="Qwen/Qwen2.5-7B-Instruct",
messages=[
{"role": "user", "content": "Explain quantum computing"}
]
)


**Multi-Turn Conversations:**```python
# Maintain conversation history
response = chat_completion(
    model="Qwen/Qwen2.5-7B-Instruct",
    messages=[
        {"role": "system", "content": "You are a helpful coding assistant"},
        {"role": "user", "content": "Write a Python function to sort a list"},
        {"role": "assistant", "content": "Here's a sorting function..."},
        {"role": "user", "content": "Now optimize it for large lists"}
    ]
)

Temperature and Sampling:```python

Control randomness and creativity

response = chat_completion(
model="Qwen/Qwen2.5-7B-Instruct",
messages=[{"role": "user", "content": "Write a creative story"}],
temperature=0.9, # More creative
top_p=0.95,
max_tokens=1000
)


**Tool-Calling (Autonomous Agents):**```python
# AI can call MCP tools automatically
response = chat_completion(
    model="Qwen/Qwen2.5-7B-Instruct",
    messages=[
        {"role": "user", "content": "Show me all browser tabs and save to database"}
    ],
    tools=[
        {
            "type": "function",
            "function": {
                "name": "browser_list_tabs",
                "description": "Get all open browser tabs",
                "parameters": {"type": "object", "properties": {}}
            }
        },
        {
            "type": "function",
            "function": {
                "name": "sqlite_execute",
                "description": "Execute SQL query",
                "parameters": {
                    "type": "object",
                    "properties": {
                        "sql": {"type": "string"},
                        "database": {"type": "string"}
                    }
                }
            }
        }
    ],
    auto_execute_tools=True  # Autonomous mode
)

# Model will:
# 1. Call browser_list_tabs
# 2. Process results
# 3. Call sqlite_execute to save data
# 4. Return summary

Why tool-calling matters: Local AI becomes an autonomous agent. Not just answering questions — taking actions, calling tools, completing complex workflows.

Hardware Optimization

Automatic Quantization:```python

Let tool decide best quantization

response = chat_completion(
model="Qwen/Qwen2.5-7B-Instruct",
messages=[{"role": "user", "content": "Hello"}],
quantization="auto" # Chooses 4bit/8bit/none based on VRAM
)


**Device Selection:**```python
# Control where model runs
response = chat_completion(
    model="Qwen/Qwen2.5-7B-Instruct",
    messages=[{"role": "user", "content": "Hello"}],
    device="cuda"  # or "cpu" or "auto"
)

Why optimization matters: Run larger models on limited hardware. 7B model in 4-bit quantization fits in 4GB VRAM. 13B model fits in 8GB. Automatic selection ensures best performance for your hardware.


Usage Examples

Hardware Info```json

{
"input": {
"operation": "hardware_info",
"tool_unlock_token": "YOUR_TOKEN"
}
}


### List Installed Models```json
{
  "input": {
    "operation": "list_installed_models",
    "tool_unlock_token": "YOUR_TOKEN"
  }
}

Model Info```json

{
"input": {
"operation": "model_info",
"model": "Qwen/Qwen2.5-7B-Instruct",
"tool_unlock_token": "YOUR_TOKEN"
}
}


### Chat Completion```json
{
  "input": {
    "operation": "chat_completion",
    "model": "Qwen/Qwen2.5-7B-Instruct",
    "messages": [
      {"role": "user", "content": "Explain quantum computing"}
    ],
    "temperature": 0.7,
    "max_tokens": 1000,
    "tool_unlock_token": "YOUR_TOKEN"
  }
}

Chat with Tool-Calling```json

{
"input": {
"operation": "chat_completion",
"model": "Qwen/Qwen2.5-7B-Instruct",
"messages": [
{"role": "user", "content": "Get browser tabs and save to database"}
],
"tools": [
{
"type": "function",
"function": {
"name": "browser_list_tabs",
"description": "Get all open browser tabs",
"parameters": {"type": "object", "properties": {}}
}
}
],
"auto_execute_tools": true,
"tool_unlock_token": "YOUR_TOKEN"
}
}
```


Technical Architecture

Supported Models

Text Generation:
- Small (0.5-3B): Qwen2.5-0.5B, Phi-3-mini, Gemma-2-2B
- Medium (7-13B): Llama-3.1-8B, Qwen2.5-7B, Mistral-7B
- Large (30B+): Llama-3.1-70B, Qwen2.5-32B

Tool-Calling Support:
- Qwen2.5-Instruct family (recommended)
- Llama-3.x Instruct
- Any model with function-calling training

Multi-Modal (Future):
- LLaVA (vision + text)
- Qwen2-VL (vision + text)
- KOSMOS-2 (vision + text)

Hardware Requirements

Minimum (CPU-only):
- 8GB RAM
- 4-core CPU
- Small models only (0.5-3B)

Recommended (GPU):
- 8GB+ VRAM (NVIDIA GPU)
- CUDA 11.8+
- Medium models (7-13B) with quantization

Optimal (High-end GPU):
- 24GB+ VRAM
- CUDA 12.1+
- Large models (30B+) or unquantized medium models

Quantization

4-bit (BitsAndBytes):
- ~4GB VRAM for 7B model
- Minimal quality loss
- 4x memory reduction

8-bit:
- ~8GB VRAM for 7B model
- Negligible quality loss
- 2x memory reduction

None (FP16/BF16):
- ~14GB VRAM for 7B model
- Full quality
- Maximum memory usage

Model Storage

Cache Location:
- Linux/Mac: ~/.cache/huggingface/hub/
- Windows: %USERPROFILE%\.cache\huggingface\hub\
- Override: HF_HOME environment variable

Storage Requirements:
- 0.5B model: ~1GB
- 7B model: ~7GB
- 13B model: ~13GB
- 70B model: ~70GB


Performance Considerations

Inference Speed

  • 0.5B model: ~50-100 tokens/sec (CPU)
  • 7B model: ~20-40 tokens/sec (GPU, 4-bit)
  • 13B model: ~10-20 tokens/sec (GPU, 4-bit)
  • 70B model: ~2-5 tokens/sec (GPU, 4-bit)

Memory Usage

  • Model size + context window + overhead
  • 7B model (4-bit): ~4-6GB VRAM
  • 7B model (8-bit): ~8-10GB VRAM
  • 7B model (FP16): ~14-16GB VRAM

Context Length

  • Qwen2.5: 32K tokens
  • Llama-3.1: 128K tokens
  • Gemma-2: 8K tokens
  • Varies by model

Limitations & Considerations

Model Quality

  • Smaller Models: Less capable than GPT-4/Claude
  • Specialized Tasks: May require fine-tuning
  • Reasoning: Limited compared to frontier models
  • Knowledge: Training data cutoff applies

Hardware Requirements

  • GPU Recommended: CPU inference is slow
  • VRAM Limits: Larger models need more memory
  • Quantization Trade-off: Quality vs memory
  • Cooling: Extended use generates heat

Tool-Calling

  • Model Support: Not all models support tools
  • Schema Compliance: Requires proper training
  • Error Handling: Tools may fail
  • Security: Validate all tool calls

Privacy vs Features

  • Offline: No internet = no web search
  • Local Only: Can't access cloud services
  • Updates: Manual model downloads
  • Support: Community-driven

Why This Tool is Unmatched

1. Complete Privacy
Data never leaves your machine. Perfect for sensitive work.

2. Autonomous Agents
Tool-calling support. AI can take actions, not just answer questions.

3. Zero Cost
Unlimited usage after initial download. No API bills.

4. OpenRouter-Compatible
Same interface as cloud APIs. Easy switching.

5. Hardware Optimization
Automatic quantization and device selection.

6. MCP Integration
Call any MCP tool from local AI.

7. Multiple Models
Support for Qwen, Llama, Mistral, Gemma, and more.

8. Production-Ready
Error handling, validation, monitoring.

9. Air-Gap Compatible
Works without internet after initial setup.

10. Future-Proof
Multi-modal, embeddings, more features coming.


Powered by MCP-Link

This tool is part of the MCP-Link Server — the only MCP server with local LLM inference and autonomous tool-calling built-in.

What's Included

Isolated Python Environment:
- PyTorch with CUDA support
- Transformers library
- Quantization tools (BitsAndBytes)
- All dependencies bundled

Model Management:
- Automatic HuggingFace integration
- Cache management
- Hardware detection
- Optimization selection

Tool-Calling Infrastructure:
- MCP tool integration
- Schema validation
- Autonomous execution
- Security controls

Get MCP-Link

Download the installer for your platform:
- Windows
- Mac (Apple Silicon)
- Mac (Intel)
- Linux

Installation is automatic. Dependencies are included. It just works.


Technical Specifications

Backend: PyTorch + Transformers
Hardware: CUDA (GPU) or CPU
Quantization: 4-bit, 8-bit, FP16
Context Length: Model-dependent (8K-128K)
Tool-Calling: OpenAI-compatible format
Model Source: HuggingFace Hub
Cache: ~/.cache/huggingface/

Supported Models:
- Qwen2.5 (0.5B-32B)
- Llama-3.1 (8B-70B)
- Mistral (7B)
- Gemma-2 (2B-9B)
- Phi-3 (mini-medium)

Performance:
- 0.5B: ~50-100 tok/sec (CPU)
- 7B: ~20-40 tok/sec (GPU, 4-bit)
- 13B: ~10-20 tok/sec (GPU, 4-bit)


License & Copyright

Copyright © 2025 Christopher Nathan Drake

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at:

https://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

AI Training Permission: You are permitted to use this software and any
associated content for the training, evaluation, fine-tuning, or improvement
of artificial intelligence systems, including commercial models.

SPDX-License-Identifier: Apache-2.0

Part of the Aura Friday MCP-Link Server project.


Support & Community

Issues & Feature Requests:
GitHub Issues

Documentation:
MCP-Link Documentation

HuggingFace:
Model Hub

Community:
Join other developers building private, autonomous AI agents.

常见问题

6 问
答案由本站依据条目字段整理,不引用上游原文
LLM MCP 76b8d59c 怎么安装?

资料没有给出安装命令,请到官方仓库或文档按说明接入;这类条目多数是生态应用,或尚未发布可安装包。

LLM MCP 76b8d59c 怎么在 Claude 里配置?

它的传输方式未标注,在客户端的 MCP 配置里填好启动命令和参数,保存后完全退出客户端再打开,配置才会生效。

LLM MCP 76b8d59c 收费吗?

本站不代收费用,也没有标注具体价格。是否收费取决于服务本身和背后的接口额度,正式使用前按官方说明确认。

LLM MCP 76b8d59c 需要 API Key 吗?

资料标注为无需认证,装好就能连;如果实际调用时报鉴权错误,按官方文档补上凭据。

LLM MCP 76b8d59c 支持哪些客户端?

资料标注支持 Claude;其他客户端只要能配置 MCP Server,也能用同样的命令或地址接入。

LLM MCP 76b8d59c 能提供哪些能力?

资料显示能力标签包括 本地AI、Python、Claude、隐私保护。具体工具清单以官方文档为准。

热门专题

按标签挑服务器
全部专题 →

服务器信息以作者仓库与官方文档为准;分类、传输方式与鉴权方式的中文说明为中文整理,最近核验 2026-05-17。