微调与托管推理

FINE-TUNE & HOSTING9 个模型

两条路线一次看清:微调平台按训练单价收(口径各家不同),托管推理按 token 收(可以逐条比价)。这页把 13 家微调平台与 22 条托管推理报价放一起,并按你的输入输出比例重算月 token 账单。

报价时间 2026-10-27 19:00 微调按训练单价 · 托管按 token 计费 · 覆盖 10 家托管商
微调平台134 家模型厂商直营 · 9 家第三方托管
托管推理报价22覆盖 9 个开源模型
最低混合单价$0.08317DeepSeek V4 Flash · 每百万 token
已关闭或临近下线2只保留用于维护存量模型,别再新上
你的月 token 口径1000M输出占 30% · 用于下方重算

托管推理按你的用量重算

9 个模型可比
输入输出比例不同,结论会变
各开源模型最低托管推理单价与月成本
#模型最低价托管商输入单价输出单价混合单价月成本(按你的比例)上下文输出速度
1 DeepSeek V4 Flash70B · MIT · 开放权重 OpenRouter4 家报价可比 $0.05544 $0.1109 $0.08317 $72.08 1.0M — 报价 →
2 Phi-414B · MIT · 开放权重 DeepInfra3 家报价可比 $0.07 $0.14 $0.105 $91 16K 220 tok/s 报价 →
3 Llama 4 Scout109B · Llama 4 Community License · 开放权重 DeepInfra2 家报价可比 $0.1 $0.3 $0.2 $160 10.0M 170 tok/s 报价 →
4 Llama 4 Maverick400B · Llama 4 Community License · 开放权重 OpenRouter2 家报价可比 $0.1875 $0.6525 $0.42 $327 1.0M — 报价 →
5 Qwen 2.5 72B Instruct72B · Qwen License · 开放权重 OpenRouter3 家报价可比 $0.35 $0.4 $0.375 $365 130K — 报价 →
6 Llama 3.1 70B Instruct70B · Llama 3.1 Community License · 开放权重 OpenRouter1 家报价可比 $0.4 $0.4 $0.4 $400 130K — 报价 →
7 DeepSeek V4 Pro1600B · MIT · 开放权重 OpenRouter5 家报价可比 $0.435 $0.87 $0.6525 $565.5 1.0M — 报价 →
8 Mixtral 8x22B Instruct141B · Apache-2.0 · 开放权重 OpenRouter1 家报价可比 $0.65 $0.65 $0.65 $650 65K — 报价 →
9 Llama 3.1 405B Instruct405B · Llama 3.1 Community License · 开放权重 OpenRouter1 家报价可比 $3 $3 $3 $3,000 130K — 报价 →

微调平台对比

13 家
训练单价各家口径不同,原文保留
微调平台的基座模型、方法与训练推理单价
平台可微调基座微调方法训练单价(官方口径)推理单价(官方口径)免费额度
Google Vertex AI Fine-TuningGoogle · 模型厂商直营 Gemini 3.5 Flash、Gemini 3.1 Flash-Lite、Gemini 2.5 Pro, Flash, and Flash-Lite (retire 2026-10-20) 等 6 个 lora dpo rlhf $10/1M training tokens (Gemini 3.5 Flash, SFT or RL); $3 (Gemini 3.1 Flash-Lite); $25 (Gemini 2.5 Pro); $5 (Gemini 2.5 Flash); $1.50 (Gemini 2.5 Flash-Lite); open models from $0.28/1M (Llama 3.2 1B) Tuned Gemini 3 and later models serve at 1.5x the base price; older tuned Gemini models at the base price — 文档 →
Mistral Fine-TuningMistral · 模型厂商直营 Mistral text and vision models (legacy fine-tuning API)、Classifier Factory classifiers lora full $4 minimum per job plus $2/month storage per fine-tuned model; per-token rates on the Mistral pricing page See the Mistral pricing page — 文档 →
AWS Bedrock Fine-TuningAmazon Web Services · 第三方托管 Amazon Nova 2 Lite, Nova Pro, Nova Lite, Nova Micro、Llama 3.1, 3.2, and 3.3、gpt-oss-20B and Qwen3 32B (reinforcement fine-tuning) 等 4 个 lora rlhf continued-pretraining Per-model rates on the Bedrock pricing page Customized Nova models run on demand at the base model price — 文档 →
Fireworks Fine-TuningFireworks AI · 第三方托管 Qwen3 family including Qwen3-235B、gpt-oss-120B、DeepSeek V3 family 等 4 个 lora full dpo rlhf Per 1M training tokens, LoRA SFT: $0.50 (up to 16B), $3 (16B to 80B), $6 (80B to 300B), $10 (over 300B). LoRA DPO and full-parameter SFT cost double; full-parameter DPO four times. Reinforcement fine-tuning billed per GPU hour. Fine-tuned models serve at the same price as their base models — 文档 →
Hugging Face AutoTrainHugging Face · 第三方托管 Most HuggingFace open-weights models lora full dpo GPU time on the Hugging Face Space hardware it runs on Inference Endpoints billed separately by instance hour Free to run locally or on your own hardware 文档 →
Modal Labs (DIY)Modal · 第三方托管 Any (BYO code)、Open-model recipes published lora qlora full dpo rlhf continued-pretraining GPU-time billing per second; H100 about $3.95/hr, B200 about $6.25/hr GPU-time billing on serving function $30/mo compute credit on Starter 文档 →
OpenPipe (CoreWeave)CoreWeave · 第三方托管 Open-weight models through managed SFT、Bring-your-own models through the ART reinforcement learning library lora rlhf Not published; confirm with CoreWeave Not published; confirm with CoreWeave — 文档 →
Predibase (Rubrik)Rubrik · 第三方托管 Open-weight models (legacy Predibase platform) lora qlora full Not published Not published — 文档 →
Replicate Fine-TuningReplicate (Cloudflare) · 第三方托管 FLUX image models、SDXL、Community trainers for open language models lora GPU time; for example H100 at $0.001525/sec Per-second GPU billing; fast-booting fine-tunes bill only active time — 文档 →
TinkerThinking Machines Lab · 第三方托管 Inkling and Inkling-Small、GLM-5.3、Kimi-K2.6 等 7 个 lora rlhf Per 1M training tokens: $0.44 (Qwen3-8B), $0.737 (gpt-oss-120B), $3.718 (DeepSeek-V3.1), $4.84 (Kimi-K2.6), $5.61 (Inkling at a limited-time 50% discount). Prefill and sampling billed separately. Sampling from checkpoints billed per token; serverless inference in beta for Inkling models only — 文档 →
Together AI Fine-TuningTogether AI · 第三方托管 Qwen3.5, Qwen3.6, and Qwen3.8 27B、DeepSeek V4 Flash 0731 and DeepSeek-V3.1、Kimi K2.6 and K2.7 Code 等 6 个 lora full dpo LoRA SFT per 1M tokens: $0.34 (models up to 9B), $1.05 (27B to 35B), $2.03 (Llama 3.3 70B), $2.50 (gpt-oss-120B), $6.00 (DeepSeek V4 Flash 0731), $15.00 (Kimi K2.6). DPO about 2.5x SFT. $4 minimum per job, rising to $60 on the largest models. Serve tuned adapters on Together serverless or dedicated endpoints; see Together inference pricing — 文档 →
Anthropic Fine-Tuning (AWS Bedrock) 实质已关闭Anthropic · 模型厂商直营 Claude 3 Haiku (Bedrock end of life 2026-09-10) lora Not available for new jobs Existing custom models ran on Provisioned Throughput, which cannot be newly created for Legacy models — 文档 →
OpenAI Fine-Tuning 已公布下线时间表OpenAI · 模型厂商直营 GPT-4.1、GPT-4.1-mini、GPT-4.1-nano (base retires 2026-10-23) 等 6 个 full dpo rlhf $25/1M tokens (GPT-4.1, GPT-4o); $5 (GPT-4.1-mini); $3 (GPT-4o-mini); $1.50 (GPT-4.1-nano); o4-mini reinforcement fine-tuning $100 per training hour Fine-tuned GPT-4.1 $3.00 in / $12.00 out per 1M tokens; GPT-4.1-mini $0.80 / $3.20; o4-mini $4.00 / $16.00, half with data sharing — 文档 →

方法覆盖矩阵

6 种方法
平台在 methods 字段里列出即算 1 家支持

LoRA(低秩适配)

12 家支持
占已披露方法平台
92%(12/13)
直营 / 第三方托管
3 / 9
Google Vertex AI Fine-TuningMistral Fine-TuningAWS Bedrock Fine-TuningFireworks Fine-TuningHugging Face AutoTrainModal Labs (DIY)OpenPipe (CoreWeave)Predibase (Rubrik)Replicate Fine-TuningTinkerTogether AI Fine-TuningAnthropic Fine-Tuning (AWS Bedrock)

RLHF / RFT(强化学习)

7 家支持
占已披露方法平台
54%(7/13)
直营 / 第三方托管
2 / 5
Google Vertex AI Fine-TuningAWS Bedrock Fine-TuningFireworks Fine-TuningModal Labs (DIY)OpenPipe (CoreWeave)TinkerOpenAI Fine-Tuning

全参微调(full)

7 家支持
占已披露方法平台
54%(7/13)
直营 / 第三方托管
2 / 5
Mistral Fine-TuningFireworks Fine-TuningHugging Face AutoTrainModal Labs (DIY)Predibase (Rubrik)Together AI Fine-TuningOpenAI Fine-Tuning

DPO(偏好对齐)

6 家支持
占已披露方法平台
46%(6/13)
直营 / 第三方托管
2 / 4
Google Vertex AI Fine-TuningFireworks Fine-TuningHugging Face AutoTrainModal Labs (DIY)Together AI Fine-TuningOpenAI Fine-Tuning

QLoRA(4bit 量化 LoRA)

2 家支持
占已披露方法平台
15%(2/13)
直营 / 第三方托管
0 / 2
Modal Labs (DIY)Predibase (Rubrik)

持续预训练(continued-pretraining)

2 家支持
占已披露方法平台
15%(2/13)
直营 / 第三方托管
0 / 2
AWS Bedrock Fine-TuningModal Labs (DIY)

单价怎么比

13 家训练价
先把分母对齐,再谈单价高低
微调平台训练单价的计费单位分布
计费单位平台数占比覆盖平台
未公开或需查定价页如 AWS Bedrock Fine-Tuning:Per-model rates on the Bedrock pricing page 4 31%(4/13) AWS Bedrock Fine-Tuning OpenPipe (CoreWeave) Predibase (Rubrik) Anthropic Fine-Tuning (AWS Bedrock)
按 100 万训练 token如 Google Vertex AI Fine-Tuning:$10/1M training tokens (Gemini 3.5 Flash, SFT or… 3 23%(3/13) Google Vertex AI Fine-Tuning Tinker Together AI Fine-Tuning
按训练时长(GPU 小时 / 秒)如 Hugging Face AutoTrain:GPU time on the Hugging Face Space hardware it r… 3 23%(3/13) Hugging Face AutoTrain Modal Labs (DIY) Replicate Fine-Tuning
token 与时长并存如 Fireworks Fine-Tuning:Per 1M training tokens, LoRA SFT: $0.50 (up to 1… 2 15%(2/13) Fireworks Fine-Tuning OpenAI Fine-Tuning
按作业与存储如 Mistral Fine-Tuning:$4 minimum per job plus $2/month storage per fin… 1 8%(1/13) Mistral Fine-Tuning

例 1|推理侧:按 token 付,每月重复

DeepSeek V4 Flash 的最低报价是 $0.05544 输入 / $0.1109 输出(每百万 token,来自 OpenRouter)。按你设的 1,000M token/月、输出占 30%,拆成输入 700M + 输出 300M:$0.05544 × 700 + $0.1109 × 300 ≈ $72.08/月。

折算成单价是每百万混合 token $0.07208;这个成本每月都会再发生一次。

例 2|训练侧:按训练 token 付,一次投入

同为「按 100 万训练 token」计价:Together AI Fine-Tuning 原文首档 $0.34/1M、OpenAI Fine-Tuning $25/1M,相差约 74 倍——差距来自基座参数档位与训练方式(LoRA 还是全参)。若一次微调要喂 1,000M 训练 token(借页面上的 token 量举例),按前者约 $340,按后者约 $25,000,都是一次性支出。

分母不同:这里是训练语料 token(一次投入,同一批语料还可能被训练多个 epoch),例 1 是服务出去的 token(每月重复)。两边都叫 token,但不能相减,也不能直接比单价高低。

例 3|训练侧:按卡时付,与 token 无关

Modal Labs (DIY) 的训练单价原文是「GPU-time billing per second; H100 about $3.95/hr, B200 about $6.25/hr」,折成小时约 $3.95/卡时;按 1 张卡跑 100 小时算约 $395(100 小时是举例,不是任何平台的报价)。

分母是占用卡的时间(含排队与闲置),且各家单位不统一(有的按 GPU 秒、有的按训练小时),所以「每小时多少美元」与「每百万 token 多少美元」不能直接比。

平台类型分布

13 家
直营多绑自家闭源基座,托管多以开源基座为主

模型厂商直营

31%(4/13)
平台数
4 家
可微调基座条目
15
覆盖方法种类
4
已公布停服/下线
2
提供免费额度
0
DPO(偏好对齐)全参微调(full)LoRA(低秩适配)RLHF / RFT(强化学习)
Google Vertex AI Fine-TuningMistral Fine-TuningAnthropic Fine-Tuning (AWS Bedrock)OpenAI Fine-Tuning

第三方托管

69%(9/13)
平台数
9 家
可微调基座条目
30
覆盖方法种类
6
已公布停服/下线
0
提供免费额度
2
持续预训练(continued-pretraining)DPO(偏好对齐)全参微调(full)LoRA(低秩适配)QLoRA(4bit 量化 LoRA)RLHF / RFT(强化学习)
AWS Bedrock Fine-TuningFireworks Fine-TuningHugging Face AutoTrainModal Labs (DIY)OpenPipe (CoreWeave)Predibase (Rubrik)Replicate Fine-TuningTinkerTogether AI Fine-Tuning

平台状态与备注

13 条
下单前看这段,避免踩停服
Google Vertex AI Fine-Tuning

Now branded Gemini Enterprise Agent Platform. PaLM 2 and Codey tuning went away with those models. The Gemini 2.5 targets retire on Google Cloud on 2026-10-20, so new tunes should start on Gemini 3.5 Flash or 3.1 Flash-Lite. Also a first-party path for tuning open models such as Gemma 3, Llama, and Qwen3.

产品特性:Supervised fine-tuning with adapter sizes from 1 to 16;Preference tuning on Gemini 2.5 Flash and Flash-Lite;Reinforcement learning fine-tuning on Gemini 3.5 Flash;Tuning checkpoints and continuous tuning。

Mistral Fine-Tuning

Mistral now files its fine-tuning API under deprecated features and says it is no longer actively supported. Jobs still carry the $4 minimum and $2 monthly storage fee. Fine for keeping an existing tune alive, not a place to start new work.

产品特性:Supervised fine-tuning for text and vision;Classifier Factory for custom classifiers;European data residency。

AWS Bedrock Fine-Tuning

Nova is now the center of Bedrock customization, and on-demand serving for tuned Nova models removes the old Provisioned Throughput cost at low volume. The Claude path is gone: Claude 3 Haiku was the last customizable Claude model and reached Bedrock end of life on 2026-09-10.

产品特性:Supervised fine-tuning and distillation;Reinforcement fine-tuning with GRPO;Continued pre-training;Nova Forge subscription for deeper customization。

Fireworks Fine-Tuning

Clear size-tiered pricing and no serving markup on tuned models, so many variants can share one base cheaply. No longer LoRA-only: full-parameter training and RFT are both on the price list.

产品特性:LoRA and full-parameter SFT and DPO;Reinforcement fine-tuning at on-demand GPU rates;Multi-LoRA serving at base-model prices。

Hugging Face AutoTrain

Hugging Face now marks AutoTrain as no longer maintained, with no new features or bug fixes, and recommends Axolotl, TRL, or transformers Trainer instead. NVIDIA agreed on 2026-09-03 to acquire Hugging Face for $12.93B and says the Hub will stay open and accelerator-neutral.

产品特性:No-code UI in a Docker Space;Local UI and Python API;Push to Hub。

Modal Labs (DIY)

BYO fine-tuning infra. You own the code; Modal owns the GPU scheduling. The right answer if your tuning recipe does not fit a turn-key provider.

产品特性:Full BYO control;Serverless GPU;Distributed training;Open-source recipes。

OpenPipe (CoreWeave)

CoreWeave agreed to acquire OpenPipe in September 2025. OpenPipe said it would keep supporting existing customers, the ART library, and managed SFT, while warning the product may evolve. The old distill-from-GPT-4-traces pitch is now part of a larger CoreWeave training stack, so older published pricing should not be relied on.

产品特性:Agent Reinforcement Trainer (ART) open-source RL library;Managed SFT workflows;Sits alongside Weights & Biases inside CoreWeave。

Predibase (Rubrik)

Rubrik agreed to acquire Predibase in June 2025, and predibase.com now redirects to Rubrik Agent Cloud. The standalone self-serve fine-tuning product is no longer marketed on its own; LoRAX, the open-source multi-LoRA server, is the piece most teams can still use directly.

产品特性:Multi-adapter LoRA serving;LoRAX open-source serving project still maintained on GitHub。

Replicate Fine-Tuning

Strongest image LoRA experience (FLUX, SDXL). Cloudflare agreed to acquire Replicate in November 2025 to fold its model catalog into Workers. Less competitive for text-LLM fine-tuning than Together or Fireworks.

产品特性:Image LoRA fine-tuning standout;API-driven;Fast-booting fine-tunes without idle charges。

Tinker

A research-grade training API rather than a job runner: you write the training loop and Thinking Machines runs the GPUs. Checkpoints can be downloaded, and pricing follows active parameters, which makes trillion-parameter MoE models such as Kimi-K2.6 practical to tune.

产品特性:Low-level API: forward_backward, optim_step, sample, save_state;Built-in RL losses (PPO, CISPO, DRO) and custom losses;Downloadable LoRA checkpoints, stored at $0.10/GB-month;Priced on active parameters, which favors MoE models。

Together AI Fine-Tuning

A broad hosted menu of open models to tune, from Qwen3.5 0.8B up to Kimi K2.6, with a published price and minimum charge for every one. The default for teams that want a custom open model without writing a training loop.

产品特性:LoRA and full fine-tuning;SFT and DPO;Published per-model prices and minimums;Frontier-scale open models including Kimi K2.6 and DeepSeek V4 Flash。

Anthropic Fine-Tuning (AWS Bedrock)(实质已关闭)

Effectively closed. Bedrock's fine-tuning table lists Claude 3 Haiku as the only customizable Claude model; it entered Legacy on 2026-03-10, which blocks new fine-tuning jobs, and reached end of life on 2026-09-10. No Claude 4 or Claude 5 model appears in the table.

产品特性:Bedrock-only (AWS);Claude 3 Haiku was the only customizable Claude model;Legacy status blocks new fine-tuning jobs。

OpenAI Fine-Tuning(已公布下线时间表)

OpenAI is winding the platform down. New organizations lost access on 2026-05-07, organizations with no fine-tuned inference in the prior 60 days lost job creation on 2026-07-02, and every remaining customer stops creating jobs on 2027-01-06. Tunes built on gpt-4.1-nano and o4-mini stop serving when those bases shut down on 2026-10-23. No model export. Useful now only for maintaining existing tunes.

产品特性:Supervised, DPO, vision, and reinforcement fine-tuning;Closed to new organizations since 2026-05-07;Fine-tunes keep serving until their base model is deprecated。

常见问题

微调后到底是买 token 还是租卡自己托管?

先看流量规模:月 token 量小、请求稀疏时按 token 付费几乎总是更便宜,因为闲置的卡不会给你打折;月 token 量大且稳定时,租卡自建的边际成本会低于按 token 的单价。用这页的月成本表对比成本测算里同规模的租卡月成本即可——注意把自建的运维与弹性损失也考虑进去。

LoRA 和全参微调怎么选?

LoRA/QLoRA 训练成本低一个量级、可插拔多套适配器,适合风格对齐与领域问答;全参微调效果上限更高但成本高、且每次迭代都要重训全量权重,适合基座能力确实不足的场景。表中的「微调方法」列可以直接看出各家支持范围:全参、LoRA、DPO、RLHF(或 RFT)的支持差异很大。

为什么 OpenAI 与 Anthropic 的微调都不可用了?

OpenAI 已公布自助微调的下线时间表(分阶段关闭新建任务),Anthropic 的 Bedrock 微调也进入 Legacy 不再接受新任务。结论很直接:闭源模型厂商正在收缩微调能力,长期依赖单一厂商的微调服务有停服风险。要做长期投入,优先选可导出权重或基于开源模型的托管微调。

托管推理的「上下文」和「输出速度」重要吗?

很重要且常被忽略。同样是每百万 token 报价,上下文窗口决定你能不能塞进长文档(超出直接报错),输出速度决定用户体验(tok/s 低到个位数时交互体验会很差)。表中两列都来自公开来源实测/标注,缺值的地方保持空白。

微调单价与托管推理报价取自各平台公开定价页;数据日期 2026-10-27 19:00,托管报价时间 2026-10-27 19:00。