微调与托管推理
FINE-TUNE & HOSTING9 个模型两条路线一次看清:微调平台按训练单价收(口径各家不同),托管推理按 token 收(可以逐条比价)。这页把 13 家微调平台与 22 条托管推理报价放一起,并按你的输入输出比例重算月 token 账单。
托管推理按你的用量重算
9 个模型可比| # | 模型 | 最低价托管商 | 输入单价 | 输出单价 | 混合单价 | 月成本(按你的比例) | 上下文 | 输出速度 | |
|---|---|---|---|---|---|---|---|---|---|
| 1 |
|
OpenRouter4 家报价可比 | $0.05544 | $0.1109 | $0.08317 | $72.08 | 1.0M | — | 报价 → |
| 2 |
|
DeepInfra3 家报价可比 | $0.07 | $0.14 | $0.105 | $91 | 16K | 220 tok/s | 报价 → |
| 3 |
|
DeepInfra2 家报价可比 | $0.1 | $0.3 | $0.2 | $160 | 10.0M | 170 tok/s | 报价 → |
| 4 |
|
OpenRouter2 家报价可比 | $0.1875 | $0.6525 | $0.42 | $327 | 1.0M | — | 报价 → |
| 5 |
|
OpenRouter3 家报价可比 | $0.35 | $0.4 | $0.375 | $365 | 130K | — | 报价 → |
| 6 |
|
OpenRouter1 家报价可比 | $0.4 | $0.4 | $0.4 | $400 | 130K | — | 报价 → |
| 7 |
|
OpenRouter5 家报价可比 | $0.435 | $0.87 | $0.6525 | $565.5 | 1.0M | — | 报价 → |
| 8 |
|
OpenRouter1 家报价可比 | $0.65 | $0.65 | $0.65 | $650 | 65K | — | 报价 → |
| 9 |
|
OpenRouter1 家报价可比 | $3 | $3 | $3 | $3,000 | 130K | — | 报价 → |
微调平台对比
13 家| 平台 | 可微调基座 | 微调方法 | 训练单价(官方口径) | 推理单价(官方口径) | 免费额度 | |
|---|---|---|---|---|---|---|
|
|
Gemini 3.5 Flash、Gemini 3.1 Flash-Lite、Gemini 2.5 Pro, Flash, and Flash-Lite (retire 2026-10-20) 等 6 个 | lora dpo rlhf | $10/1M training tokens (Gemini 3.5 Flash, SFT or RL); $3 (Gemini 3.1 Flash-Lite); $25 (Gemini 2.5 Pro); $5 (Gemini 2.5 Flash); $1.50 (Gemini 2.5 Flash-Lite); open models from $0.28/1M (Llama 3.2 1B) | Tuned Gemini 3 and later models serve at 1.5x the base price; older tuned Gemini models at the base price | — | 文档 → |
|
|
Mistral text and vision models (legacy fine-tuning API)、Classifier Factory classifiers | lora full | $4 minimum per job plus $2/month storage per fine-tuned model; per-token rates on the Mistral pricing page | See the Mistral pricing page | — | 文档 → |
|
|
Amazon Nova 2 Lite, Nova Pro, Nova Lite, Nova Micro、Llama 3.1, 3.2, and 3.3、gpt-oss-20B and Qwen3 32B (reinforcement fine-tuning) 等 4 个 | lora rlhf continued-pretraining | Per-model rates on the Bedrock pricing page | Customized Nova models run on demand at the base model price | — | 文档 → |
|
|
Qwen3 family including Qwen3-235B、gpt-oss-120B、DeepSeek V3 family 等 4 个 | lora full dpo rlhf | Per 1M training tokens, LoRA SFT: $0.50 (up to 16B), $3 (16B to 80B), $6 (80B to 300B), $10 (over 300B). LoRA DPO and full-parameter SFT cost double; full-parameter DPO four times. Reinforcement fine-tuning billed per GPU hour. | Fine-tuned models serve at the same price as their base models | — | 文档 → |
|
|
Most HuggingFace open-weights models | lora full dpo | GPU time on the Hugging Face Space hardware it runs on | Inference Endpoints billed separately by instance hour | Free to run locally or on your own hardware | 文档 → |
|
|
Any (BYO code)、Open-model recipes published | lora qlora full dpo rlhf continued-pretraining | GPU-time billing per second; H100 about $3.95/hr, B200 about $6.25/hr | GPU-time billing on serving function | $30/mo compute credit on Starter | 文档 → |
|
|
Open-weight models through managed SFT、Bring-your-own models through the ART reinforcement learning library | lora rlhf | Not published; confirm with CoreWeave | Not published; confirm with CoreWeave | — | 文档 → |
|
|
Open-weight models (legacy Predibase platform) | lora qlora full | Not published | Not published | — | 文档 → |
|
|
FLUX image models、SDXL、Community trainers for open language models | lora | GPU time; for example H100 at $0.001525/sec | Per-second GPU billing; fast-booting fine-tunes bill only active time | — | 文档 → |
|
|
Inkling and Inkling-Small、GLM-5.3、Kimi-K2.6 等 7 个 | lora rlhf | Per 1M training tokens: $0.44 (Qwen3-8B), $0.737 (gpt-oss-120B), $3.718 (DeepSeek-V3.1), $4.84 (Kimi-K2.6), $5.61 (Inkling at a limited-time 50% discount). Prefill and sampling billed separately. | Sampling from checkpoints billed per token; serverless inference in beta for Inkling models only | — | 文档 → |
|
|
Qwen3.5, Qwen3.6, and Qwen3.8 27B、DeepSeek V4 Flash 0731 and DeepSeek-V3.1、Kimi K2.6 and K2.7 Code 等 6 个 | lora full dpo | LoRA SFT per 1M tokens: $0.34 (models up to 9B), $1.05 (27B to 35B), $2.03 (Llama 3.3 70B), $2.50 (gpt-oss-120B), $6.00 (DeepSeek V4 Flash 0731), $15.00 (Kimi K2.6). DPO about 2.5x SFT. $4 minimum per job, rising to $60 on the largest models. | Serve tuned adapters on Together serverless or dedicated endpoints; see Together inference pricing | — | 文档 → |
|
|
Claude 3 Haiku (Bedrock end of life 2026-09-10) | lora | Not available for new jobs | Existing custom models ran on Provisioned Throughput, which cannot be newly created for Legacy models | — | 文档 → |
|
|
GPT-4.1、GPT-4.1-mini、GPT-4.1-nano (base retires 2026-10-23) 等 6 个 | full dpo rlhf | $25/1M tokens (GPT-4.1, GPT-4o); $5 (GPT-4.1-mini); $3 (GPT-4o-mini); $1.50 (GPT-4.1-nano); o4-mini reinforcement fine-tuning $100 per training hour | Fine-tuned GPT-4.1 $3.00 in / $12.00 out per 1M tokens; GPT-4.1-mini $0.80 / $3.20; o4-mini $4.00 / $16.00, half with data sharing | — | 文档 → |
方法覆盖矩阵
6 种方法RLHF / RFT(强化学习)
7 家支持全参微调(full)
7 家支持DPO(偏好对齐)
6 家支持QLoRA(4bit 量化 LoRA)
2 家支持持续预训练(continued-pretraining)
2 家支持单价怎么比
13 家训练价| 计费单位 | 平台数 | 占比 | 覆盖平台 |
|---|---|---|---|
| 未公开或需查定价页如 AWS Bedrock Fine-Tuning:Per-model rates on the Bedrock pricing page | 4 | 31%(4/13) | AWS Bedrock Fine-Tuning OpenPipe (CoreWeave) Predibase (Rubrik) Anthropic Fine-Tuning (AWS Bedrock) |
| 按 100 万训练 token如 Google Vertex AI Fine-Tuning:$10/1M training tokens (Gemini 3.5 Flash, SFT or… | 3 | 23%(3/13) | Google Vertex AI Fine-Tuning Tinker Together AI Fine-Tuning |
| 按训练时长(GPU 小时 / 秒)如 Hugging Face AutoTrain:GPU time on the Hugging Face Space hardware it r… | 3 | 23%(3/13) | Hugging Face AutoTrain Modal Labs (DIY) Replicate Fine-Tuning |
| token 与时长并存如 Fireworks Fine-Tuning:Per 1M training tokens, LoRA SFT: $0.50 (up to 1… | 2 | 15%(2/13) | Fireworks Fine-Tuning OpenAI Fine-Tuning |
| 按作业与存储如 Mistral Fine-Tuning:$4 minimum per job plus $2/month storage per fin… | 1 | 8%(1/13) | Mistral Fine-Tuning |
例 1|推理侧:按 token 付,每月重复
DeepSeek V4 Flash 的最低报价是 $0.05544 输入 / $0.1109 输出(每百万 token,来自 OpenRouter)。按你设的 1,000M token/月、输出占 30%,拆成输入 700M + 输出 300M:$0.05544 × 700 + $0.1109 × 300 ≈ $72.08/月。
折算成单价是每百万混合 token $0.07208;这个成本每月都会再发生一次。
例 2|训练侧:按训练 token 付,一次投入
同为「按 100 万训练 token」计价:Together AI Fine-Tuning 原文首档 $0.34/1M、OpenAI Fine-Tuning $25/1M,相差约 74 倍——差距来自基座参数档位与训练方式(LoRA 还是全参)。若一次微调要喂 1,000M 训练 token(借页面上的 token 量举例),按前者约 $340,按后者约 $25,000,都是一次性支出。
分母不同:这里是训练语料 token(一次投入,同一批语料还可能被训练多个 epoch),例 1 是服务出去的 token(每月重复)。两边都叫 token,但不能相减,也不能直接比单价高低。
例 3|训练侧:按卡时付,与 token 无关
Modal Labs (DIY) 的训练单价原文是「GPU-time billing per second; H100 about $3.95/hr, B200 about $6.25/hr」,折成小时约 $3.95/卡时;按 1 张卡跑 100 小时算约 $395(100 小时是举例,不是任何平台的报价)。
分母是占用卡的时间(含排队与闲置),且各家单位不统一(有的按 GPU 秒、有的按训练小时),所以「每小时多少美元」与「每百万 token 多少美元」不能直接比。
平台类型分布
13 家模型厂商直营
31%(4/13)第三方托管
69%(9/13)平台状态与备注
13 条Google Vertex AI Fine-Tuning
Now branded Gemini Enterprise Agent Platform. PaLM 2 and Codey tuning went away with those models. The Gemini 2.5 targets retire on Google Cloud on 2026-10-20, so new tunes should start on Gemini 3.5 Flash or 3.1 Flash-Lite. Also a first-party path for tuning open models such as Gemma 3, Llama, and Qwen3.
产品特性:Supervised fine-tuning with adapter sizes from 1 to 16;Preference tuning on Gemini 2.5 Flash and Flash-Lite;Reinforcement learning fine-tuning on Gemini 3.5 Flash;Tuning checkpoints and continuous tuning。
Mistral Fine-Tuning
Mistral now files its fine-tuning API under deprecated features and says it is no longer actively supported. Jobs still carry the $4 minimum and $2 monthly storage fee. Fine for keeping an existing tune alive, not a place to start new work.
产品特性:Supervised fine-tuning for text and vision;Classifier Factory for custom classifiers;European data residency。
AWS Bedrock Fine-Tuning
Nova is now the center of Bedrock customization, and on-demand serving for tuned Nova models removes the old Provisioned Throughput cost at low volume. The Claude path is gone: Claude 3 Haiku was the last customizable Claude model and reached Bedrock end of life on 2026-09-10.
产品特性:Supervised fine-tuning and distillation;Reinforcement fine-tuning with GRPO;Continued pre-training;Nova Forge subscription for deeper customization。
Fireworks Fine-Tuning
Clear size-tiered pricing and no serving markup on tuned models, so many variants can share one base cheaply. No longer LoRA-only: full-parameter training and RFT are both on the price list.
产品特性:LoRA and full-parameter SFT and DPO;Reinforcement fine-tuning at on-demand GPU rates;Multi-LoRA serving at base-model prices。
Hugging Face AutoTrain
Hugging Face now marks AutoTrain as no longer maintained, with no new features or bug fixes, and recommends Axolotl, TRL, or transformers Trainer instead. NVIDIA agreed on 2026-09-03 to acquire Hugging Face for $12.93B and says the Hub will stay open and accelerator-neutral.
产品特性:No-code UI in a Docker Space;Local UI and Python API;Push to Hub。
Modal Labs (DIY)
BYO fine-tuning infra. You own the code; Modal owns the GPU scheduling. The right answer if your tuning recipe does not fit a turn-key provider.
产品特性:Full BYO control;Serverless GPU;Distributed training;Open-source recipes。
OpenPipe (CoreWeave)
CoreWeave agreed to acquire OpenPipe in September 2025. OpenPipe said it would keep supporting existing customers, the ART library, and managed SFT, while warning the product may evolve. The old distill-from-GPT-4-traces pitch is now part of a larger CoreWeave training stack, so older published pricing should not be relied on.
产品特性:Agent Reinforcement Trainer (ART) open-source RL library;Managed SFT workflows;Sits alongside Weights & Biases inside CoreWeave。
Predibase (Rubrik)
Rubrik agreed to acquire Predibase in June 2025, and predibase.com now redirects to Rubrik Agent Cloud. The standalone self-serve fine-tuning product is no longer marketed on its own; LoRAX, the open-source multi-LoRA server, is the piece most teams can still use directly.
产品特性:Multi-adapter LoRA serving;LoRAX open-source serving project still maintained on GitHub。
Replicate Fine-Tuning
Strongest image LoRA experience (FLUX, SDXL). Cloudflare agreed to acquire Replicate in November 2025 to fold its model catalog into Workers. Less competitive for text-LLM fine-tuning than Together or Fireworks.
产品特性:Image LoRA fine-tuning standout;API-driven;Fast-booting fine-tunes without idle charges。
Tinker
A research-grade training API rather than a job runner: you write the training loop and Thinking Machines runs the GPUs. Checkpoints can be downloaded, and pricing follows active parameters, which makes trillion-parameter MoE models such as Kimi-K2.6 practical to tune.
产品特性:Low-level API: forward_backward, optim_step, sample, save_state;Built-in RL losses (PPO, CISPO, DRO) and custom losses;Downloadable LoRA checkpoints, stored at $0.10/GB-month;Priced on active parameters, which favors MoE models。
Together AI Fine-Tuning
A broad hosted menu of open models to tune, from Qwen3.5 0.8B up to Kimi K2.6, with a published price and minimum charge for every one. The default for teams that want a custom open model without writing a training loop.
产品特性:LoRA and full fine-tuning;SFT and DPO;Published per-model prices and minimums;Frontier-scale open models including Kimi K2.6 and DeepSeek V4 Flash。
Anthropic Fine-Tuning (AWS Bedrock)(实质已关闭)
Effectively closed. Bedrock's fine-tuning table lists Claude 3 Haiku as the only customizable Claude model; it entered Legacy on 2026-03-10, which blocks new fine-tuning jobs, and reached end of life on 2026-09-10. No Claude 4 or Claude 5 model appears in the table.
产品特性:Bedrock-only (AWS);Claude 3 Haiku was the only customizable Claude model;Legacy status blocks new fine-tuning jobs。
OpenAI Fine-Tuning(已公布下线时间表)
OpenAI is winding the platform down. New organizations lost access on 2026-05-07, organizations with no fine-tuned inference in the prior 60 days lost job creation on 2026-07-02, and every remaining customer stops creating jobs on 2027-01-06. Tunes built on gpt-4.1-nano and o4-mini stop serving when those bases shut down on 2026-10-23. No model export. Useful now only for maintaining existing tunes.
产品特性:Supervised, DPO, vision, and reinforcement fine-tuning;Closed to new organizations since 2026-05-07;Fine-tunes keep serving until their base model is deprecated。
常见问题
微调后到底是买 token 还是租卡自己托管?
先看流量规模:月 token 量小、请求稀疏时按 token 付费几乎总是更便宜,因为闲置的卡不会给你打折;月 token 量大且稳定时,租卡自建的边际成本会低于按 token 的单价。用这页的月成本表对比成本测算里同规模的租卡月成本即可——注意把自建的运维与弹性损失也考虑进去。
LoRA 和全参微调怎么选?
LoRA/QLoRA 训练成本低一个量级、可插拔多套适配器,适合风格对齐与领域问答;全参微调效果上限更高但成本高、且每次迭代都要重训全量权重,适合基座能力确实不足的场景。表中的「微调方法」列可以直接看出各家支持范围:全参、LoRA、DPO、RLHF(或 RFT)的支持差异很大。
为什么 OpenAI 与 Anthropic 的微调都不可用了?
OpenAI 已公布自助微调的下线时间表(分阶段关闭新建任务),Anthropic 的 Bedrock 微调也进入 Legacy 不再接受新任务。结论很直接:闭源模型厂商正在收缩微调能力,长期依赖单一厂商的微调服务有停服风险。要做长期投入,优先选可导出权重或基于开源模型的托管微调。
托管推理的「上下文」和「输出速度」重要吗?
很重要且常被忽略。同样是每百万 token 报价,上下文窗口决定你能不能塞进长文档(超出直接报错),输出速度决定用户体验(tok/s 低到个位数时交互体验会很差)。表中两列都来自公开来源实测/标注,缺值的地方保持空白。
微调单价与托管推理报价取自各平台公开定价页;数据日期 2026-10-27 19:00,托管报价时间 2026-10-27 19:00。