AWS Inferentia 2
AWS · 2023-04 · Inferentia
- 显存
- 32 GB
- 带宽
- 0.82 TB/s
- FP16
- 190
- FP8
- —
AWS inference silicon. Lower compute than Trainium 2 but cheaper per-token for high-volume serving workloads on AWS.
FP4 — · TDP —
厂商规格页 →