论文55

Epoch AI 发布 IPI 指数:智能体推理容量一年增长 4.6 倍

原标题:Agentic inference capacity grew 4.6× from Q2 2025 to Q2 2026. This compares with just 2.6× growth in compute, according to our Inference ...

Epoch AI@EpochAIResearch发布时间 (北京时间)

Epoch AI 依据其 Inference Performance Index(IPI)估算,2025 年 Q2 到 2026 年 Q2 智能体推理容量增长 4.6 倍,而算力仅增长 2.6 倍。该指数在算力之外纳入内存带宽和芯片间通信,以 GB300 等效分数横向比较芯片并估算数据中心乃至全球的推理容量。Epoch AI 称,Nvidia 的 Blackwell 系列贡献了新增推理容量的 74%,既来自销量增长,也来自单 GPU 推理性能提升。

中文译文尚未完成,先为你展示原文。

Agentic inference capacity grew 4.6× from Q2 2025 to Q2 2026. This compares with just 2.6× growth in compute, according to our Inference Performance Index (IPI).

Nvidia’s Blackwell generations accounted for 74% of the added inference capacity, reflecting both growing sales and higher inference performance per GPU.

This shows that FLOP/s alone understate how quickly the capacity to run AI models is growing.

We estimate that FLOP/s alone understates GB300’s inference advantage over H100 by 10×. The standard AI chip comparison misses most of what matters for inference. We’re introducing the Inference Performance Index (IPI), a new measure that accounts for memory bandwidth and inter-chip communication alongside compute. These factors determine how many users or agents a chip can support simultaneously at a given output speed. Scores in GB300 equivalents let you compare chips directly and estimate the total inference capacity of a data center, or even the world.
查看原帖
NVIDIA 英伟达推理能力数据与训练论文研究评测基准#论文/研究#推理#数据/训练#评测/基准