行业58

Parasail 将率先规模化部署 Positron Titan 服务器,首期 5MW

原标题:Memory capacity per watt is becoming one of the most useful ways to judge AI hardware.

Rohan Paul@rohanpaul_ai发布时间 (北京时间)

推理云 Parasail 宣布将率先规模化部署 Positron 的下一代 Titan 服务器,首期规模为 5MW。Titan 用廉价的智能手机式 DRAM 承载超大模型,而不用稀缺的 HBM,单台服务器可容纳最多 32 万亿参数的模型。作者认为,每瓦内存容量正成为判断 AI 硬件最有用的指标之一。

中文译文尚未完成,先为你展示原文。

Memory capacity per watt is becoming one of the most useful ways to judge AI hardware.

Positron Titan runs multi-trillion-parameter models on commodity DRAM, and @parasail_io is the first inference cloud putting it online at scale.

Parasail, an inference cloud that already runs several chip types behind one API, just announced it will be the first to deploy Positron’s next-gen Titan servers at scale, starting with 5MW.

Titan keeps giant models in cheap smartphone-style memory instead of scarce high-bandwidth memory (HBM), so one server can hold a model of up to 32 trillion parameters.

Positron's Titan is joining the Parasail fleet. 5MW. Trillions of tokens a day of cost-optimized compute by late 2027. @parasail_io @positron_ai @parasail_io is the first multi-silicon inference cloud that routes your prompts to the best chip for the job, serving trillions of tokens a day to hundreds of customers. Positron fills a vital part of compute spectrum on the cost optimized side: 4X better cost-per token than next gen NVIDIA/AMD systems which is perfect for large-scale agent swarms, background agents, and physical AI. Positron has done incredible work building a chip and system that orchestrates across DRAM and SRAM allowing for massively scalable memory pools with commodity memory giving the best of both worlds for memory capacity and bandwidth. We've been excited to partner with them in the early days through the launch of their Atlas chip and now big capacity plans with Titan. @positron_ai
查看原帖
部署工程数据与训练行业动态#行业动态#部署/工程#数据/训练