产品38

Artificial Analysis 数据平台支持自建自定义指数

原标题:Build your own custom index in the Artificial Analysis Data Playground

Artificial Analysis@ArtificialAnlys发布时间 (北京时间)

Artificial Analysis 的 Data Playground 支持用户自建自定义指数:可任选其 benchmark、自定义权重并与其他图表轴联动绘图,模型须在指数内全部评测均有结果才计分,与 Intelligence Index 方法论一致。

中文译文尚未完成,先为你展示原文。

Build your own custom index in the Artificial Analysis Data Playground

Add any Artificial Analysis benchmarks, customize their weights, and plot the results with other chart axis. Models receive a score only if they have results for every evaluation in your index, consistent with the Intelligence Index methodology.

Also in the Data Playground:
➤ Formula metrics: combine any metrics with +, -, *, / and functions such as log and sqrt
➤ Playback: play a scatter chart forward by launch date, with the frontier drawn as it stood at each date
➤ Heat maps across many evaluations, and box plot distributions by group, such as open weights vs proprietary
➤ A workbench with sheets, Columns/Rows shelves and a dashboard view

The Data Playground is available with Artificial Analysis Pro.

产品更新评测基准#产品更新#评测/基准