产品
58AI 评分(两次独立评分的平均)

NaceAI 推出 Drex Router 模型路由,单次决策约 57 至 87 毫秒

原标题:A model decision in under 90 ms is fast enough to put a router in front of almost any LLM call.

Rohan Paul@rohanpaul_ai发布时间 (北京时间)

NaceAI 发布 Drex Router,一个基于 Gemma 构建的 12B 小模型,读取提示词和候选模型列表后返回选中的模型,单次决策约 57 至 87 毫秒。

中文译文尚未完成,先为你展示原文。

A model decision in under 90 ms is fast enough to put a router in front of almost any LLM call.

@NaceAI just launched Drex Router, and it reads the prompt and your list of models, then returns its pick in about 57 to 87 ms, using a 12B model built on Gemma.

In Nace’s tests on 1,400 general-knowledge exam questions, it scored 87.6% for $0.10 per 1,000 questions, while rival Jev Router scored 86.4% for $1.09.

A router that only returns a model name can’t tell you a confident pick from a coin flip. Drex Router returns a probability for every candidate plus a short reason,

Introducing Drex Router. A small model that picks the right LLM/SLM and reasoning effort for every step your agent takes. Accuracy: Drex Router 87.6% vs. Jev Router’s 86.4% Try it: https://console.nace.ai COMMENT DREX and get extra $5 in API credits
查看原帖
Agent 智能体部署工程产品更新#产品更新#Agent#部署/工程