CASE FILE / Model & agent routing

Jev made our Slack agent 2x faster ⚡️ Our agent can be quite slow becaus…

Jev made our Slack agent 2x faster ⚡️ Our agent can be quite slow because it needs to read skills and figure out which tools to call. We used @typesafeai's new model to speed this up by first passing it the prompt and classifying the best skill, tool and params to use before handing it to the agent

By John Yeo @johnyeo_

● ● ●CASE FILEGUIDE

John Yeo · @johnyeo_

Original post

Jev made our Slack agent 2x faster ⚡️ Our agent can be quite slow because it needs to read skills and figure out which tools to call. We used @typesafeai's new model to speed this up by first passing it the prompt and classifying the best skill, tool and params to use before handing it to the agent

Views 4,919Likes 60Reposts 3

Chinese translation

Jev让我们的Slack代理速度提高了2倍️ 我们的代理可能会相当慢，因为它需要阅读技能并弄清楚要调用哪些工具。我们使用@typesafeai的新模型来加速这一过程，首先向它传递提示，并在将其交给代理之前对要使用的最佳技能、工具和参数进行分类

What this case shows

Let JEV choose the model or tool first
Auto-route on high confidence, escalate otherwise
This is the most common production pattern