AI Just Outsourced It's Own Thinking (Stanford)
Discover AI
0:00 / 0:00
AI Just Outsourced It's Own Thinking (Stanford)
5 056 просмотров · 1 год назад
Discover AI
91,5 тыс. подписчиков
5 056 просмотров · 1 год назад
Ai systems, especially multi-agent systems outsource their complex planning phase with advanced thinking and complex reasoning. It is simply to expensive for the AI to do the thinking all by itself, again and again. Cache the complete PLAN template for each and every complex query and reuse it.
Reduce costs up to 50%.
all rights w/ authors:
"Cost-Efficient Serving of LLM Agents via Test-Time Plan Caching"
Qizheng Zhang 1, Michael Wornow 1, and Kunle Olukotun 1,2
from
1 Department of Computer Science, Stanford University
1 Department of Electrical Engineering, Stanford University
#stanford
#airesearch
#scienceexplained
#aiagents
#science