ThunderAgent
KV-cache scheduling for agent workflows
A scheduler for whole agent workflows that manages KV-cache-aware execution during tool calls, intended to reduce cache thrashing in agentic inference.
Recent stories
0 linked stories
No linked stories yet.