ThunderAgent
A Fast, Simple, and Robust Program-Aware Agentic Inference System
ThunderAgent is a program-aware scheduling layer for agentic inference that treats each multi-turn agent workflow as a schedulable program, tracking execution phase, KV-cache footprint, and node placement to reduce KV-cache thrashing and improve throughput and latency.
Recent stories
0 linked stories
No linked stories yet.