Agentic Plan Caching: Test-Time Memory for Fast and Cost-Efficient LLM Agents
LLM-based agent applications have shown increasingly remarkable capabilities in complex workflows but incur substantial costs and latency due to extensive planning and reasoning requirements. Existing LLM caching techniques (like context caching and semantic caching), primarily designed for serving…