2025
Generative Caching for Structurally Similar Prompts and Responses
NeurIPS 2025poster
Large Language Models (LLMs) are increasingly being used to plan, reason, and execute tasks across diverse scenarios. In use cases like repeatable workflows and agentic settings, prompts are often reused with minor variations while having a similar structure for recurring tasks. This opens up opport…