2025
Provable Benefits of Task-Specific Prompts for In-context Learning
AISTATS 2025poster
The in-context learning capabilities of modern language models have motivated a deeper mathematical understanding of sequence models. A line of recent work has shown that linear attention models can emulate projected gradient descent iterations to implicitly learn the task vector from the data provi…