2025
How Do Position Encodings Affect Length Generalization? Case Studies On In-Context Function Learning
AAAI 2025technical
The capability of In-Context Learning (ICL) is crucial for large language models to generalize across a wide range of tasks. By utilizing prompts, these models can accurately predict outcomes for previously unseen tasks without necessitating retraining. However, this generalization ability does not…