2023
Improving generalization in large langue model by learning prefix subspaces
EMNLP 2023long findings
This article focuses on large language models (LLMs) fine-tuning in the scarce data regime (also known as "few-shot learning setting"). We propose a method to increase the generalization capabilities of LLMs based on neural network subspaces. This optimization method, recently introduced in comput…