Isabella Olariu

Evaluating Parameter-Efficient Finetuning Approaches for Pre-trained Models on the Financial Domain

Large-scale language models with millions, billions, or trillions of trainable parameters are becoming increasingly popular. However, they risk becoming rapidly over-parameterized and the adaptation cost of fully fine-tuning them increases significantly. Storing them becomes progressively impractica…