Dawa Derksen

Parameter-Efficient Adaptation of Geospatial Foundation Models through Embedding Deflection

As large-scale heterogeneous data sets become increasingly available, adapting foundation models at low cost has become a key issue. Seminal works in natural language processing, e.g. Low-Rank Adaptation (LoRA), leverage the low "intrinsic rank" of parameter updates during adaptation. In this paper,…