Nura Aljaafari

CARMA: Enhanced Compositionality in LLMs via Advanced Regularisation and Mutual Information Alignment

Large language models (LLMs) struggle with compositional generalisation, limiting their ability to systematically combine learned components to interpret novel inputs. While architectural modifications, fine-tuning, and data augmentation improve compositionality, they often have limited adaptability