← Search

Piotr Andruszkiewicz

2 accepted papers

2025

No Train but Gain: Language Arithmetic for training-free Language Adapters enhancement

COLING 2025main

Modular deep learning is the state-of-the-art solution for lifting the curse of multilinguality, preventing the impact of negative interference and enabling cross-lingual performance in Multilingual Pre-trained Language Models. However, a trade-off of this approach is the reduction in positive trans…

2024

Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation

COLING 2024main

The rise of Modular Deep Learning showcases its potential in various Natural Language Processing applications. Parameter-efficient fine-tuning (PEFT) modularity has been shown to work for various use cases, from domain adaptation to multilingual setups. However, all this work covers the case where t…