2024
LaRA: Large Rank Adaptation for Speech and Text Cross-Modal Learning in Large Language Models
EMNLP 2024finding
Integrating speech and text capabilities into large language models (LLMs) is a challenging task and we present Large Rank Adaptation (LaRA) for effective cross-modal integration of speech and text in the LLM framework. Unlike conventional LoRA, our method requires significantly larger ranks compara…