Shitou Zhang

HyperLoRA: Efficient Cross-task Generalization via Constrained Low-Rank Adapters Generation

Adapting pre-trained language models (PLMs) for cross-task generalization is a crucial research area within the field of NLP. While fine-tuning and in-context learning are effective approaches for adapting LMs to emerging tasks, they can be costly and inefficient. Recently, some researchers have foc…