Yota Maeda

MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba

An ecosystem of Transformer-based models has been established by building large models with extensive data. Parameter-efficient fine-tuning (PEFT) is a crucial technology for deploying these models to downstream tasks with minimal cost while achieving effective performance. Recently, Mamba, a State…