3DM: Distill, Dynamic Drop, and Merge for Debiasing Multi-modal Large Language Models
The rapid advancement of Multi-modal Language Models (MLLMs) has significantly enhanced performance in multimodal tasks, yet these models often exhibit inherent biases that compromise their reliability and fairness. Traditional debiasing methods face a trade-off between the need for extensive labele…