← Search

Baochen Sun

3 accepted papers

2025

MoLA: MoE LoRA with Layer-wise Expert Allocation

NAACL 2025findings

Recent efforts to integrate low-rank adaptation (LoRA) with the Mixture-of-Experts (MoE) have managed to achieve performance comparable to full-parameter fine-tuning by tuning much fewer parameters. Despite promising results, research on improving the efficiency and expert analysis of LoRA with MoE…

2024

Supervision Interpolation via LossMix: Generalizing Mixup for Object Detection and Beyond

AAAI 2024technical

The success of data mixing augmentations in image classification tasks has been well-received. However, these techniques cannot be readily applied to object detection due to challenges such as spatial misalignment, foreground/background distinction, and plurality of instances. To tackle these issues…