← Search

Jingwei Dong

3 accepted papers

2025

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards

ICLR 2025poster

The rapid scaling of large language models necessitates more lightweight finetuning methods to reduce the explosive GPU memory overhead when numerous customized models are served simultaneously. Targeting more parameter-efficient low-rank adaptation (LoRA), parameter sharing presents a promising sol…

2025

ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom

EMNLP 2025

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation. To tackle this issue, we first identify the drawbacks of exis

2025

TreeSynth: Synthesizing Diverse Data from Scratch via Tree-Guided Subspace Partitioning

NeurIPS 2025spotlight

Model customization necessitates high-quality and diverse datasets, but acquiring such data remains time-consuming and labor-intensive. Despite the great potential of large language models (LLMs) for data synthesis, current approaches are constrained by limited seed data, model biases and low-varia…

Cited by 0SourcecodeScholar