← Search

Qimei Cui

4 accepted papers

2025

Advancing Expert Specialization for Better MoE

NeurIPS 2025oral

Mixture-of-Experts (MoE) models enable efficient scaling of large language models (LLMs) by activating only a subset of experts per input. However, we observe that the commonly used auxiliary load balancing loss often leads to expert overlap and overly uniform routing, which hinders expert speciali…

Cited by 0SourceScholar
2024

ContextBLIP: Doubly Contextual Alignment for Contrastive Image Retrieval from Linguistically Complex Descriptions

ACL 2024findings

Image retrieval from contextual descriptions (IRCD) aims to identify an image within a set of minimally contrastive candidates based on linguistically complex text. Despite the success of VLMs, they still significantly lag behind human performance in IRCD. The main challenges lie in aligning key con…

2024

DocMSU: A Comprehensive Benchmark for Document-Level Multimodal Sarcasm Understanding

AAAI 2024technical

Multimodal Sarcasm Understanding (MSU) has a wide range of applications in the news field such as public opinion analysis and forgery detection. However, existing MSU benchmarks and approaches usually focus on sentence-level MSU. In document-level news, sarcasm clues are sparse or small and are of…

2024

Refining Latent Homophilic Structures over Heterophilic Graphs for Robust Graph Convolution Networks

AAAI 2024technical

Graph convolution networks (GCNs) are extensively utilized in various graph tasks to mine knowledge from spatial data. Our study marks the pioneering attempt to quantitatively investigate the GCN robustness over omnipresent heterophilic graphs for node classification. We uncover that the predominant…

Cited by 12SourcePDFScholar