← Search

Wei Duan

5 accepted papers

2026

IGU-LoRA: Adaptive Rank Allocation via Integrated Gradients and Uncertainty-Aware Scoring

ICLR 2026poster

As large language models (LLMs) scale to billions of parameters, full-parameter fine-tuning becomes compute- and memory-prohibitive. Parameter-efficient fine-tuning (PEFT) mitigates this issue by updating only a small set of task-specific parameters while keeping the base model frozen. Among PEFT ap…

Cited by 0SourcecodeScholar
2026

Turning Drift into Constraint: Robust Reasoning Alignment in Non-Stationary Multi-Stream Environments

ICML 2026poster

This paper identifies a critical yet underexplored challenge in reasoning alignment from multiple multi-modal large language models (MLLMs): In non-stationary environments, the diverse reasoning distributions of source models often evolve unpredictably, transmitting systematic biases and drift to th…

Cited by 0SourceScholar
2022

Learning from the Dark: Boosting Graph Convolutional Neural Networks with Diverse Negative Samples

AAAI 2022technical

Graph Convolutional Neural Networks (GCNs) have been generally accepted to be an effective tool for node representations learning. An interesting way to understand GCNs is to think of them as a message passing mechanism where each node updates its representation by accepting information from its nei…