← Search

Wei Yang Bryan Lim

21 accepted papers

2026

AdaCache: Adaptive Caching and Context Augmentation for Efficient LLM Serving

ICLR 2026poster

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models by integrating external knowledge sources, but at the cost of substantial computational overhead from extended input sequences. Current RAG systems exhibit two fundamental inefficiencies: redundant processing of frequ…

Cited by 0SourceScholar
2026

An Empirical Study on the Resilience of Partial Merging to Model Clone Attacks

ICML 2026poster

Model merging is a promising technique to enhance the capabilities of neural networks (NNs) by integrating multiple downstream fine-tuned models without requiring access to clients' raw data or substantial computation resources. However, conventional model merging typically requires collecting the f…

Cited by 0SourceScholar
2026

Certified Robustness under Heterogeneous Perturbations via Hybrid Randomized Smoothing

ICML 2026poster

Randomized smoothing provides strong, model-agnostic robustness certificates, but existing guarantees are limited to single modalities, treating continuous and discrete inputs in isolation. This limitation becomes critical in multimodal models, where decisions depend on cross-modal semantics and adv…

Cited by 0SourceScholar
2026

Disrupting Hierarchical Reasoning: Adversarial Protection for Geographic Privacy in Multimodal Reasoning Models

ICLR 2026poster

Multi-modal large reasoning models (MLRMs) pose significant privacy risks by inferring precise geographic locations from personal images through hierarchical chain-of-thought reasoning. Existing privacy protection techniques, primarily designed for perception-based models, prove ineffective against…

Cited by 0SourceScholar
2026

FedAdamom: Adaptive Momentum for Improved Generalization in Federated Optimization

CVPR 2026

Federated learning (FL) has emerged as a widely adopted training paradigm for privacy-preserving machine learning. Despite the past success of SGD-based methods, they still suffer from severe data heterogeneity and the lack of adaptivity in practical applications. While several adaptive federated op

Cited by 0SourcecodeScholar
2026

M-Loss: Quantifying Model Merging Compatibility with Limited Unlabeled Data

AAAI 2026technical

Training of large-scale models is both computationally intensive and often constrained by the availability of labeled data. Model merging offers a compelling alternative by directly integrating the weights of multiple source models without requiring additional data or extensive training. However, co

Cited by 0SourcePDFScholar
2026

MultiPriv: Benchmarking Individual-Level Privacy Reasoning in Vision-Language Models

ICML 2026poster

Modern Vision-Language Models (VLMs) pose significant individual-level privacy risks by linking fragmented multimodal data to identifiable individuals through hierarchical chain-of-thought reasoning. However, existing privacy benchmarks remain structurally insufficient for this threat, as they prima…

Cited by 0SourceScholar
2026

Oblivionis: A Lightweight Learning and Unlearning Framework for Federated Large Language Models

AAAI 2026technical

Large Language Models (LLMs) increasingly leverage Federated Learning (FL) to utilize private, task-specific datasets for fine-tuning while preserving data privacy. However, while federated LLM frameworks effectively enable collaborative training without raw data sharing, they critically lack built-

Cited by 0SourcePDFScholar
2026

Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation

ICML 2026poster

Accurate and efficient Video Quality Assessment (VQA) has long been a key research challenge. Current mainstream VQA methods typically improve performance by pretraining on large-scale classification datasets, followed by fine-tuning on VQA datasets. However, this strategy presents two significant c…

Cited by 0SourceScholar
2026

SubspacePath Pruner: Inference-time Pruning via Probe-based Representation–Parameter Coupling

ICML 2026poster

Large-scale dedicated application of LLMs in diverse scenarios increasingly demands specialized model inference behavior under strict constraints of accuracy, latency, and memory. However, the heterogeneous and long-tailed nature of real-world specialized scenarios makes it difficult to obtain train…

Cited by 0SourceScholar
2026

Tracing the Dynamics of Refusal: Exploiting Latent Refusal Trajectories for Robust Jailbreak Detection

ICML 2026poster

Representation Engineering typically relies on static refusal vectors derived from terminal representations. We move beyond this paradigm, demonstrating that refusal is a dynamic and sparse process rather than a localized outcome. Using Causal Tracing, we uncover the Refusal Trajectory—a persistent …

Cited by 0SourceScholar
2026

VENOMREC: Cross-Modal Interactive Poisoning for Targeted Promotion in Multimodal LLM Recommender Systems

ICML 2026poster

Multimodal large language models (MLLMs) are pushing recommender systems (RecSys) toward content-grounded retrieval and ranking via cross-modal fusion. We find that while cross-modal consensus often mitigates conventional poisoning that manipulates interaction logs or perturbs a single modality, it …

Cited by 0SourceScholar
2026

XDomainBench: Diagnosing Reasoning Collapse in High-Dimensional Scientific Knowledge Composition

ICML 2026poster

Large Language Models (LLMs) are increasingly deployed for knowledge synthesis, yet their capacity for compositional generalization in scientific knowledge remains under-characterized. Existing benchmarks primarily focus on single-turn restricted scenarios, failing to capture the capability boundari…

Cited by 0SourceScholar
2025

AegisGuard: RL-Guided Adapter Tuning for TEE-Based Efficient & Secure On-Device Inference

NeurIPS 2025poster

On-device large models (LMs) reduce cloud dependency but expose proprietary model weights to the end-user, making them vulnerable to white-box model stealing (MS) attacks. A common defense is TEE-Shielded DNN Partition (TSDP), which places all trainable LoRA adapters (fine tuned on private data) ins…

Cited by 0SourceScholar
2025

Enhancing Federated Domain Adaptation with Multi-Domain Prototype-Based Federated Fine-Tuning

ICLR 2025poster

Federated Domain Adaptation (FDA) is a Federated Learning (FL) scenario where models are trained across multiple clients with unique data domains but a shared category space, without transmitting private data. The primary challenge in FDA is data heterogeneity, which causes significant divergences i…

Cited by 0SourcePDFScholar
2025

FedRAM: Federated Reweighting and Aggregation for Multi-Task Learning

NeurIPS 2025poster

Federated Multi-Task Learning (FL-MTL) enables clients with heterogeneous data to collaboratively train models capable of handling multiple downstream tasks. However, FL-MTL faces key challenges, including statistical heterogeneity, task interference, and the need to balance local learning with glob…

Cited by 0SourcecodeScholar
2025

Unlearning through Knowledge Overwriting: Reversible Federated Unlearning via Selective Sparse Adapter

CVPR 2025poster

Federated Learning is a promising paradigm for privacy-preserving collaborative model training. In practice, it is essential not only to continuously train the model to acquire new knowledge but also to guarantee old knowledge the right to be forgotten (i.e., federated unlearning), especially for pr…

2022

Economics of Semantic Communication System in Wireless Powered Internet of Things

ICASSP 2022accepted

The semantic communication system enables wireless devices to communicate effectively with the semantic meaning of the data. Wireless powered Internet of Things (IoT) that adopts the semantic communication system relies on harvested energy to transmit semantic information. However, the issue of ener…

Cited by 0SourceScholar
2021

Communication-efficient and Scalable Decentralized Federated Edge Learning

IJCAI 2021poster

Federated Edge Learning (FEL) is a distributed Machine Learning (ML) framework for collaborative training on edge devices. FEL improves data privacy over traditional centralized ML model training by keeping data on the devices and only sending local model updates to a central coordinator for aggrega…

Cited by 15SourcePDFScholar
2021

Predictive Analytics for COVID-19 Social Distancing

IJCAI 2021poster

The COVID-19 pandemic has disrupted the lives of millions across the globe. In Singapore, promoting safe distancing by managing crowds in public areas have been the cornerstone of containing the community spread of the virus. One of the most important solutions to maintain social distancing is to mo…

Cited by 2SourcePDFScholar
2021

Towards Parkinson's Disease Prognosis Using Self-Supervised Learning and Anomaly Detection

ICASSP 2021accepted

Parkinson’s disease (PD) is a chronic disease with a high risk of incidence after the age of 60 and is a problem for many countries facing an aging population. Current works have mainly focused on supervised learning using data collected from various sensors to differentiate between PD and healthy s…

Cited by 0SourceScholar