← Search

Xirui Li

8 accepted papers

2026

FedPissa: Towards Federated Personalized Adaptation of Foundation Models via LoRA Subspace Mapping

ICML 2026spotlight

LoRA efficiently adapts large pre-trained models via low-rank updates, making it a strong parameter-efficient fine-tuning (PEFT) method. When integrated with Federated Learning (FL), it enables collaborative fine-tuning across distributed clients, leveraging rich downstream data without exposing pri…

Cited by 0SourceScholar
2026

Latent Knowledge-Guided Video Diffusion for Scientific Phenomena Generation from a Single Initial Frame

AAAI 2026technical

Video diffusion models have achieved impressive results in natural scene generation, yet they struggle to generalize to scientific phenomena such as fluid simulations and meteorological processes, where underlying dynamics are governed by scientific laws. These tasks pose unique challenges, includin

Cited by 0SourcePDFScholar
2026

Tailoring the Training: Difficulty-Aware Learning Strategy Allocation for Large Language Models

ICML 2026poster

Although reinforcement learning (RL) enhances the reasoning capabilities of large language models (LLMs), it is primarily learned from the model's self-generated distribution, limiting its ability to acquire reasoning skills beyond its initial knowledge. To overcome this, we propose a Difficulty-Awa…

Cited by 0SourceScholar
2025

A Simple Approach to Unifying Diffusion-based Conditional Generation

ICLR 2025poster

Recent progress in image generation has sparked research into controlling these models through condition signals, with various methods addressing specific challenges in conditional generation. Instead of proposing another specialized technique, we introduce a simple, unified framework to handle dive…

Cited by 1SourcePDFScholar
2025

Is Your Multimodal Language Model Oversensitive to Safe Queries?

ICLR 2025poster

Humans are prone to cognitive distortions — biased thinking patterns that lead to exaggerated responses to specific stimuli, albeit in very different contexts. This paper demonstrates that advanced Multimodal Large Language Models (MLLMs) exhibit similar tendencies. While these models are designed t…

Cited by 0SourcePDFScholar
2024

DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLMs Jailbreakers

EMNLP 2024finding

Safety-aligned Large Language Models (LLMs) are still vulnerable to some manual and automated jailbreak attacks, which adversarially trigger LLMs to output harmful content. However, existing jailbreaking methods usually view a harmful prompt as a whole but they are not effective at reducing LLMs’ at…

2024

VidToMe: Video Token Merging for Zero-Shot Video Editing

CVPR 2024poster

Diffusion models have made significant advances in generating high-quality images but their application to video generation has remained challenging due to the complexity of temporal motion. Zero-shot video editing offers a solution by utilizing pre-trained image diffusion models to translate source…