← Search

Pengrui Li

3 accepted papers

2025

Subspace Optimization for Large Language Models with Convergence Guarantees

ICML 2025poster

Subspace optimization algorithms, such as GaLore (Zhao et al., 2024), have gained attention for pre-training and fine-tuning large language models (LLMs) due to their memory efficiency. However, their convergence guarantees remain unclear, particularly in stochastic settings. In this paper, we revea…

2024

A Local-Ascending-Global Learning Strategy for Brain-Computer Interface

AAAI 2024technical

Neuroscience research indicates that the interaction among different functional regions of the brain plays a crucial role in driving various cognitive tasks. Existing studies have primarily focused on constructing either local or global functional connectivity maps within the brain, often lacking an…

Cited by 9SourcePDFScholar