← Search

Senmiao Wang

3 accepted papers

2026

MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning

ICML 2026poster

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks. Typically, LLMs are first pre-trained on large corpora and subsequently fine-tuned on task-specific datasets. However, during fine-tuning, LLMs may forget some knowledge acquired in the pre-training …

Cited by 0SourceScholar
2024

PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programming

ICML 2024poster

Solving large-scale linear programming (LP) problems is an important task in various areas such as communication networks, power systems, finance and logistics. Recently, two distinct approaches have emerged to expedite LP solving: (i) First-order methods (FOMs); (ii) Learning to optimize (L2O). In…

2022

Adaptive Model Design for Markov Decision Process

ICML 2022spotlight

In a Markov decision process (MDP), an agent interacts with the environment via perceptions and actions. During this process, the agent aims to maximize its own gain. Hence, appropriate regulations are often required, if we hope to take the external costs/benefits of its actions into consideration.…

Cited by 14SourcePDFScholar