← Search

Shiyuan Zhang

7 accepted papers

2026

Balancing Signal and Variance: Adaptive Offline RL Post-Training for VLA Flow Models

AAAI 2026technical

Vision-Language-Action (VLA) models based on flow matching have shown excellent performance in general-purpose robotic manipulation tasks. However, the action accuracy of these models on complex downstream tasks is unsatisfactory. One important reason is that these models rely solely on the post-tra

Cited by 0SourcePDFScholar
2026

Clipping Low-Probability Tokens in SFT Yields a Generalizable Initialization for RL

ICML 2026poster

Supervised Fine-Tuning (SFT) is a critical step for adapting Large Language Models (LLMs) to specialized domains, often serving as an initialization for subsequent reinforcement learning (RL). However, SFT can overfit a small set of expert data, harming generalization and eroding prior knowledge. Th…

Cited by 0SourceScholar
2026

Dimension-Independent Convergence of Underdamped Langevin Monte Carlo in KL Divergence

ICML 2026poster

Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions $\pi\propto e^{-V}$, and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD typically scale polynomially with the ambient dimension $d$, le…

Cited by 0SourceScholar
2025

Fine-Tuning Hard-to-Simulate Objectives for Quadruped Locomotion: A Case Study on Total Power Saving

ICRA 2025

Legged locomotion is not just about mobility; it also encompasses crucial objectives such as energy efficiency, safety, and user experience, which are vital for real-world applications. However, key factors such as battery power consumption and stepping noise are often inaccurately modeled or missin

Cited by 2SourcecodeScholar
2025

Taming Hyperparameter Sensitivity in Data Attribution: Practical Selection Without Costly Retraining

NeurIPS 2025poster

Data attribution methods, which quantify the influence of individual training data points on a machine learning model, have gained increasing popularity in data-centric applications in modern AI. Despite a recent surge of new methods developed in this space, the impact of hyperparameter tuning in th…

Cited by 0SourcecodeScholar
2024

$\texttt{dattri}$: A Library for Efficient Data Attribution

NeurIPS 2024spotlight

Data attribution methods aim to quantify the influence of individual training samples on the prediction of artificial intelligence (AI) models. As training data plays an increasingly crucial role in the modern development of large-scale AI models, data attribution has found broad applications in imp…