← Search

Penghao Zhao

4 accepted papers

2026

Efficient Multi-round LLM Inference over Disaggregated Serving

ICML 2026poster

With the rapid evolution of Large Language Models (LLMs), multi-round workflows, such as autonomous agents and iterative retrieval, have become increasingly prevalent. However, this raises hurdles for serving LLMs under prefill-decode (PD) disaggregation, a widely adopted paradigm that separates the…

Cited by 0SourceScholar
2026

PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting

ICML 2026poster

Coupled spatiotemporal forecasting is important for predicting the future evolution of multiple interacting dynamical systems, such as in climate models. However, existing methods are severely constrained by the persistent bottleneck of compounding errors. In coupled systems, errors from each subsys…

Cited by 0SourceScholar
2024

Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

NeurIPS 2024poster

In current deep learning tasks, Adam-style optimizers—such as Adam, Adagrad, RMSprop, Adafactor, and Lion—have been widely used as alternatives to SGD-style optimizers. These optimizers typically update model parameters using the sign of gradients, resulting in more stable convergence curves. The l…

Cited by 6SourcePDFScholar
2023

Learning from Training Dynamics: Identifying Mislabeled Data beyond Manually Designed Features

AAAI 2023technical

While mislabeled or ambiguously-labeled samples in the training set could negatively affect the performance of deep models, diagnosing the dataset and identifying mislabeled samples helps to improve the generalization power. Training dynamics, i.e., the traces left by iterations of optimization algo…