← Search

Qingyu Song

7 accepted papers

2026

AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning

ICML 2026poster

Zeroth-Order (ZO) optimization has emerged as a promising solution for fine-tuning LLMs under strict memory constraints, as it avoids the prohibitive memory cost of storing activations for backpropagation. However, existing ZO methods typically employ isotropic perturbations, neglecting the rich str…

Cited by 0SourceScholar
2024

Towards Robust Learning to Optimize with Theoretical Guarantees

CVPR 2024poster

Learning to optimize (L2O) is an emerging technique to solve mathematical optimization problems with learning-based methods. Although with great success in many real-world scenarios such as wireless communications computer networks and electronic design existing L2O works lack theoretical demonstrat…

2021

Rethinking Counting and Localization in Crowds: A Purely Point-Based Framework

ICCV 2021poster

Localizing individuals in crowds is more in accordance with the practical demands of subsequent high-level crowd analysis tasks than simply counting. However, existing localization based methods relying on intermediate representations (i.e., density maps or pseudo boxes) serving as learning targets…

Cited by 365PDFcodeScholar
2021

To Choose or to Fuse? Scale Selection for Crowd Counting

AAAI 2021technical

In this paper, we address the large scale variation problem in crowd counting by taking full advantage of the multi-scale feature representations in a multi-level network. We implement such an idea by keeping the counting error of a patch as small as possible with a proper feature level selection st…

2021

Uniformity in Heterogeneity: Diving Deep Into Count Interval Partition for Crowd Counting

ICCV 2021poster

Recently, the problem of inaccurate learning targets in crowd counting draws increasing attention. Inspired by a few pioneering work, we solve this problem by trying to predict the indices of pre-defined interval bins of counts instead of the count values themselves. However, an inappropriate interv…

Cited by 49PDFcodeScholar
2020

A Hierarchical Graph Network for 3D Object Detection on Point Clouds

CVPR 2020poster

3D object detection on point clouds finds many applications. However, most known point cloud object detection methods did not adequately accommodate the characteristics (e.g., sparsity) of point clouds, and thus some key semantic information (e.g., shape information) is not well captured. In this pa…

Cited by 196PDFScholar