← Search

Qing Tao

6 accepted papers

2026

The Power of Decaying Steps: Enhancing Attack Stability and Transferability for Sign-based Optimizers

CVPR 2026

Crafting adversarial examples can be formulated as an optimization problem. While sign-based optimizers such as I-FGSM and MI-FGSM have become the de facto standard for the induced optimization problems, there still exist several unsolved problems in theoretical grounding and practical reliability e

Cited by 0SourcecodeScholar
2023

Structured BFGS Method for Optimal Doubly Stochastic Matrix Approximation

AAAI 2023technical

Doubly stochastic matrix plays an essential role in several areas such as statistics and machine learning. In this paper we consider the optimal approximation of a square matrix in the set of doubly stochastic matrices. A structured BFGS method is proposed to solve the dual of the primal problem. Th…

2021

Gradient Descent Averaging and Primal-dual Averaging for Strongly Convex Optimization

AAAI 2021technical

Averaging scheme has attracted extensive attention in deep learning as well as traditional machine learning. It achieves theoretically optimal convergence and also improves the empirical model performance. However, there is still a lack of sufficient convergence analysis for strongly convex optimiza…

Cited by 3SourcePDFScholar
2021

The Role of Momentum Parameters in the Optimal Convergence of Adaptive Polyak's Heavy-ball Methods

ICLR 2021poster

The adaptive stochastic gradient descent (SGD) with momentum has been widely adopted in deep learning as well as convex optimization. In practice, the last iterate is commonly used as the final solution. However, the available regret analysis and the setting of constant momentum parameters only guar…

Cited by 17SourcePDFScholar
2020

Semismooth Newton Algorithm for Efficient Projections onto $\ell_1, ∞$-norm Ball

ICML 2020poster

The structured sparsity-inducing $\ell_{1, \infty}$-norm, as a generalization of the classical $\ell_1$-norm, plays an important role in jointly sparse models which select or remove simultaneously all the variables forming a group. However, its resulting problem is more difficult to solve than the c…