← Search

Tianxiao Cao

2 accepted papers

2026

Unpacking the Implicit Norm Dynamics of Sharpness-Aware Minimization in Tensorized Models

AAAI 2026technical

Sharpness-Aware Minimization (SAM) has been proven to be an effective optimization technique for improving generalization in overparameterized models. While prior works have explored the implicit regularization of SAM in simple two-core scale-invariant settings, its behavior in more general tensoriz

Cited by 0SourcePDFScholar
2024

Learning Low-Rank Tensor Cores with Probabilistic ℓ0-Regularized Rank Selection for Model Compression

IJCAI 2024poster

Compressing deep neural networks is of great importance for real-world applications on resource-constrained devices. Tensor decomposition is one promising answer that retains the functionality and most of the expressive power of the original deep models by replacing the weights with their decomposed…