← Search

Jianlun Ma

2 accepted papers

2025

Learning from Loss Landscape: Generalizable Mixed-Precision Quantization via Adaptive Sharpness-Aware Gradient Aligning

ICML 2025poster

Mixed Precision Quantization (MPQ) has become an essential technique for optimizing neural network by determining the optimal bitwidth per layer. Existing MPQ methods, however, face a major hurdle: they require a computationally expensive search for quantization strategies on large-scale datasets. T…

Cited by 0SourcePDFScholar
2024

One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training

AAAI 2024technical

Weight quantization is an effective technique to compress deep neural networks for their deployment on edge devices with limited resources. Traditional loss-aware quantization methods commonly use the quantized gradient to replace the full-precision gradient. However, we discover that the gradient e…