Tuan-Kiet Doan

INSTANT: Compressing Gradients and Activations for Resource-Efficient Training

Deep learning has advanced at an unprecedented pace. This progress has led to a significant increase in its complexity. However, despite extensive research on accelerating inference, training deep models directly within a resource-constrained budget remains a considerable challenge due to its high c…