← Search

Le-Trung Nguyen

3 accepted papers

2026

Efficient Resource-Constrained Training of Transformers via Subspace Optimization

ICLR 2026oral

As AI increasingly shapes daily life, energy consumption and data privacy have become pressing concerns. On-device learning trains models directly on edge devices, cutting energy consumption and safeguarding data privacy. However, the expanding scale of modern neural networks creates a major obstacl…

Cited by 0Source ↗code ↗Scholar ↗
2025

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning

ICML 2025poster

On-device learning has emerged as a promising direction for AI development, particularly because of its potential to reduce latency issues and mitigate privacy risks associated with device-server communication, while improving energy efficiency. Despite these advantages, significant memory and compu…

Cited by 6Source ↗PDF ↗Scholar ↗
2024

Activation Map Compression through Tensor Decomposition for Deep Learning

NeurIPS 2024poster

Internet of Things and Deep Learning are synergetically and exponentially growing industrial fields with a massive call for their unification into a common framework called Edge AI. While on-device inference is a well-explored topic in recent research, backpropagation remains an open challenge due t…