← Search

Van-Tam Nguyen

9 accepted papers

2026

Efficient Resource-Constrained Training of Transformers via Subspace Optimization

ICLR 2026oral

As AI increasingly shapes daily life, energy consumption and data privacy have become pressing concerns. On-device learning trains models directly on edge devices, cutting energy consumption and safeguarding data privacy. However, the expanding scale of modern neural networks creates a major obstacl…

Cited by 0SourcecodeScholar
2026

INSTANT: Compressing Gradients and Activations for Resource-Efficient Training

ICLR 2026poster

Deep learning has advanced at an unprecedented pace. This progress has led to a significant increase in its complexity. However, despite extensive research on accelerating inference, training deep models directly within a resource-constrained budget remains a considerable challenge due to its high c…

Cited by 0SourcecodeScholar
2026

Study of Training Dynamics for Memory-Constrained Fine-Tuning

ICLR 2026poster

Memory-efficient training of deep neural networks has become increasingly important as models grow larger while deployment environments impose strict resource constraints. We propose TraDy, a novel transfer learning scheme leveraging two key insights: layer importance for updates is architecture-dep…

Cited by 0SourceScholar
2025

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning

ICML 2025poster

On-device learning has emerged as a promising direction for AI development, particularly because of its potential to reduce latency issues and mitigate privacy risks associated with device-server communication, while improving energy efficiency. Despite these advantages, significant memory and compu…

Cited by 0SourcePDFScholar
2025

Self-Supervised Learning of Graph Representations for Network Intrusion Detection

NeurIPS 2025poster

Detecting intrusions in network traffic is a challenging task, particularly under limited supervision and constantly evolving attack patterns. While recent works have leveraged graph neural networks for network intrusion detection, they often decouple representation learning from anomaly detection,…

Cited by 0SourceScholar
2025

Till the Layers Collapse: Compressing a Deep Neural Network Through the Lenses of Batch Normalization Layers.

AAAI 2025technical

Today, deep neural networks are widely used since they can handle a variety of complex tasks. Their generality makes them very powerful tools in modern technology. However, deep neural networks are often overparameterized. The usage of these large models consumes a lot of computation resources. In t…

2024

Activation Map Compression through Tensor Decomposition for Deep Learning

NeurIPS 2024poster

Internet of Things and Deep Learning are synergetically and exponentially growing industrial fields with a massive call for their unification into a common framework called Edge AI. While on-device inference is a well-explored topic in recent research, backpropagation remains an open challenge due t…

2024

Debiasing surgeon: fantastic weights and how to find them

ECCV 2024poster

"Nowadays an ever-growing concerning phenomenon, the emergence of algorithmic biases that can lead to unfair models, emerges. Several debiasing approaches have been proposed in the realm of deep learning, employing more or less sophisticated approaches to discourage these models from massively emplo…

Cited by 0SourcePDFScholar