← Search

Aël Quélennec

3 accepted papers

2026

Study of Training Dynamics for Memory-Constrained Fine-Tuning

ICLR 2026poster

Memory-efficient training of deep neural networks has become increasingly important as models grow larger while deployment environments impose strict resource constraints. We propose TraDy, a novel transfer learning scheme leveraging two key insights: layer importance for updates is architecture-dep…

Cited by 0SourceScholar
2025

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning

ICML 2025poster

On-device learning has emerged as a promising direction for AI development, particularly because of its potential to reduce latency issues and mitigate privacy risks associated with device-server communication, while improving energy efficiency. Despite these advantages, significant memory and compu…

Cited by 0SourcePDFScholar
2024

Activation Map Compression through Tensor Decomposition for Deep Learning

NeurIPS 2024poster

Internet of Things and Deep Learning are synergetically and exponentially growing industrial fields with a massive call for their unification into a common framework called Edge AI. While on-device inference is a well-explored topic in recent research, backpropagation remains an open challenge due t…