← Search

Aël Quélennec

3 accepted papers

2026

Study of Training Dynamics for Memory-Constrained Fine-Tuning

ICLR 2026poster

Memory-efficient training of deep neural networks has become increasingly important as models grow larger while deployment environments impose strict resource constraints. We propose TraDy, a novel transfer learning scheme leveraging two key insights: layer importance for updates is architecture-dep…

Cited by 0Source ↗Scholar ↗
2025

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning

ICML 2025poster

On-device learning has emerged as a promising direction for AI development, particularly because of its potential to reduce latency issues and mitigate privacy risks associated with device-server communication, while improving energy efficiency. Despite these advantages, significant memory and compu…

Cited by 6Source ↗PDF ↗Scholar ↗
2024

Activation Map Compression through Tensor Decomposition for Deep Learning

NeurIPS 2024poster

Internet of Things and Deep Learning are synergetically and exponentially growing industrial fields with a massive call for their unification into a common framework called Edge AI. While on-device inference is a well-explored topic in recent research, backpropagation remains an open challenge due t…