← Search

Ibrahim Ayed

5 accepted papers

2023

Module-wise Training of Neural Networks via the Minimizing Movement Scheme

NeurIPS 2023poster

Greedy layer-wise or module-wise training of neural networks is compelling in constrained and on-device settings where memory is limited, as it circumvents a number of problems of end-to-end back-propagation. However, it suffers from a stagnation problem, whereby early layers overfit and deeper laye…

Cited by 3SourcePDFScholar
2022

A Neural Tangent Kernel Perspective of GANs

ICML 2022spotlight

We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GANs’ training scheme, are subject to ill-defined discriminator gradients. We overcome this issue which impedes a principl…

2021

Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting

ICLR 2021oral

Forecasting complex dynamical phenomena in settings where only partial knowledge of their dynamics is available is a prevalent problem across various scientific fields. While purely data-driven approaches are arguably insufficient in this context, standard physical modeling based approaches tend to…

2021

LEADS: Learning Dynamical Systems that Generalize Across Environments

NeurIPS 2021poster

When modeling dynamical systems from real-world data samples, the distribution of data often changes according to the environment in which they are captured, and the dynamics of the system itself vary from one environment to another. Generalizing across environments thus challenges the conventional…

2020

Learning the Spatio-Temporal Dynamics of Physical Processes from Partial Observations

ICASSP 2020accepted

We consider the problem of automatically learning the dynamics of physical processes evolving in space and time from incomplete observations. This is a central problem in many fields that remains complicated for large observation spaces and complex dynamics. We propose a data-driven framework, where…

Cited by 0SourceScholar