← Search

Alexandra Maria Proca

5 accepted papers

2026

Temporal superposition and feature geometry of RNNs under memory demands

ICLR 2026oral

Understanding how populations of neurons represent information is a central challenge across machine learning and neuroscience. Recent work in both fields has begun to characterize the representational geometry and functionality underlying complex distributed activity. For example, artificial neural…

Cited by 0SourceScholar
2025

From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks

ICLR 2025poster

Biological and artificial neural networks develop internal representations that enable them to perform complex tasks. In artificial networks, the effectiveness of these models relies on their ability to build task specific representation, a process influenced by interactions among datasets, architec…

Cited by 5SourcePDFScholar
2025

Learning dynamics in linear recurrent neural networks

ICML 2025oral

Recurrent neural networks (RNNs) are powerful models used widely in both machine learning and neuroscience to learn tasks with temporal dependencies and to model neural dynamics. However, despite significant advancements in the theory of RNNs, there is still limited understanding of their learning p…

Cited by 1SourcePDFScholar
2024

Discovering modular solutions that generalize compositionally

ICLR 2024poster

Many complex tasks can be decomposed into simpler, independent parts. Discovering such underlying compositional structure has the potential to enable compositional generalization. Despite progress, our most powerful systems struggle to compose flexibly. It therefore seems natural to make models more…

2024

Flexible task abstractions emerge in linear networks with fast and bounded units

NeurIPS 2024spotlight

Animals survive in dynamic environments changing at arbitrary timescales, but such data distribution shifts are a challenge to neural networks. To adapt to change, neural systems may change a large number of parameters, which is a slow process involving forgetting past information. In contrast, anim…