← Search

Wojciech Masarczyk

4 accepted papers

2026

Optimizer Choice Matters For The Emergence of Neural Collapse

ICLR 2026poster

Neural Collapse (NC) refers to the emergence of highly symmetric geometric structures in the representations of deep neural networks during the terminal phase of training. Despite its prevalence, the theoretical understanding of NC remains limited. Existing analyses largely ignore the role of the op…

Cited by 0SourceScholar
2023

The Tunnel Effect: Building Data Representations in Deep Neural Networks

NeurIPS 2023poster

Deep neural networks are widely known for their remarkable effectiveness across various tasks, with the consensus that deeper networks implicitly learn more complex data representations. This paper shows that sufficiently deep networks trained for supervised image classification split into two disti…

Cited by 18SourcePDFScholar
2022

Multiband VAE: Latent Space Alignment for Knowledge Consolidation in Continual Learning

IJCAI 2022poster

We propose a new method for unsupervised generative continual learning through realignment of Variational Autoencoder's latent space. Deep generative models suffer from catastrophic forgetting in the same way as other neural structures. Recent generative continual learning works approach this proble…

2021

Reinforcement learning for optimization of variational quantum circuit architectures

NeurIPS 2021poster

The study of Variational Quantum Eigensolvers (VQEs) has been in the spotlight in recent times as they may lead to real-world applications of near-term quantum devices. However, their performance depends on the structure of the used variational ansatz, which requires balancing the depth and expressi…

Cited by 169SourcePDFScholar