← Search

Jakub Mikolaj Tomczak

7 accepted papers

2023

Modelling Long Range Dependencies in $N$D: From Task-Specific to a General Purpose CNN

ICLR 2023poster

Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN architectures. We present the Continuous Convolutional Neural Ne…

2022

Alleviating Adversarial Attacks on Variational Autoencoders with MCMC

NeurIPS 2022accept

Variational autoencoders (VAEs) are latent variable models that can generate complex objects and provide meaningful latent representations. Moreover, they could be further used in downstream tasks such as classification. As previous work has shown, one can easily fool VAEs to produce unexpected late…

2022

CKConv: Continuous Kernel Convolution For Sequential Data

ICLR 2022poster

Conventional neural architectures for sequential data present important limitations. Recurrent neural networks suffer from exploding and vanishing gradients, small effective memory horizons, and must be trained sequentially. Convolutional neural networks cannot handle sequences of unknown size and t…

2022

FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes

ICLR 2022poster

When designing Convolutional Neural Networks (CNNs), one must select the size of the convolutional kernels before training. Recent works show CNNs benefit from different kernel sizes at different layers, but exploring all possible combinations is unfeasible in practice. A more efficient approach is…

2022

On Analyzing Generative and Denoising Capabilities of Diffusion-based Deep Generative Models

NeurIPS 2022accept

Diffusion-based Deep Generative Models (DDGMs) offer state-of-the-art performance in generative modeling. Their main strength comes from their unique setup in which a model (the backward diffusion process) is trained to reverse the forward diffusion process, which gradually adds noise to the input s…

2021

Invertible DenseNets with Concatenated LipSwish

NeurIPS 2021poster

We introduce Invertible Dense Networks (i-DenseNets), a more parameter efficient extension of Residual Flows. The method relies on an analysis of the Lipschitz continuity of the concatenation in DenseNets, where we enforce invertibility of the network by satisfying the Lipschitz constant. Furthermor…

2021

Storchastic: A Framework for General Stochastic Automatic Differentiation

NeurIPS 2021poster

Modelers use automatic differentiation (AD) of computation graphs to implement complex Deep Learning models without defining gradient computations. Stochastic AD extends AD to stochastic computation graphs with sampling steps, which arise when modelers handle the intractable expectations common in R…