← Search

Adam Kosiorek

6 accepted papers

2020

MetaFun: Meta-Learning with Iterative Functional Updates

ICML 2020poster

We develop a functional encoder-decoder approach to supervised meta-learning, where labeled data is encoded into an infinite-dimensional functional representation rather than a finite-dimensional one. Furthermore, rather than directly producing the representation, we learn a neural update rule resem…

2019

Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks

ICML 2019oral

Many machine learning tasks such as multiple instance learning, 3D shape recognition, and few-shot image classification are defined on sets of instances. Since solutions to such problems do not depend on the order of elements of the set, models used to address them should be permutation invariant. W…

2018

Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objects

NeurIPS 2018spotlight

We present Sequential Attend, Infer, Repeat (SQAIR), an interpretable deep generative model for image sequences. It can reliably discover and track objects through the sequence; it can also conditionally generate future frames, thereby simulating expected motion of objects. This is achieved by expl…

2018

Tighter Variational Bounds are Not Necessarily Better

ICML 2018oral

We provide theoretical and empirical evidence that using tighter evidence lower bounds (ELBOs) can be detrimental to the process of learning an inference network by reducing the signal-to-noise ratio of the gradient estimator. Our results call into question common implicit assumptions that tighter E…

Cited by 246SourcePDFScholar