← Search

Justin Bayer

10 accepted papers

2024

Exploring Under Constraints with Model-Based Actor-Critic and Safety Filters

CoRL 2024poster

Applying reinforcement learning (RL) to learn effective policies on physical robots without supervision remains challenging when it comes to tasks where safe exploration is critical. Constrained model-based RL (CMBRL) presents a promising approach to this problem. These methods are designed to learn…

Cited by 3SourceScholar
2022

PRISM: Probabilistic Real-Time Inference in Spatial World Models

CoRL 2022oral

We introduce PRISM, a method for real-time filtering in a probabilistic generative model of agent motion and visual perception. Previous approaches either lack uncertainty estimates for the map and agent state, do not run in real-time, do not have a dense scene representation or do not model agent d…

Cited by 2SourceScholar
2021

Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Models

ICLR 2021poster

Amortised inference enables scalable learning of sequential latent-variable models (LVMs) with the evidence lower bound (ELBO). In this setting, variational posteriors are often only partially conditioned. While the true posteriors depend, e.g., on the entire sequence of observations, approximate po…

Cited by 20SourcePDFScholar
2021

Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoF

ICLR 2021poster

We solve the problem of 6-DoF localisation and 3D dense reconstruction in spatial environments as approximate Bayesian inference in a deep state-space model. Our approach leverages both learning and domain knowledge from multiple-view geometry and rigid-body dynamics. This results in an expressive p…

Cited by 11SourcePDFScholar
2020

Learning Flat Latent Manifolds with VAEs

ICML 2020poster

Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact latent space. Prevalent is the use of the Euclidean metric, whic…

Cited by 53SourcePDFScholar
2019

Approximate Bayesian Inference in Spatial Environments

RSS 2019poster

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous exploration are typically adressed with specialised methods, often…

Cited by 26SourcePDFScholar
2018

Metrics for Deep Generative Models

AISTATS 2018poster

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source—the latent space—to samples from a more complex distribution represented by a dataset. While the manifold hypothesis implies…

2017

Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data

ICLR 2017poster

We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference.…

Cited by 484SourcecodeScholar
2015

Measuring fingertip forces from camera images for random finger poses

IROS 2015poster

Robust fingertip force detection from fingernail image is a critical strategy that can be applied in many areas. However, prior research fixed many variables that influence the finger color change. This paper analyzes the effect of the finger joint on the force detection in order to deal with the co…

Cited by 10SourceScholar