← Search

Nutan Chen

8 accepted papers

2025

LIMT: Language-Informed Multi-Task Visual World Models

ICRA 2025

Most recent successes in robot reinforcement learning involve learning a specialized single-task agent. However, robots capable of performing multiple tasks can be much more valuable in real-world applications. Multi-task reinforcement learning can be very challenging due to the increased sample com

Cited by 5SourceScholar
2025

M-HOF-Opt: Multi-Objective Hierarchical Output Feedback Optimization via Multiplier Induced Loss Landscape Scheduling

AISTATS 2025poster

A probabilistic graphical model is proposed, modeling the joint model parameter and multiplier evolution, with a hypervolume based likelihood, promoting multi-objective descent in structural risk minimization. We address multi-objective model parameter optimization via a surrogate single objective…

Cited by 0SourcecodeScholar
2020

Learning Flat Latent Manifolds with VAEs

ICML 2020poster

Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact latent space. Prevalent is the use of the Euclidean metric, whic…

Cited by 53SourcePDFScholar
2019

Learning Hierarchical Priors in VAEs

NeurIPS 2019spotlight

We propose to learn a hierarchical prior in the context of variational autoencoders to avoid the over-regularisation resulting from a standard normal prior distribution. To incentivise an informative latent representation of the data, we formulate the learning problem as a constrained optimisation p…

Cited by 120SourcePDFScholar
2018

Active Learning based on Data Uncertainty and Model Sensitivity

IROS 2018poster

Robots can rapidly acquire new skills from demonstrations. However, during generalisation of skills or transitioning across fundamentally different skills, it is unclear whether the robot has the necessary knowledge to perform the task. Failing to detect missing information often leads to abrupt mov…

Cited by 18SourceScholar
2018

Metrics for Deep Generative Models

AISTATS 2018poster

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source—the latent space—to samples from a more complex distribution represented by a dataset. While the manifold hypothesis implies…

2016

Stable reinforcement learning with autoencoders for tactile and visual data

IROS 2016poster

For many tasks, tactile or visual feedback is helpful or even crucial. However, designing controllers that take such high-dimensional feedback into account is non-trivial. Therefore, robots should be able to learn tactile skills through trial and error by using reinforcement learning algorithms. The…

Cited by 209SourceScholar
2015

Measuring fingertip forces from camera images for random finger poses

IROS 2015poster

Robust fingertip force detection from fingernail image is a critical strategy that can be applied in many areas. However, prior research fixed many variables that influence the finger color change. This paper analyzes the effect of the finger joint on the force detection in order to deal with the co…

Cited by 10SourceScholar