← Search

Benjamin Eckart

7 accepted papers

2024

Compositional Text-to-Image Generation with Dense Blob Representations

ICML 2024poster

Existing text-to-image models struggle to follow complex text prompts, raising the need for extra grounding inputs for better controllability. In this work, we propose to decompose a scene into visual primitives - denoted as dense blob representations - that contain fine-grained details of the scene…

Cited by 16SourcePDFScholar
2024

Learning to Jointly Understand Visual and Tactile Signals

ICLR 2024poster

Modeling and analyzing object and shape has been well studied in the past. However, manipulation of these complex tools and articulated objects remains difficult for autonomous agents. Our human hands, however, are dexterous and adaptive. We can easily adapt a manipulation skill on one object to all…

Cited by 6SourcePDFScholar
2022

Neural Interferometry: Image Reconstruction from Astronomical Interferometers Using Transformer-Conditioned Neural Fields

AAAI 2022technical

Astronomical interferometry enables a collection of telescopes to achieve angular resolutions comparable to that of a single, much larger telescope. This is achieved by combining simultaneous observations from pairs of telescopes such that the signal is mathematically equivalent to sampling the Four…

2021

Self-Supervised Learning on 3D Point Clouds by Learning Discrete Generative Models

CVPR 2021poster

While recent pre-training tasks on 2D images have proven very successful for transfer learning, pre-training for 3D data remains challenging. In this work, we introduce a general method for 3D self-supervised representation learning that 1) remains agnostic to the underlying neural network architect…

Cited by 74PDFScholar
2020

DeepGMR: Learning Latent Gaussian Mixture Models for Registration

ECCV 2020poster

Point cloud registration is a fundamental problem in 3D computer vision, graphics and robotics. For the last few decades, existing registration algorithms have struggled in situations with large transformations, noise, and time constraints. In this paper, we introduce Deep Gaussian Mixture Registrat…

2016

Accelerated Generative Models for 3D Point Cloud Data

CVPR 2016spotlight

Finding meaningful, structured representations of 3D point cloud data (PCD) has become a core task for spatial perception applications. In this paper we introduce a method for constructing compact generative representations of PCD at multiple levels of detail. As opposed to deterministic struct…

Cited by 84PDFScholar