← Search

Pedro Hermosilla

13 accepted papers

2025

CutS3D: Cutting Semantics in 3D for 2D Unsupervised Instance Segmentation

ICCV 2025poster

Traditionally, algorithms that learn to segment object instances in 2D images have heavily relied on large amounts of human-annotated data. Only recently, novel approaches have emerged tackling this problem in an unsupervised fashion. Generally, these approaches first generate pseudo-masks and then…

Cited by 0SourcePDFScholar
2025

Masked Scene Modeling: Narrowing the Gap Between Supervised and Self-Supervised Learning in 3D Scene Understanding

CVPR 2025poster

Self-supervised learning has transformed 2D computer vision by enabling models trained on large, unannotated datasets to provide versatile off-the-shelf features that perform similarly to models trained with labels. However, in 3D scene understanding, self-supervised methods are typically only used…

2025

OpenHype: Hyperbolic Embeddings for Hierarchical Open-Vocabulary Radiance Fields

NeurIPS 2025poster

Modeling the inherent hierarchical structure of 3D objects and 3D scenes is highly desirable, as it enables a more holistic understanding of environments for autonomous agents. Accomplishing this with implicit representations, such as Neural Radiance Fields, remains an unexplored challenge. Existing…

Cited by 0SourceScholar
2025

RelationField: Relate Anything in Radiance Fields

CVPR 2025poster

Neural radiance fields are an emerging 3D scene representation and recently even been extended to learn features for scene understanding by distilling open-vocabulary features from vision-language models. However, current method primarily focus on object-centric representations, supporting object se…

2024

Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationships

CVPR 2024poster

Current approaches for 3D scene graph prediction rely on labeled datasets to train models for a fixed set of known object classes and relationship categories. We present Open3DSG an alternative approach to learn 3D scene graph prediction in an open world without requiring labeled scene graph data. W…

2024

Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Sampling

CVPR 2024poster

Traditionally training neural networks to perform semantic segmentation requires expensive human-made annotations. But more recently advances in the field of unsupervised learning have made significant progress on this issue and towards closing the gap to supervised algorithms. To achieve this seman…

Cited by 6SourcePDFScholar
2024

Weakly Supervised Virus Capsid Detection with Image-Level Annotations in Electron Microscopy Images

ICLR 2024poster

Current state-of-the-art methods for object detection rely on annotated bounding boxes of large data sets for training. However, obtaining such annotations is expensive and can require up to hundreds of hours of manual labor. This poses a challenge, especially since such annotations can only be prov…

Cited by 1SourcePDFScholar
2022

Clean Implicit 3D Structure From Noisy 2D STEM Images

CVPR 2022poster

Scanning Transmission Electron Microscopes (STEMs) acquire 2D images of a 3D sample on the scale of individual cell components. Unfortunately, these 2D images can be too noisy to be fused into a useful 3D structure and facilitating good denoisers is challenging due to the lack of clean-noisy pairs.…

Cited by 10PDFcodeScholar
2022

Gaussian Mixture Convolution Networks

ICLR 2022poster

This paper proposes a novel method for deep learning based on the analytical convolution of multidimensional Gaussian mixtures. In contrast to tensors, these do not suffer from the curse of dimensionality and allow for a compact representation, as data is only stored where details exist. Convolution…

2022

RADU: Ray-Aligned Depth Update Convolutions for ToF Data Denoising

CVPR 2022poster

Time-of-Flight (ToF) cameras are subject to high levels of noise and distortions due to Multi-Path-Interference (MPI). While recent research showed that 2D neural networks are able to outperform previous traditional State-of-the-Art (SOTA) methods on correcting ToF-Data, little research on learning-…

Cited by 14PDFcodeScholar
2022

Variance-Aware Weight Initialization for Point Convolutional Neural Networks

ECCV 2022poster

"Appropriate weight initialization has been of key importance to successfully train neural networks. Recently, batch normalization has diminished the role of weight initialization by simply normalizing each layer based on batch statistics. Unfortunately, batch normalization has several drawbacks whe…

Cited by 0SourcePDFScholar
2021

Intrinsic-Extrinsic Convolution and Pooling for Learning on 3D Protein Structures

ICLR 2021poster

Proteins perform a large variety of functions in living organisms and thus play a key role in biology. However, commonly used algorithms in protein representation learning were not specifically designed for protein data, and are therefore not able to capture all relevant structural levels of a prote…

2019

Total Denoising: Unsupervised Learning of 3D Point Cloud Cleaning

ICCV 2019poster

We show that denoising of 3D point clouds can be learned unsupervised, directly from noisy 3D point cloud data only. This is achieved by extending recent ideas from learning of unsupervised image denoisers to unstructured 3D point clouds. Unsupervised image denoisers operate under the assumption tha…

Cited by 175PDFcodeScholar