← Search

Pau de Jorge

5 accepted papers

2025

DUNE: Distilling a Universal Encoder from Heterogeneous 2D and 3D Teachers

CVPR 2025poster

Recent multi-teacher distillation methods have unified the encoders of multiple foundation models into a single encoder, achieving competitive performance on core vision tasks like classification, segmentation, and depth estimation. This led us to ask: Could similar success be achieved when the pool…

Cited by 0SourcePDFScholar
2023

Reliability in Semantic Segmentation: Are We on the Right Track?

CVPR 2023poster

Motivated by the increasing popularity of transformers in computer vision, in recent times there has been a rapid development of novel architectures. While in-domain performance follows a constant, upward trend, properties like robustness or uncertainty estimation are less explored -leaving doubts a…

2022

Make Some Noise: Reliable and Efficient Single-Step Adversarial Training

NeurIPS 2022accept

Recently, Wong et al. (2020) showed that adversarial training with single-step FGSM leads to a characteristic failure mode named catastrophic overfitting (CO), in which a model becomes suddenly vulnerable to multi-step attacks. Experimentally they showed that simply adding a random perturbation prio…

2022

On the Road to Online Adaptation for Semantic Image Segmentation

CVPR 2022poster

We propose a new problem formulation and a corresponding evaluation framework to advance research on unsupervised domain adaptation for semantic image segmentation. The overall goal is fostering the development of adaptive learning systems that will continuously learn, without supervision, in ever-c…

Cited by 35PDFcodeScholar
2021

Progressive Skeletonization: Trimming more fat from a network at initialization

ICLR 2021poster

Recent studies have shown that skeletonization (pruning parameters) of networks at initialization provides all the practical benefits of sparsity both at inference and training time, while only marginally degrading their performance. However, we observe that beyond a certain level of sparsity (appro…