← Search

Krzysztof J Geras

7 accepted papers

2024

Uncertainty-aware Fine-tuning of Segmentation Foundation Models

NeurIPS 2024poster

The Segment Anything Model (SAM) is a large-scale foundation model that has revolutionized segmentation methodology. Despite its impressive generalization ability, the segmentation accuracy of SAM on images with intricate structures is often unsatisfactory. Recent works have proposed lightweight fin…

2023

Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning

CVPR 2023poster

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-supervised learning (CSSL), which learns to push apart representations correspon…

2022

Characterizing and Overcoming the Greedy Nature of Learning in Multi-modal Deep Neural Networks

ICML 2022spotlight

We hypothesize that due to the greedy nature of learning in multi-modal deep neural networks, these models tend to rely on just one modality while under-fitting the other modalities. Such behavior is counter-intuitive and hurts the models’ generalization, as we observe empirically. To estimate the m…

2022

Generative multitask learning mitigates target-causing confounding

NeurIPS 2022accept

We propose generative multitask learning (GMTL), a simple and scalable approach to causal machine learning in the multitask setting. Our approach makes a minor change to the conventional multitask inference objective, and improves robustness to target shift. Since GMTL only modifies the inference ob…

Cited by 5SourcePDFScholar
2021

Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization

ICML 2021spotlight

The early phase of training a deep neural network has a dramatic effect on the local curvature of the loss function. For instance, using a small learning rate does not guarantee stable optimization because the optimization trajectory has a tendency to steer towards regions of the loss surface with i…

Cited by 80SourcePDFScholar
2018

Breast Density Classification with Deep Convolutional Neural Networks

ICASSP 2018accepted

Breast density classification is an essential part of breast cancer screening. Although a lot of prior work considered this problem as a task for learning algorithms, to our knowledge, all of them used small and not clinically realistic data both for training and evaluation of their models. In this…

Cited by 0SourceScholar
2017

Do Deep Convolutional Nets Really Need to be Deep and Convolutional?

ICLR 2017poster

Yes, they do. This paper provides the first empirical demonstration that deep convolutional models really need to be both deep and convolutional, even when trained with methods such as distillation that allow small or shallow models of high accuracy to be trained. Although previous research showed…

Cited by 299SourceScholar