← Search

Holger R. Roth

9 accepted papers

2024

FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language Models

ICML 2024poster

Pre-trained language models (PLM) have revolutionized the NLP landscape, achieving stellar performances across diverse tasks. These models, while benefiting from vast training data, often require fine-tuning on specific data to cater to distinct downstream tasks. However, this data adaptation proces…

Cited by 34SourcePDFScholar
2024

Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?

NeurIPS 2024poster

How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks…

2023

Communication-Efficient Vertical Federated Learning with Limited Overlapping Samples

ICCV 2023poster

Federated learning is a popular collaborative learning approach that enables clients to train a global model without sharing their local data. Vertical federated learning (VFL) deals with scenarios in which the data on clients have different feature spaces but share some overlapping samples. Existin…

Cited by 18PDFScholar
2023

Fair Federated Medical Image Segmentation via Client Contribution Estimation

CVPR 2023poster

How to ensure fairness is an important topic in federated learning (FL). Recent studies have investigated how to reward clients based on their contribution (collaboration fairness), and how to achieve uniformity of performance across clients (performance fairness). Despite achieving progress on eith…

Cited by 63SourcePDFScholar
2022

Auto-FedRL: Federated Hyperparameter Optimization for Multi-Institutional Medical Image Segmentation

ECCV 2022poster

"Federated learning (FL) is a distributed machine learning technique that enables collaborative model training while avoiding explicit data sharing. The inherent privacy-preserving property of FL algorithms makes them especially attractive to the medical field. However, in case of heterogeneous clie…

2022

Closing the Generalization Gap of Cross-Silo Federated Medical Image Segmentation

CVPR 2022poster

Cross-silo federated learning (FL) has attracted much attention in medical imaging analysis with deep learning in recent years as it can resolve the critical issues of insufficient data, data privacy, and training efficiency. However, there can be a generalization gap between the model trained from…

Cited by 84PDFcodeScholar
2022

GradViT: Gradient Inversion of Vision Transformers

CVPR 2022poster

In this work we demonstrate the vulnerability of vision transformers (ViTs) to gradient-based inversion attacks. During this attack, the original data batch is reconstructed given model weights and the corresponding gradients. We introduce a method, named GradViT, that optimizes random noise into na…

Cited by 90PDFcodeScholar
2022

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis

CVPR 2022poster

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised learning framework with tailored proxy tasks for medical image a…

Cited by 796PDFcodeScholar
2021

T-AutoML: Automated Machine Learning for Lesion Segmentation Using Transformers in 3D Medical Imaging

ICCV 2021poster

Lesion segmentation in medical imaging has been an important topic in clinical research. Researchers have proposed various detection and segmentation algorithms to address this task. Recently, deep learning-based approaches have significantly improved the performance over conventional methods. Howev…

Cited by 36PDFScholar