Federated Hybrid-Supervised Learning for Universal Medical Image Segmentation

Abstract

Federated Learning (FL) is an advanced technology that tackles the challenge of blocked data arising from privacy concerns, enabling the training of deep learning models without the need for data sharing. However, FL faces difficulties with heterogeneous data and limited annotations in medical image segmentation. Motivated by this discovery, this study proposes a novel hybrid-supervised federated learning method (FedSLAG) that explores various types of annotations in medical imaging. To focus more on weakly-supervised and unsupervised scenarios within hybrid-supervised learning, a federated Gaussian enhancement module was proposed for heterogeneous sparse annotations (points and scribbles). The feature extraction module combines the features of multiple weakly-supervised clients and establishes the correlation of similar pixels, thus making up for the deficiency of scarce annotations and the insufficient feature extraction capability of a single machine. Then, a two-stage broadcast mechanism based on supervision sparsity was proposed to alleviate optimization deviation in local models. Experiments on breast tumor and skin lesion segmentation tasks demonstrate significant efficiency gains as well as highly competitive segmentation accuracy in many hybrid-supervised situations. Our codes are available at: https://github.com/TrivenDev/FedSLAG.