← Search

Ziyue Xu

9 accepted papers

2025

VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledge

CVPR 2025highlight

Generalist vision language models (VLMs) have made significant strides in computer vision, but they fall short in specialized fields like healthcare, where expert knowledge is essential. Current large multimodal models like Gemini and GPT-4o are insufficient for medical tasks due to their reliance o…

Cited by 5SourcePDFScholar
2025

VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imaging

CVPR 2025poster

Foundation models for interactive segmentation in 2D natural images and videos have sparked significant interest in building 3D foundation models for medical imaging. However, the domain gaps and clinical use cases for 3D medical imaging require a dedicated model that diverges from existing 2D solut…

2024

FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language Models

ICML 2024poster

Pre-trained language models (PLM) have revolutionized the NLP landscape, achieving stellar performances across diverse tasks. These models, while benefiting from vast training data, often require fine-tuning on specific data to cater to distinct downstream tasks. However, this data adaptation proces…

Cited by 34SourcePDFScholar
2023

Communication-Efficient Vertical Federated Learning with Limited Overlapping Samples

ICCV 2023poster

Federated learning is a popular collaborative learning approach that enables clients to train a global model without sharing their local data. Vertical federated learning (VFL) deals with scenarios in which the data on clients have different feature spaces but share some overlapping samples. Existin…

Cited by 18PDFScholar
2023

Fair Federated Medical Image Segmentation via Client Contribution Estimation

CVPR 2023poster

How to ensure fairness is an important topic in federated learning (FL). Recent studies have investigated how to reward clients based on their contribution (collaboration fairness), and how to achieve uniformity of performance across clients (performance fairness). Despite achieving progress on eith…

Cited by 63SourcePDFScholar
2022

Auto-FedRL: Federated Hyperparameter Optimization for Multi-Institutional Medical Image Segmentation

ECCV 2022poster

"Federated learning (FL) is a distributed machine learning technique that enables collaborative model training while avoiding explicit data sharing. The inherent privacy-preserving property of FL algorithms makes them especially attractive to the medical field. However, in case of heterogeneous clie…

2022

Closing the Generalization Gap of Cross-Silo Federated Medical Image Segmentation

CVPR 2022poster

Cross-silo federated learning (FL) has attracted much attention in medical imaging analysis with deep learning in recent years as it can resolve the critical issues of insufficient data, data privacy, and training efficiency. However, there can be a generalization gap between the model trained from…

Cited by 84PDFcodeScholar
2021

T-AutoML: Automated Machine Learning for Lesion Segmentation Using Transformers in 3D Medical Imaging

ICCV 2021poster

Lesion segmentation in medical imaging has been an important topic in clinical research. Researchers have proposed various detection and segmentation algorithms to address this task. Recently, deep learning-based approaches have significantly improved the performance over conventional methods. Howev…

Cited by 36PDFScholar
2020

ScribbleBox: Interactive Annotation Framework for Video Object Segmentation

ECCV 2020poster

Manually labeling video datasets for segmentation tasks is extremely time consuming. We introduce ScribbleBox, an interactive framework for annotating object instances with masks in videos with a significant boost in efficiency. In particular, we split annotation into two steps: annotating objects w…

Cited by 23SourcePDFScholar