← Search

Jianpeng Zhang

11 accepted papers

2026

Disease-Centric Vision-Language Pretraining with Hybrid Visual Encoding for 3D Computed Tomography

ICML 2026poster

Vision–language pre-training (VLP) holds great promise for general-purpose medical AI by leveraging radiology reports as rich textual supervision, yet existing methods struggle with 3D CT imaging due to inefficient visual backbones and coarse semantic alignment. To address these issues, we propose a…

Cited by 0SourceScholar
2025

Boosting Vision Semantic Density with Anatomy Normality Modeling for Medical Vision-language Pre-training

ICCV 2025poster

Vision-language pre-training (VLP) has great potential for developing multifunctional and general medical diagnostic capabilities. However, aligning medical images with a low signal-to-noise ratio (SNR) to reports with a high SNR presents a semantic density gap, leading to visual alignment bias. In…

2025

Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understanding

ICLR 2025spotlight

Artificial intelligence (AI) shows great potential in assisting radiologists to improve the efficiency and accuracy of medical image interpretation and diagnosis. However, a versatile AI model requires large-scale data and comprehensive annotations, which are often impractical in medical settings. R…

2024

Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models

CVPR 2024poster

Radiologists highly desire fully automated versatile AI for medical imaging interpretation. However the lack of extensively annotated large-scale multi-disease datasets has hindered the achievement of this goal. In this paper we explore the feasibility of leveraging language as a naturally high-qual…

Cited by 5SourcePDFScholar
2024

Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning

CVPR 2024highlight

Self-supervised learning (SSL) is an efficient pre-training method for medical image analysis. However current research is mostly confined to certain modalities consuming considerable time and resources without achieving universality across different modalities. A straightforward solution is combini…

2024

Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration

CVPR 2024highlight

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image registration algorithms rely on statistical-based similarity measures o…

Cited by 12SourcePDFScholar
2024

Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?

NeurIPS 2024poster

How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks…

2023

CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scans

ICCV 2023poster

Human readers or radiologists routinely perform full-body multi-organ multi-disease detection and diagnosis in clinical practice, while most medical AI systems are built to focus on single organs with a narrow list of a few diseases. This might severely limit AI's clinical adoption. A certain number…

Cited by 12PDFScholar
2022

Uncertainty-Aware Multi-modal Learning via Cross-Modal Random Network Prediction

ECCV 2022poster

"Multi-modal learning focuses on training models by equally combining multiple input data modalities during the prediction process. However, this equal combination can be detrimental to the prediction accuracy because different modalities are usually accompanied by varying levels of uncertainty. Usi…

Cited by 24SourcePDFScholar
2022

UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barrier

ECCV 2022poster

"Self-supervised learning (SSL) opens up huge opportunities for medical image analysis that is well known for its lack of annotations. However, aggregating massive (unlabeled) 3D medical images like computerized tomography (CT) remains challenging due to its high imaging cost and privacy restriction…

2021

DoDNet: Learning To Segment Multi-Organ and Tumors From Multiple Partially Labeled Datasets

CVPR 2021poster

Due to the intensive cost of labor and expertise in annotating 3D medical images at a voxel level, most benchmark datasets are equipped with the annotations of only one type of organs and/or tumors, resulting in the so-called partially labeling issue. To address this issue, we propose a dynamic on-d…

Cited by 208PDFScholar