← Search

Ke Zhu

17 accepted papers

2026

Enhancing Descriptive Captions with Visual Attributes for Multimodal Perception

CVPR 2026

Training Large Multimodality Models (LMMs) relies on descriptive image caption that connects image and language. Existing methods for generating such captions often rely on distilling the captions from pretrained LMMs, constructing them from publicly available internet images, or even generating the

Cited by 0SourcecodeScholar
2026

Privacy-Protected Causal Survival Analysis Under Distribution Shift

ICLR 2026poster

Causal inference across multiple data sources can improve the generalizability and reproducibility of scientific findings. However, for time-to-event outcomes, data integration methods remain underdeveloped, especially when populations are heterogeneous and privacy constraints prevent direct data po…

Cited by 0SourceScholar
2025

Continual SFT Matches Multimodal RLHF with Negative Supervision

CVPR 2025poster

Multimodal RLHF usually happens after supervised finetuning (SFT) stage to continually improve vision-language models' (VLMs) comprehension. Conventional wisdom holds its superiority over continual SFT during this preference alignment stage. In this paper, we observe that the inherent value of multi…

2025

Doubly Robust Fusion of Many Treatments for Policy Learning

ICML 2025poster

Individualized treatment rules/recommendations (ITRs) aim to improve patient outcomes by tailoring treatments to the characteristics of each individual. However, in high-dimensional treatment settings, existing methods face significant challenges due to data sparsity within treatment groups and high…

Cited by 0SourcePDFScholar
2025

Enhancing Statistical Validity and Power in Hybrid Controlled Trials: A Randomization Inference Approach with Conformal Selective Borrowing

ICML 2025poster

External controls from historical trials or observational data can augment randomized controlled trials when large-scale randomization is impractical or unethical, such as in drug evaluation for rare diseases. However, non-randomized external controls can introduce biases, and existing Bayesian and…

2024

DiffuLT: Diffusion for Long-tail Recognition Without External Knowledge

NeurIPS 2024poster

This paper introduces a novel pipeline for long-tail (LT) recognition that diverges from conventional strategies. Instead, it leverages the long-tailed dataset itself to generate a balanced proxy dataset without utilizing external data or model. We deploy a diffusion model trained from scratch on on…

Cited by 0SourcePDFScholar
2024

Rectify the Regression Bias in Long-Tailed Object Detection

ECCV 2024poster

"Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the regression branch. This paper shows that the regression bias ex…

Cited by 4SourcePDFScholar