← Search

Jingyi Xie

7 accepted papers

2026

IF-VidCap: Can Video Caption Models Follow Instructions?

ICLR 2026poster

Although Multimodal Large Language Models (MLLMs) have demonstrated proficiency in video captioning, practical applications require captions that follow specific user instructions rather than generating exhaustive, unconstrained descriptions. Current benchmarks, however, primarily assess descriptiv…

Cited by 0SourcecodeScholar
2025

AdaDARE-gamma: Balancing Stability and Plasticity in Multi-modal LLMs through Efficient Adaptation

CVPR 2025poster

Adapting Multi-modal Large Language Models (MLLMs) to target tasks often suffers from catastrophic forgetting, where acquiring new task-specific knowledge compromises performance on pre-trained tasks. In this paper, we introduce AdaDARE-\gamma, an efficient approach that alleviates catastrophic forg…

Cited by 0SourcePDFScholar
2025

Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizable

NeurIPS 2025spotlight

The rapid increase in AI-generated images (AIGIs) underscores the need for detection methods. Existing detectors are often trained on biased datasets, leading to overfitting on spurious correlations between non-causal image attributes and real/synthetic labels. While these biased features enhance p…

Cited by 0SourcecodeScholar
2024

Natural Language-centered Inference Network for Multi-modal Fake News Detection

IJCAI 2024poster

The proliferation of fake news with image and text in the internet has triggered widespread concern. Existing research has made important contributions in cross-modal information interaction and fusion, but fails to fundamentally address the modality gap among news image, text, and news-related exte…

Cited by 4SourcePDFScholar
2023

Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality

NeurIPS 2023spotlight

Prompt-based continual learning is an emerging direction in leveraging pre-trained knowledge for downstream continual learning, and has almost reached the performance pinnacle under supervised pre-training. However, our empirical research reveals that the current strategies fall short of their full…

2020

SegFix: Model-Agnostic Boundary Refinement for Segmentation

ECCV 2020poster

We present a model-agnostic post-processing scheme to improve the boundary quality for the segmentation result that is generated by any existing segmentation model. Motivated by the empirical observation that the label predictions of interior pixels are more reliable, we propose to replace the origi…

2019

ABD-Net: Attentive but Diverse Person Re-Identification

ICCV 2019poster

Attention mechanisms have been found effective for person re-identification (Re-ID). However, the learned "attentive" features are often not naturally uncorrelated or "diverse", which compromises the retrieval performance based on the Euclidean distance. We advocate the complementary powers of atten…

Cited by 672PDFcodeScholar