← Search

Jinan Sun

8 accepted papers

2024

LION: Implicit Vision Prompt Tuning

AAAI 2024technical

Despite recent promising performances across a range of vision tasks, vision Transformers still have an issue of high computational costs. Recently, vision prompt learning has provided an economical solution to this problem without fine-tuning the whole large-scale model. However, the efficiency an…

Cited by 26SourcePDFScholar
2023

Exploiting Pseudo Image Captions for Multimodal Summarization

ACL 2023findings

Multimodal summarization with multimodal output (MSMO) faces a challenging semantic gap between visual and textual modalities due to the lack of reference images for training. Our pilot investigation indicates that image captions, which naturally connect texts and images, can significantly benefit M…

2023

IDEA: An Invariant Perspective for Efficient Domain Adaptive Image Retrieval

NeurIPS 2023poster

In this paper, we investigate the problem of unsupervised domain adaptive hashing, which leverage knowledge from a label-rich source domain to expedite learning to hash on a label-scarce target domain. Although numerous existing approaches attempt to incorporate transfer learning techniques into dee…

Cited by 6SourcePDFScholar
2023

Parameter-efficient Tuning of Large-scale Multimodal Foundation Model

NeurIPS 2023poster

Driven by the progress of large-scale pre-training, parameter-efficient transfer learning has gained immense popularity across different subfields of Artificial Intelligence. The core is to adapt the model to downstream tasks with only a small set of parameters. Recently, researchers have leveraged…

2023

Prototypical Mixing and Retrieval-Based Refinement for Label Noise-Resistant Image Retrieval

ICCV 2023poster

Label noise is pervasive in real-world applications, which influences the optimization of neural network models. This paper investigates a realistic but understudied problem of image retrieval under label noise, which could lead to severe overfitting or memorization of noisy samples during optimizat…

Cited by 5PDFcodeScholar
2022

Frequency-Aware Contrastive Learning for Neural Machine Translation

AAAI 2022technical

Low-frequency word prediction remains a challenge in modern neural machine translation (NMT) systems. Recent adaptive training methods promote the output of infrequent words by emphasizing their weights in the overall training objectives. Despite the improved recall of low-frequency words, their pre…

2021

Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation

ACL 2021long

This paper proposes a sophisticated neural architecture to incorporate bilingual dictionaries into Neural Machine Translation (NMT) models. By introducing three novel components: Pointer, Disambiguator, and Copier, our method PDC achieves the following merits inherently compared with previous effort…

2020

Stacking Networks Dynamically for Image Restoration Based on the Plug-and-Play Framework

ECCV 2020poster

Recently, stacked networks show powerful performance in Image Restoration, such as challenging motion deblurring problems. However, the number of stacking levels is a hyper-parameter fine-tuned manually, making the stacking levels static during training without theoretical explanations for optimal s…

Cited by 12SourcePDFScholar