← Search

Zhiyue Liu

5 accepted papers

2025

Bridging Semantic and Modality Gaps in Zero-Shot Captioning via Retrieval from Synthetic Data

EMNLP 2025

Zero-shot image captioning, which aims to generate image descriptions without relying on annotated data, has recently attracted increasing research interest. Pre-trained text-to-image generation models enable the creation of synthetic pairs solely from text data, while existing methods fall short in

2025

Task-Specific Information Decomposition for End-to-End Dense Video Captioning

ACL 2025long

Dense video captioning aims to localize events within input videos and generate concise descriptive texts for each event. Advanced end-to-end methods require both tasks to share the same intermediate features that serve as event queries, thereby enabling the mutual promotion of two tasks. However, r…

2024

Improving Cross-Modal Alignment with Synthetic Pairs for Text-Only Image Captioning

AAAI 2024technical

Although image captioning models have made significant advancements in recent years, the majority of them heavily depend on high-quality datasets containing paired images and texts which are costly to acquire. Previous works leverage the CLIP's cross-modal association ability for image captioning, r…

Cited by 11SourcePDFScholar
2023

RMLM: A Flexible Defense Framework for Proactively Mitigating Word-level Adversarial Attacks

ACL 2023long

Adversarial attacks on deep neural networks keep raising security concerns in natural language processing research. Existing defenses focus on improving the robustness of the victim model in the training stage. However, they often neglect to proactively mitigate adversarial attacks during inference.…

2022

UECA-Prompt: Universal Prompt for Emotion Cause Analysis

COLING 2022main

Emotion cause analysis (ECA) aims to extract emotion clauses and find the corresponding cause of the emotion. Existing methods adopt fine-tuning paradigm to solve certain types of ECA tasks. These task-specific methods have a deficiency of universality. And the relations among multiple objectives in…