← Search

Huimin Zeng

23 accepted papers

2026

FASA: FREQUENCY-AWARE SPARSE ATTENTION

ICLR 2026poster

The deployment of Large Language Models (LLMs) faces a critical bottleneck when handling lengthy inputs: the prohibitive memory footprint of the Key Value (KV) cache. To address this bottleneck, the token pruning paradigm leverages attention sparsity to selectively retain a small, critical subset of…

Cited by 0SourceScholar
2026

Ref-Adv: Exploring MLLM Visual Reasoning in Referring Expression Tasks

ICLR 2026poster

Referring Expression Comprehension (REC) links language to region level visual perception. Standard benchmarks (RefCOCO, RefCOCO+, RefCOCOg) have progressed rapidly with multimodal LLMs but remain weak tests of visual rea- soning and grounding: (i) many expressions are very short, leaving little rea…

Cited by 0SourceScholar
2025

A Non-Contrastive Learning Framework for Sequential Recommendation with Preference-Preserving Profile Generation

ICLR 2025poster

Contrastive Learning (CL) proves to be effective for learning generalizable user representations in Sequential Recommendation (SR), but it suffers from high computational costs due to its reliance on negative samples. To overcome this limitation, we propose the first Non-Contrastive Learning (NCL) f…

Cited by 0SourcePDFScholar
2025

Hybrid Latent Reasoning via Reinforcement Learning

NeurIPS 2025poster

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit from more informative features rather than sampling a discrete…

Cited by 0SourcecodeScholar
2024

Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation

NAACL 2024long

The proliferation of online misinformation has posed significant threats to public interest. While numerous online users actively participate in the combat against misinformation, many of such responses can be characterized by the lack of politeness and supporting facts. As a solution, text generati…

Cited by 27SourcePDFScholar
2024

Fair Federated Learning with Biased Vision-Language Models

ACL 2024findings

Existing literature that integrates CLIP into federated learning (FL) largely ignores the inherent group unfairness within CLIP and its ethical implications on FL applications. Furthermore, such CLIP bias may be amplified in FL, due to the unique issue of data heterogeneity across clients. However,…

Cited by 4SourcePDFScholar
2024

MarineInst: A Foundation Model for Marine Image Analysis with Instance Visual Description

ECCV 2024oral

"Recent foundation models trained on a tremendous scale of data have shown great promise in a wide range of computer vision tasks and application domains. However, less attention has been paid to the marine realms, which in contrast cover the majority of our blue planet. The scarcity of labeled data…

Cited by 8SourcePDFScholar
2024

Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments

ACL 2024long

The rapid propagation of misinformation poses substantial risks to public interest. To combat misinformation, large language models (LLMs) are adapted to automatically verify claim credibility. Nevertheless, existing methods heavily rely on the embedded knowledge within LLMs and / or black-box APIs…

2024

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

EMNLP 2024finding

Despite recent advancements in language and vision modeling, integrating rich multimodal knowledge into recommender systems continues to pose significant challenges. This is primarily due to the need for efficient recommendation, which requires adaptive and interactive responses. In this study, we f…

2023

A Crowd-AI Collaborative Duo Relational Graph Learning Framework towards Social Impact Aware Photo Classification

AAAI 2023technical

In artificial intelligence (AI), negative social impact (NSI) represents the negative effect on the society as a result of mistakes conducted by AI agents. While the photo classification problem has been widely studied in the AI community, the NSI made by photo misclassification is largely ignored d…

Cited by 0SourcePDFScholar
2023

MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning

ACL 2023long

With emerging topics (e.g., COVID-19) on social media as a source for the spreading misinformation, overcoming the distributional shifts between the original training domain (i.e., source domain) and such target domains remains a non-trivial task for misinformation detection. This presents an elusiv…

2023

On Adversarial Robustness of Demographic Fairness in Face Attribute Recognition

IJCAI 2023poster

Demographic fairness has become a critical objective when developing modern visual models for identity-sensitive applications, such as face attribute recognition (FAR). While great efforts have been made to improve the fairness of the models, the investigation on the adversarial robustness of the fa…

Cited by 5SourcePDFScholar
2023

On Optimizing Model Generality in AI-based Disaster Damage Assessment: A Subjective Logic-driven Crowd-AI Hybrid Learning Approach

IJCAI 2023poster

This paper focuses on the AI-based damage assessment (ADA) applications that leverage state-of-the-art AI techniques to automatically assess the disaster damage severity using online social media imagery data, which aligns well with the ''disaster risk reduction'' target under United Nations' Sustai…

Cited by 3SourcePDFScholar
2023

Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning

ACL 2023long

With emerging online topics as a source for numerous new events, detecting unseen / rare event types presents an elusive challenge for existing event detection methods, where only limited data access is provided for training. To address the data scarcity problem in event detection, we propose MetaEv…

2022

Crowd, Expert & AI: A Human-AI Interactive Approach Towards Natural Language Explanation Based COVID-19 Misinformation Detection

IJCAI 2022poster

In this paper, we study an explainable COVID-19 misinformation detection problem where the goal is to accurately identify COVID-19 misleading posts on social media and explain the posts with natural language explanations (NLEs). Our problem is motivated by the limitations of current explainable misi…

Cited by 19SourcePDFScholar
2022

Domain Adaptation for Question Answering via Question Classification

COLING 2022main

Question answering (QA) has demonstrated impressive progress in answering questions from customized domains. Nevertheless, domain adaptation remains one of the most elusive challenges for QA systems, especially when QA systems are trained in a source domain but deployed in a different target domain.…

2022

On Attacking Out-Domain Uncertainty Estimation in Deep Neural Networks

IJCAI 2022poster

In many applications with real-world consequences, it is crucial to develop reliable uncertainty estimation for the predictions made by the AI decision systems. Targeting at the goal of estimating uncertainty, various deep neural network (DNN) based uncertainty estimation algorithms have been propos…

Cited by 13SourcePDFScholar
2022

QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation

EMNLP 2022main

Question answering (QA) has recently shown impressive results for answering questions from customized domains. Yet, a common challenge is to adapt QA models to an unseen target domain. In this paper, we propose a novel self-supervised framework called QADA for QA domain adaptation. QADA introduces a…

2021

Are Adversarial Examples Created Equal? A Learnable Weighted Minimax Risk for Robustness under Non-uniform Attacks

AAAI 2021technical

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples according to the underlying data distribution, which is appa…

Cited by 28SourcePDFScholar