← Search

Jianfeng He

18 accepted papers

2025

Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluation

NAACL 2025long

Faithfulness evaluators based on Large Language Models (LLMs) are often fooled by the fluency of the text and struggle with identifying errors in the summaries, usually leading to high false negative rate. We propose an approach to summary faithfulness evaluation in which multiple LLM-based agents a…

2025

MDSEval: A Meta-Evaluation Benchmark for Multimodal Dialogue Summarization

EMNLP 2025

Multimodal Dialogue Summarization (MDS) is a critical task with wide-ranging applications. To support the development of effective MDS models, robust automatic evaluation methods are essential for reducing both cost and human effort. However, such methods require a strong meta-evaluation benchmark g

Cited by 0SourcePDFScholar
2024

AMA-LSTM: Pioneering Robust and Fair Financial Audio Analysis for Stock Volatility Prediction

NAACL 2024industry

Stock volatility prediction is an important task in the financial industry. Recent multimodal methods have shown advanced results by combining text and audio information, such as earnings calls. However, these multimodal methods have faced two drawbacks. First, they often fail to yield reliable mode…

2024

Can LLM Find the Green Circle? Investigation and Human-Guided Tool Manipulation for Compositional Generalization

ICASSP 2024accepted

The meaning of complex phrases in natural language is composed of their individual components. The task of compositional generalization evaluates a model’s ability to understand new combinations of components. Previous studies trained smaller, task-specific models, which exhibited poor generalizatio…

Cited by 0SourceScholar
2024

Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization?

EMNLP 2024main

Text summarization, a key natural language generation (NLG) task, is vital in various domains. However, the high cost of inaccurate summaries in risk-critical applications, particularly those involving human-in-the-loop decision-making, raises concerns about the reliability of uncertainty estimation…

2024

Don’t Go To Extremes: Revealing the Excessive Sensitivity and Calibration Limitations of LLMs in Implicit Hate Speech Detection

ACL 2024long

The fairness and trustworthiness of Large Language Models (LLMs) are receiving increasing attention. Implicit hate speech, which employs indirect language to convey hateful intentions, occupies a significant portion of practice. However, the extent to which LLMs effectively address this issue remain…

Cited by 20SourcePDFScholar
2024

InternalInspector I2: Robust Confidence Estimation in LLMs through Internal States

EMNLP 2024finding

Despite their vast capabilities, Large Language Models (LLMs) often struggle with generating reliable outputs, frequently producing high-confidence inaccuracies known as hallucinations. Addressing this challenge, our research introduces InternalInspector, a novel framework designed to enhance confid…

Cited by 2SourcePDFScholar
2024

Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection

NAACL 2024long

Semi-supervised dialogue summarization (SSDS) leverages model-generated summaries to reduce reliance on human-labeled data and improve the performance of summarization models. While addressing label noise, previous works on semi-supervised learning primarily focus on natural language understanding t…

2024

Uncertainty Estimation on Sequential Labeling via Uncertainty Transmission

NAACL 2024findings

Sequential labeling is a task predicting labels for each token in a sequence, such as Named Entity Recognition (NER). NER tasks aim to extract entities and predict their labels given a text, which is important in information extraction. Although previous works have shown great progress in improving…

2023

D2Former: Jointly Learning Hierarchical Detectors and Contextual Descriptors via Agent-Based Transformers

CVPR 2023highlight

Establishing pixel-level matches between image pairs is vital for a variety of computer vision applications. However, achieving robust image matching remains challenging because CNN extracted descriptors usually lack discriminative ability in texture-less regions and keypoint detectors are only good…

Cited by 10SourcePDFScholar
2023

Foreground-Background Distribution Modeling Transformer for Visual Object Tracking

ICCV 2023poster

Visual object tracking is a fundamental research topic with a broad range of applications. Benefiting from the rapid development of Transformer, pure Transformer trackers have achieved great progress. However, the feature learning of these Transformer-based trackers is easily disturbed by complex ba…

Cited by 38PDFScholar
2023

Query Refinement Transformer for 3D Instance Segmentation

ICCV 2023poster

3D instance segmentation aims to predict a set of object instances in a scene and represent them as binary foreground masks with corresponding semantic labels. However, object instances are diverse in shape and category,and point clouds are usually sparse, unordered, and irregular, which leads to a…

Cited by 32PDFScholar
2023

SE-ORNet: Self-Ensembling Orientation-Aware Network for Unsupervised Point Cloud Shape Correspondence

CVPR 2023poster

Unsupervised point cloud shape correspondence aims to obtain dense point-to-point correspondences between point clouds without manually annotated pairs. However, humans and some animals have bilateral symmetry and various orientations, which leads to severe mispredictions of symmetrical parts. Besid…

2023

TART: Improved Few-shot Text Classification Using Task-Adaptive Reference Transformation

ACL 2023long

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieve state-of-the-art performance. However, the performance of existing approaches heavily depends on the inter-class variance of the support set. As a result, it can perform well on tasks when the semant…

2022

Cross-Domain Few-Shot Semantic Segmentation

ECCV 2022poster

"Few-shot semantic segmentation aims at learning to segment a novel object class with only a few annotated examples. Most existing methods consider a setting where base classes are sampled from the same domain as the novel classes. However, in many applications, collecting sufficient training data f…

2022

Uncertainty-Aware Cross-Lingual Transfer with Pseudo Partial Labels

NAACL 2022findings

Large-scale multilingual pre-trained language models have achieved remarkable performance in zero-shot cross-lingual tasks. A recent study has demonstrated the effectiveness of self-learning-based approach on cross-lingual transfer, where only unlabeled data of target languages are required, without…

2022

Weakening the Influence of Clothing: Universal Clothing Attribute Disentanglement for Person Re-Identification

IJCAI 2022poster

Most existing Re-ID studies focus on the short-term cloth-consistent setting and thus dominate by the visual appearance of clothing. However, the same person would wear different clothes and different people would wear the same clothes in reality, which invalidates these methods. To tackle the chall…

2021

Diverse Part Discovery: Occluded Person Re-Identification With Part-Aware Transformer

CVPR 2021poster

Occluded person re-identification (Re-ID) is a challenging task as persons are frequently occluded by various obstacles or other persons, especially in the crowd scenario. To address these issues, we propose a novel end-to-end Part-Aware Transformer (PAT) for occluded person Re-ID through diverse pa…

Cited by 433PDFScholar