← Search

Hanhua Hong

3 accepted papers

2024

Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking

EMNLP 2024main

Text ranking has witnessed significant advancements, attributed to the utilization of dual-encoder enhanced by Pre-trained Language Models (PLMs). Given the proliferation of available PLMs, selecting the most effective one for a given dataset has become a non-trivial challenge. As a promising altern…

2023

How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey

EMNLP 2023long findings

Transferability estimation has been attached to great attention in the computer vision fields. Researchers try to estimate with low computational cost the performance of a model when transferred from a source task to a given target task. Considering the effectiveness of such estimations, the commun…

Cited by 0Source ↗code ↗Scholar ↗
2023

Permutation Invariant Training for Paraphrase Identification

ICASSP 2023accepted

Identifying sentences sharing similar meanings is crucial to speech and text understandings. Although currently popular cross-encoder solutions with pre-trained language models as backbone have achieved remarkable performance, they suffer from the lack of the permutation invariance or symmetry that…

Cited by 0Source ↗Scholar ↗