← Search

Jianhui Pang

5 accepted papers

2025

Do NOT Think That Much for 2+3=? On the Overthinking of Long Reasoning Models

ICML 2025poster

The remarkable performance of long reasoning models can be attributed to their ability to emulate human-like long-time thinking during inference. These models employ extended chain-of-thought (CoT) processes, exploring multiple strategies to enhance problem-solving capabilities. However, a critical…

2024

Anchor-based Large Language Models

ACL 2024findings

Large language models (LLMs) predominantly employ decoder-only transformer architectures, necessitating the retention of keys/values information for historical tokens to provide contextual information and avoid redundant computation. However, the substantial size and parameter volume of these LLMs r…

2024

Benchmarking LLMs via Uncertainty Quantification

NeurIPS 2024poster

The proliferation of open-source Large Language Models (LLMs) from various institutions has highlighted the urgent need for comprehensive evaluation methods. However, current evaluation platforms, such as the widely recognized HuggingFace open LLM leaderboard, neglect a crucial aspect -- uncertainty…

2024

Benchmarking and Improving Long-Text Translation with Large Language Models

ACL 2024findings

Recent studies have illuminated the promising capabilities of large language models (LLMs) in handling long texts. However, their performance in machine translation (MT) of long documents remains underexplored. This paper aims to shed light on how LLMs navigate this complex task, offering a comprehe…

2024

MoNMT: Modularly Leveraging Monolingual and Bilingual Knowledge for Neural Machine Translation

COLING 2024main

The effective use of monolingual and bilingual knowledge represents a critical challenge within the neural machine translation (NMT) community. In this paper, we propose a modular strategy that facilitates the cooperation of these two types of knowledge in translation tasks, while avoiding the issue…