← Search

Zhenan He

4 accepted papers

2024

Large Language Models Can Not Perform Well in Understanding and Manipulating Natural Language at Both Character and Word Levels?

EMNLP 2024finding

Despite their promising performance across various tasks, recent studies reveal that Large language models (LLMs) still exhibit significant deficiencies in handling several word-level and character-level tasks, e.g., word unscrambling and sentence editing, indicating urgent needs for substantial imp…

Cited by 2SourcePDFScholar
2024

Rationales for Answers to Simple Math Word Problems Confuse Large Language Models

ACL 2024findings

Recently, large language models (LLMs) have demonstrated breakthrough mathematical problem-solving capabilities in grade school math word problems (MWP). For example, on the MWP benchmark GSM8K, the accuracy of GPT-3.5-Turbo and MetaMath-70B reaches 80.80% and 82.30%, respectively. One question aris…

Cited by 0SourcePDFScholar