← Search

Tengxiao Liu

6 accepted papers

2024

Can Language Models Learn to Skip Steps?

NeurIPS 2024poster

Trained on vast corpora of human language, language models demonstrate emergent human-like reasoning abilities. Yet they are still far from true intelligence, which opens up intriguing opportunities to explore the parallels of humans and model behaviors. In this work, we study the ability to skip st…

2024

ECON: On the Detection and Resolution of Evidence Conflicts

EMNLP 2024main

The rise of large language models (LLMs) has significantly influenced the quality of information in decision-making systems, leading to the prevalence of AI-generated content and challenges in detecting misinformation and managing conflicting information, or “inter-evidence conflicts.” This study in…

2024

Full Parameter Fine-tuning for Large Language Models with Limited Resources

ACL 2024long

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) but demand massive GPU resources for training. Lowering the threshold for LLMs training would encourage greater participation from researchers, benefiting both academia and society. While existing approaches have focu…

2024

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation

EMNLP 2024finding

The training process of large language models (LLMs) often involves varying degrees of test data contamination. Although current LLMs are achieving increasingly better performance on various benchmarks, their performance in practical applications does not always match their benchmark results. Leakag…

2023

Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts

EMNLP 2023long main

As large language models (LLMs) have shown effectiveness with different prompting methods, such as Chain of Thought, Program of Thought, we find that these methods have formed a great complementarity to each other on math reasoning tasks. In this work, we propose XoT, an integrated problem solving f…

Cited by 0SourcecodeScholar
2022

RLET: A Reinforcement Learning Based Approach for Explainable QA with Entailment Trees

EMNLP 2022main

Interpreting the reasoning process from questions to answers poses a challenge in approaching explainable QA. A recently proposed structured reasoning format, entailment tree, manages to offer explicit logical deductions with entailment steps in a tree structure. To generate entailment trees, prior…