← Search

Jiayu Liu

13 accepted papers

2026

Diversity-Enhanced Reasoning for Subjective Questions

ICLR 2026poster

Large Reasoning Models (LRMs) with long chain-of-thought capabilities, optimized via reinforcement learning with verifiable rewards (RLVR), excel at **objective reasoning** tasks like mathematical problem solving and code generation. However, RLVR is known for degrading generation diversity, which c…

Cited by 0SourcecodeScholar
2026

Pruning Long Chain-of-Thought of Large Reasoning Models via Small-Scale Preference Optimization

ICLR 2026poster

Recent advances in Large Reasoning Models (LRMs) have demonstrated strong performance on complex tasks through long Chain-of-Thought (CoT) reasoning. However, their lengthy outputs increase computational costs and may lead to overthinking, raising challenges in balancing reasoning effectiveness and…

Cited by 0SourcecodeScholar
2026

Step-Level Sparse Autoencoder for Reasoning Process Interpretation

ICML 2026poster

Large Language Models (LLMs) have achieved strong complex reasoning capabilities through Chain-of-Thought (CoT) reasoning. However, their reasoning patterns remain too complicated to analyze. While Sparse Autoencoders (SAEs) have emerged as a powerful tool for interpretability, existing approaches p…

Cited by 0SourceScholar
2025

Automated Creation of Reusable and Diverse Toolsets for Enhancing LLM Reasoning

AAAI 2025technical

Augmenting large language models (LLMs) with tools significantly enhances their problem-solving potential across multifaceted tasks. However, current tools automatically created by LLMs often serve as a mere summary of specific problems or solutions, which face two main issues: 1) Low reusability:…

2025

CogMath: Assessing LLMs' Authentic Mathematical Ability from a Human Cognitive Perspective

ICML 2025poster

Although large language models (LLMs) show promise in solving complex mathematical tasks, existing evaluation paradigms rely solely on a coarse measure of overall answer accuracy, which are insufficient for assessing their authentic capabilities. In this paper, we propose \textbf{CogMath}, which com…

Cited by 0SourcePDFScholar
2025

Revisiting Epistemic Markers in Confidence Estimation: Can Markers Accurately Reflect Large Language Models’ Uncertainty?

ACL 2025short

As large language models (LLMs) are increasingly used in high-stakes domains, accurately assessing their confidence is crucial. Humans typically express confidence through epistemic markers (e.g., “fairly confident”) instead of numerical values. However, it remains unclear whether LLMs consistently…

2025

What Makes In-context Learning Effective for Mathematical Reasoning

ICML 2025poster

Owing to the capability of in-context learning, large language models (LLMs) have shown impressive performance across diverse mathematical reasoning benchmarks. However, we find that few-shot demonstrations can sometimes bring negative performance and their effectiveness on LLMs' reasoning abilities…

2024

Decompose, Analyze and Rethink: Solving Intricate Problems with Human-like Reasoning Cycle

NeurIPS 2024oral

In this paper, we introduce DeAR (_Decompose-Analyze-Rethink_), a framework that iteratively builds a reasoning tree to tackle intricate problems within a single large language model (LLM). Unlike approaches that extend or search for rationales, DeAR is featured by 1) adopting a tree-based question…

Cited by 9SourcePDFScholar
2024

Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process

IJCAI 2024poster

Geometry Problem Solving (GPS), which is a classic and challenging math problem, has attracted much attention in recent years. It requires a solver to comprehensively understand both text and diagram, master essential geometry knowledge, and appropriately apply it in reasoning. However, existing wor…

2024

SocraticLM: Exploring Socratic Personalized Teaching with Large Language Models

NeurIPS 2024spotlight

Large language models (LLMs) are considered a crucial technology for advancing intelligent education since they exhibit the potential for an in-depth understanding of teaching scenarios and providing students with personalized guidance. Nonetheless, current LLM-based application in personalized teac…

2023

Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning

AAAI 2023technical

Mathematical reasoning is one of the crucial abilities of general artificial intelligence, which requires machines to master mathematical logic and knowledge from solving problems. However, existing approaches are not transparent (thus not interpretable) in terms of what knowledge has been learned a…

2022

Test-Time Training Can Close the Natural Distribution Shift Performance Gap in Deep Learning Based Compressed Sensing

ICML 2022spotlight

Deep learning based image reconstruction methods outperform traditional methods. However, neural networks suffer from a performance drop when applied to images from a different distribution than the training images. For example, a model trained for reconstructing knees in accelerated magnetic resona…