← Search

Peiyang Song

5 accepted papers

2026

The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs

ICML 2026poster

Personality traits have long been studied as predictors of human behavior. Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems, with advanced LLMs displaying consistent behavioral tendencies resembling human traits like agreeableness and self-reg…

Cited by 0SourceScholar
2025

LeanAgent: Lifelong Learning for Formal Theorem Proving

ICLR 2025poster

Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a specific dataset to perform well on particular domains, such a…

Cited by 8SourcePDFScholar
2024

Creative and Context-Aware Translation of East Asian Idioms with GPT-4

EMNLP 2024finding

As a type of figurative language, an East Asian idiom condenses rich cultural background into only a few characters. Translating such idioms is challenging for human translators, who often resort to choosing a context-aware translation from an existing list of candidates. However, compiling a dictio…

2024

In-Context Learning May Not Elicit Trustworthy Reasoning: A-Not-B Errors in Pretrained Language Models

EMNLP 2024finding

Recent advancements in artificial intelligence have led to the creation of highly capable large language models (LLMs) that can perform tasks in a human-like manner. However, LLMs exhibit only infant-level cognitive abilities in certain areas. One such area is the A-Not-B error, a phenomenon seen in…

2023

LeanDojo: Theorem Proving with Retrieval-Augmented Language Models

NeurIPS 2023oral

Large language models (LLMs) have shown promise in proving formal theorems using proof assistants such as Lean. However, existing methods are difficult to reproduce or build on, due to private code, data, and large compute requirements. This has created substantial barriers to research on machine le…

Cited by 268SourcePDFScholar