← Search

Lei Lin

7 accepted papers

2026

Attention as a Compass: Efficient Exploration for Process-Supervised RL in Reasoning Models

ICLR 2026poster

Reinforcement Learning (RL) has shown remarkable success in enhancing the reasoning capabilities of Large Language Models (LLMs). Process-Supervised RL (PSRL) has emerged as a more effective paradigm compared to outcome-based RL. However, existing PSRL approaches suffer from limited exploration effi…

Cited by 0SourcecodeScholar
2024

IaC-Eval: A Code Generation Benchmark for Cloud Infrastructure-as-Code Programs

NeurIPS 2024poster

Infrastructure-as-Code (IaC), an important component of cloud computing, allows the definition of cloud infrastructure in high-level programs. However, developing IaC programs is challenging, complicated by factors that include the burgeoning complexity of the cloud ecosystem (e.g., diversity of clo…

2024

Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios

ACL 2024findings

Although chain-of-thought (CoT) prompting combined with language models has achieved encouraging results on complex reasoning tasks, the naive greedy decoding used in CoT prompting usually causes the repetitiveness and local optimality. To address this shortcoming, ensemble-optimization tries to obt…

2024

Layer-Wise Representation Fusion for Compositional Generalization

AAAI 2024technical

Existing neural models are demonstrated to struggle with compositional generalization (CG), i.e., the ability to systematically generalize to unseen compositions of seen components. A key reason for failure on CG is that the syntactic and semantic representations of sequences in both the uppermost l…

2023

LEAPT: Learning Adaptive Prefix-to-Prefix Translation For Simultaneous Machine Translation

ICASSP 2023accepted

Simultaneous machine translation, which aims at a realtime translation, is useful in many live scenarios but very challenging due to the trade-off between accuracy and latency. To achieve the balance for both, the model needs to wait for appropriate streaming text (READ policy) and then generates it…

Cited by 0SourceScholar
2023

Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization

EMNLP 2023long findings

Recent studies have shown that sequence-to-sequence (seq2seq) models struggle with compositional generalization (CG), i.e., the ability to systematically generalize to unseen compositions of seen components. There is mounting evidence that one of the reasons hindering CG is the representation of the…

Cited by 0SourcecodeScholar
2020

McFlow: Monte Carlo Flow Models for Data Imputation

CVPR 2020poster

We consider the topic of data imputation, a foundational task in machine learning that addresses issues with missing data. To that end, we propose MCFlow, a deep framework for imputation that leverages normalizing flow generative models and Monte Carlo sampling. We address the causality dilemma that…

Cited by 59PDFcodeScholar