← Search

Lei Shen

25 accepted papers

2026

Equivariant Atomic and Lattice Modeling Using Geometric Deep Learning for Crystal Structure Optimization

AAAI 2026technical

Structure optimization, which yields the relaxed structure (minimum‑energy state), is essential for reliable materials property calculations, yet traditional ab initio approaches such as density‑functional theory (DFT) are computationally intensive. Machine learning (ML) has emerged to alleviate thi

Cited by 0SourcePDFScholar
2026

Optimal Transport for Reward Modeling from Noisy Feedback

ICML 2026poster

Reward models are fundamental to Reinforcement Learning from Human Feedback (RLHF), yet real-world datasets are inevitably corrupted by noisy preference. Conventional training objectives tend to overfit these errors, while existing denoising approaches often rely on homogeneous noise assumptions tha…

Cited by 0SourceScholar
2026

Temporal Calibrating and Distilling for Scene-Text Aware Text-Video Retrieval

AAAI 2026technical

Existing text-video retrieval methods mainly focus on singlemodal video content (i.e., visual entities), often overlooking heterogeneous scene text that is ubiquitous in human environments. Although scene text in videos provides finegrained semantics for cross-modal retrieval, effectively utilizing

Cited by 0SourcePDFScholar
2026

Unbiased Reward Modeling from Implicit Preference

ICML 2026poster

Despite the success of reinforcement learning from human feedback (RLHF) in aligning language models, current reward modeling heavily relies on explicit preference data with high collection costs. In this work, we study implicit reward modeling---learning reward models from implicit human feedback--…

Cited by 0SourceScholar
2025

Auto-SLURP: A Benchmark Dataset for Evaluating Multi-Agent Frameworks in Smart Personal Assistant

EMNLP 2025

In recent years, multi-agent frameworks powered by large language models (LLMs) have advanced rapidly. Despite this progress, there is still a notable absence of benchmark datasets specifically tailored to evaluate their performance. To bridge this gap, we introduce Auto-SLURP, a benchmark dataset a

2025

Cross-View Isolated Sign Language Recognition via View Synthesis and Feature Disentanglement

ICCV 2025poster

Cross-view isolated sign language recognition (CV-ISLR) addresses the challenge of identifying isolated signs from viewpoints unseen during training, a problem aggravated by the scarcity of multi-view data in existing benchmarks. To bridge this gap, we introduce a novel two-stage framework comprisin…

Cited by 0SourcePDFScholar
2025

Hot-pluggable Federated Learning: Bridging General and Personalized FL via Dynamic Selection

ICLR 2025poster

Personalized federated learning (PFL) achieves high performance by assuming clients only meet test data locally, which does not meet many generic federated learning (GFL) scenarios. In this work, we theoretically show that PMs can be used to enhance GFL with a new learning problem named Selective FL…

Cited by 0SourcePDFScholar
2025

Towards Unbiased Information Extraction and Adaptation in Cross-Domain Recommendation

AAAI 2025technical

Cross-Domain Recommendation (CDR) leverages additional knowledge from auxiliary domains to address the long-standing data sparsity issue. However, existing methods typically acquire this knowledge by minimizing the average loss over all domains, overlooking the fact that different domains possess di…

Cited by 0SourcePDFScholar
2024

HDMixer: Hierarchical Dependency with Extendable Patch for Multivariate Time Series Forecasting

AAAI 2024technical

Multivariate time series (MTS) prediction has been widely adopted in various scenarios. Recently, some methods have employed patching to enhance local semantics and improve model performance. However, length-fixed patch are prone to losing temporal boundary information, such as complete peaks and pe…

2024

PCE-Palm: Palm Crease Energy Based Two-Stage Realistic Pseudo-Palmprint Generation

AAAI 2024technical

The lack of large-scale data seriously hinders the development of palmprint recognition. Recent approaches address this issue by generating large-scale realistic pseudo palmprints from Bézier curves. However, the significant difference between Bézier curves and real palmprints limits their effective…

Cited by 8SourcePDFScholar
2023

CrossGNN: Confronting Noisy Multivariate Time Series Via Cross Interaction Refinement

NeurIPS 2023poster

Recently, multivariate time series (MTS) forecasting techniques have seen rapid development and widespread applications across various fields. Transformer-based and GNN-based methods have shown promising potential due to their strong ability to model interaction of time and variables. However, by co…

2023

Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-Training

ACL 2023long

Dialogue representation and understanding aim to convert conversational inputs into embeddings and fulfill discriminative tasks. Compared with free-form text, dialogue has two important characteristics, hierarchical semantic structure and multi-facet attributes. Therefore, directly applying the pret…

2023

DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation

ACL 2023long

Empathy is a crucial factor in open-domain conversations, which naturally shows one’s caring and understanding to others. Though several methods have been proposed to generate empathetic responses, existing works often lead to monotonous empathy that refers to generic and safe expressions. In this p…

Cited by 20SourcePDFScholar
2023

DistilPose: Tokenized Pose Regression With Heatmap Distillation

CVPR 2023poster

In the field of human pose estimation, regression-based methods have been dominated in terms of speed, while heatmap-based methods are far ahead in terms of performance. How to take advantage of both schemes remains a challenging problem. In this paper, we propose a novel human pose estimation frame…

2023

MNER-QG: An End-to-End MRC Framework for Multimodal Named Entity Recognition with Query Grounding

AAAI 2023technical

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a sentence-image pair. Existing methods either (1) obtain named entities with coarse-grained visual clues from attention me…

Cited by 53SourcePDFScholar
2023

RPG-Palm: Realistic Pseudo-data Generation for Palmprint Recognition

ICCV 2023poster

Palmprint recently shows great potential in recognition applications as it is a privacy-friendly and stable biometric. However, the lack of large-scale public palmprint datasets limits further research and development of palmprint recognition. In this paper, we propose a novel realistic pseudo-palmp…

Cited by 12PDFScholar
2023

Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection

ACL 2023long

With the popularity of social media, detecting sentiment from multimodal posts (e.g. image-text pairs) has attracted substantial attention recently. Existing works mainly focus on fusing different features but ignore the challenge of modality heterogeneity. Specifically, different modalities with in…

2022

BézierPalm: A Free Lunch for Palmprint Recognition

ECCV 2022poster

"Palmprints are private and stable information for biometric recognition. In the deep learning era, the development of palmprint recognition is limited by the lack of sufficient training data. In this paper, by observing that palmar creases are the key information to deep-learning-based palmprint re…

Cited by 21SourcePDFScholar
2022

Few-Shot Table Understanding: A Benchmark Dataset and Pre-Training Baseline

COLING 2022main

Few-shot table understanding is a critical and challenging problem in real-world scenario as annotations over large amount of tables are usually costly. Pre-trained language models (PLMs), which have recently flourished on tabular data, have demonstrated their effectiveness for table understanding t…

2021

CoLV: A Collaborative Latent Variable Model for Knowledge-Grounded Dialogue Generation

EMNLP 2021main

Knowledge-grounded dialogue generation has achieved promising performance with the engagement of external knowledge sources. Typical approaches towards this task usually perform relatively independent two sub-tasks, i.e., knowledge selection and knowledge-aware response generation. In this paper, in…

Cited by 26SourcePDFScholar
2021

Constructing Emotional Consensus and Utilizing Unpaired Data for Empathetic Dialogue Generation

EMNLP 2021finding

Researches on dialogue empathy aim to endow an agent with the capacity of accurate understanding and proper responding for emotions. Existing models for empathetic dialogue generation focus on the emotion flow in one direction, that is, from the context to response. We argue that conducting an empat…

2021

GTM: A Generative Triple-wise Model for Conversational Question Generation

ACL 2021long

Generating some appealing questions in open-domain conversations is an effective way to improve human-machine interactions and lead the topic to a broader or deeper direction. To avoid dull or deviated questions, some researchers tried to utilize answer, the “future” information, to guide question g…

Cited by 16SourcePDFScholar
2021

Learning to Select Context in a Hierarchical and Global Perspective for Open-Domain Dialogue Generation

ICASSP 2021accepted

Open-domain multi-turn conversations mainly have three features, which are hierarchical semantic structure, redundant information, and long-term dependency. Grounded on these, selecting relevant context becomes a challenge step for multiturn dialogue generation. However, existing methods cannot diff…

Cited by 0SourceScholar
2021

Probing Product Description Generation via Posterior Distillation

AAAI 2021technical

In product description generation (PDG), the user-cared aspect is critical for the recommendation system, which can not only improve user's experiences but also obtain more clicks. High-quality customer reviews can be considered as an ideal source to mine user-cared aspects. However, in reality, a l…