← Search

Pei Zhang

32 accepted papers

2026

Direct Simultaneous Translation Activation for Large Audio-Language Models

ICASSP 2026poster

Simultaneous speech-to-text translation (Simul-S2TT) aims to translate speech into target text in real time, outputting translations while receiving source speech input, rather than waiting for the entire utterance to be spoken. Simul-S2TT research often modifies model architectures to implement rea…

Cited by 0SourcePDFScholar
2026

FT-CPG: Learning Central Pattern Generators for Fault-Tolerant Quadruped Locomotion under Multi-Joint Failures

ICRA 2026poster

Quadruped robots used for rescue and exploration are susceptible to various leg failures, where unpredictable joint locking or power loss can pose an immediate risk of falling. Traditional controllers lack fault-tolerant control capabilities in the case of multi-joint concurrent faults, and erroneou…

Cited by 0SourceScholar
2026

Falcon: Fast Proximal Linearization of Normalized Cuts for Unsupervised Image Segmentation

ICLR 2026poster

Current zero-shot unsupervised segmentation methods based on normalized cuts (NCut) face three key limitations. First, they rely on recursive bipartitions with repeated eigen-decompositions, making them prohibitively expensive at scale. Second, each split requires spectral relaxation followed by rou…

Cited by 0SourcecodeScholar
2026

LISA: Language-guided Interference-aware Spatial-Frequency Attention for Driver Gaze Estimation

IJCAI 2026

Driver gaze estimation serves as a fundamental metric for evaluating driver attentiveness in modern monitoring systems. Beyond being vulnerable to sudden lighting changes and sensor noise, spatial-domain models struggle to disentangle authentic gaze cues from irrelevant visual attributes. In this pa

Cited by 0Scholar
2025

Bit-swapping Oriented Twin-memory Multi-view Clustering in Lifelong Incomplete Scenarios

NeurIPS 2025poster

Although receiving notable improvements, current multi-view clustering (MVC) techniques generally rely on feature library mechanisms to propagate accumulated knowledge from historical views to newly-arrived data, which overlooks the information pertaining to basis embedding within each view. Moreov…

Cited by 0SourceScholar
2025

ConText: Driving In-context Learning for Text Removal and Segmentation

ICML 2025poster

This paper presents the first study on adapting the visual in-context learning (V-ICL) paradigm to optical character recognition tasks, specifically focusing on text removal and segmentation. Most existing V-ICL generalists employ a reasoning-as-reconstruction approach: they turn to using a straight…

2025

CultureSynth: A Hierarchical Taxonomy-Guided and Retrieval-Augmented Framework for Cultural Question-Answer Synthesis

EMNLP 2025

Cultural competence, defined as the ability to understand and adapt to multicultural contexts, is increasingly vital for large language models (LLMs) in global environments. While several cultural benchmarks exist to assess LLMs’ cultural competence, current evaluations suffer from fragmented taxono

2025

Enhancing Machine Translation with Self-Supervised Preference Data

ACL 2025long

Model alignment methods like Direct Preference Optimization and Contrastive Preference Optimization have enhanced machine translation performance by leveraging preference data to enable models to reject suboptimal outputs. During preference data construction, previous approaches primarily rely on hu…

2025

FT-CPG: Learning Central Pattern Generators for Fault-Tolerant Quadruped Locomotion Under Multi-Joint Failures

RA-L 2025

Quadruped robots used for rescue and exploration are susceptible to various leg failures, where unpredictable joint locking or power loss can pose an immediate risk of falling. Traditional controllers lack fault-tolerant control capabilities in the case of multi-joint concurrent faults, and erroneou

Cited by 4SourceScholar
2025

HyperDiff: Masked Diffusion Model with High-efficient Transformer for Hyperspectral Image Cross-Scene Classification

ICASSP 2025accepted

Hyperspectral Image (HSI) cross-scene classification is a challenging task in remote sensing, particularly when real-time processing of Target Domain (TD) HSI is required, and data cannot be reused for training. While deep learning methods have shown promising results, the generalization ability of…

Cited by 0SourceScholar
2025

Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation

ICLR 2025poster

LLM self-evaluation relies on the LLM's own ability to estimate response correctness, which can greatly improve its deployment reliability. In this research track, we propose the Chain-of-Embedding (CoE) in the latent space to enable LLMs to perform output-free self-evaluation. CoE consists of all…

2025

Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models

ACL 2025long

Direct speech translation (ST) has garnered increasing attention nowadays, yet the accurate translation of terminology within utterances remains a great challenge. In this regard, current studies mainly concentrate on leveraging various translation knowledge into ST models. However, these methods of…

Cited by 0SourcePDFScholar
2025

Max-Mahalanobis Anchors Guidance for Multi-View Clustering

AAAI 2025technical

Anchor selection or learning has become a critical component in large-scale multi-view clustering. Existing anchor-based methods, which either select-then-fix or initialize-then-optimize with orthogonality, yield promising performance. However, these methods still suffer from instability of initiali…

Cited by 0SourcePDFScholar
2025

PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts

NeurIPS 2025poster

In this paper, we introduce **PolyMath**, a multilingual mathematical reasoning benchmark covering 18 languages and 4 easy-to-hard difficulty levels. Our benchmark ensures difficulty comprehensiveness, language diversity, and high-quality translation, making it a highly discriminative multilingual m…

Cited by 0SourceScholar
2025

STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework

ACL 2025finding

High-quality math datasets are crucial for advancing the reasoning abilities of large language models (LLMs). However, existing datasets often suffer from three key issues: outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM gener…

2025

Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding

NeurIPS 2025spotlight

Test-time scaling enhances large language model performance by allocating additional compute resources during decoding. Best-of-$N$ (BoN) sampling serves as a common sampling-based scaling technique, broadening the search space in parallel to find better solutions from the model distribution. Howeve…

Cited by 0SourceScholar
2025

Simple yet Effective Incomplete Multi-view Clustering: Similarity-level Imputation and Intra-view Hybrid-group Prototype Construction

ICLR 2025spotlight

Most of incomplete multi-view clustering (IMVC) methods typically choose to ignore the missing samples and only utilize observed unpaired samples to construct bipartite similarity. Moreover, they employ a single quantity of prototypes to extract the information of $\textbf{all}$ views. To elimina…

Cited by 0SourcePDFScholar
2025

Translationese-index: Using Likelihood Ratios for Graded and Generalizable Measurement of Translationese

EMNLP 2025

Translationese refers to linguistic properties that usually occur in translated texts. Previous works study translationese by framing it as a binary classification between original texts and translated texts. In this paper, we argue that translationese should be graded instead of binary and propose

Cited by 0SourcePDFScholar
2024

AnyTrans: Translate AnyText in the Image with Large Scale Models

EMNLP 2024finding

This paper introduces AnyText, an all-encompassing framework for the task–In-Image Machine Translation (IIMT), which includes multilingual text translation and text fusion within images. Our framework leverages the strengths of large-scale models, such as Large Language Models (LLMs) and text-guided…

2024

DVSAI: Diverse View-Shared Anchors Based Incomplete Multi-View Clustering

AAAI 2024technical

In numerous real-world applications, it is quite common that sample information is partially available for some views due to machine breakdown or sensor failure, causing the problem of incomplete multi-view clustering (IMVC). While several IMVC approaches using view-shared anchors have successfully…

Cited by 17SourcePDFScholar
2024

Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning

NeurIPS 2024poster

Real-world data deviating from the independent and identically distributed (\textit{i.i.d.}) assumption of in-distribution training data poses security threats to deep networks, thus advancing out-of-distribution (OOD) detection algorithms. Detection methods in generative language models (GLMs) main…

2024

Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning

EMNLP 2024finding

Achieving consistent high-quality machine translation (MT) across diverse domains remains a significant challenge, primarily due to the limited and imbalanced parallel training data available in various domains. While large language models (LLMs) have demonstrated impressive general understanding an…

2024

Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models

ACL 2024findings

Neural-symbolic methods have demonstrated efficiency in enhancing the reasoning abilities of large language models (LLMs). However, existing methods mainly rely on syntactically mapping natural languages to complete formal languages like Python and SQL. Those methods require that reasoning tasks be…

2024

Towards Resource-friendly, Extensible and Stable Incomplete Multi-view Clustering

ICML 2024spotlight

Incomplete multi-view clustering (IMVC) methods typically encounter three drawbacks: (1) intense time and/or space overheads; (2) intractable hyper-parameters; (3) non-zero variance results. With these concerns in mind, we give a simple yet effective IMVC scheme, termed as ToRES. Concretely, instead…

Cited by 10SourcePDFScholar
2023

Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented View

AAAI 2023technical

Graph anomaly detection (GAD) is a vital task in graph-based machine learning and has been widely applied in many real-world applications. The primary goal of GAD is to capture anomalous nodes from graph datasets, which evidently deviate from the majority of nodes. Recent methods have paid attention…

2023

Let the Data Choose: Flexible and Diverse Anchor Graph Fusion for Scalable Multi-View Clustering

AAAI 2023technical

In the past few years, numerous multi-view graph clustering algorithms have been proposed to enhance the clustering performance by exploring information from multiple views. Despite the superior performance, the high time and space expenditures limit their scalability. Accordingly, anchor graph lear…

2022

Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?

EMNLP 2022main

Neural machine translation (NMT) is often criticized for failures that happenwithout awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further investigations whenever they are in doubt about predictions. T…

2022

Efficient One-Pass Multi-View Subspace Clustering with Consensus Anchors

AAAI 2022technical

Multi-view subspace clustering (MVSC) optimally integrates multiple graph structure information to improve clustering performance. Recently, many anchor-based variants are proposed to reduce the computational complexity of MVSC. Though achieving considerable acceleration, we observe that most of the…

2022

PI3NN: Out-of-distribution-aware Prediction Intervals from Three Neural Networks

ICLR 2022poster

We propose a novel prediction interval (PI) method for uncertainty quantification, which addresses three major issues with the state-of-the-art PI methods. First, existing PI methods require retraining of neural networks (NNs) for every given confidence level and suffer from the crossing issue in ca…

2021

A Meta-Learning Framework for Few-Shot Classification of Remote Sensing Scene

ICASSP 2021accepted

While achieving remarkable success in remote sensing (RS) scene classification for the past few years, convolutional neural network (CNN) based methods suffer from the demand for large amounts of training data. The bottleneck in prediction accuracy has shifted from data processing limits toward a la…

Cited by 0SourceScholar
2021

Context-Interactive Pre-Training for Document Machine Translation

NAACL 2021long

Document machine translation aims to translate the source sentence into the target language in the presence of additional contextual information. However, it typically suffers from a lack of doc-level bilingual data. To remedy this, here we propose a simple yet effective context-interactive pre-trai…

Cited by 2SourcePDFScholar