← Search

Jiayi Wang

27 accepted papers

2026

See What We Cannot See: A Geo-guided Reasoning Benchmark for Object Counting under Adverse Earth Observation Conditions

CVPR 2026

Object counting in remote sensing imagery becomes challenging when visual cues are obscured by clouds, fog, shadows, or low-light conditions. Yet earth observation inherently provides complementary geo-modalities, including land use and map, which offer stable structural and contextual priors that r

Cited by 0SourcecodeScholar
2025

A Principled Path to Fitted Distributional Evaluation

NeurIPS 2025spotlight

In reinforcement learning, distributional off-policy evaluation (OPE) focuses on estimating the return distribution of a target policy using offline data collected under a different policy. This work focuses on extending the widely used fitted Q-evaluation---developed for expectation-based reinforce…

Cited by 0SourcecodeScholar
2025

ClinicalLab: Aligning Agents for Multi-Departmental Clinical Diagnostics in the Real World

NeurIPS 2025poster

Large language models (LLMs) have achieved significant performance progress in various natural language processing applications. However, LLMs still struggle to meet the strict requirements for accuracy and reliability in the medical field and face many challenges in clinical applications. Existing…

Cited by 0SourcecodeScholar
2025

Multilingual Language Model Pretraining using Machine-translated Data

EMNLP 2025

English, as a very high-resource language, enables the pretraining of high-quality large language models (LLMs). However, the same can not be said for most other languages, likely due to a gap in the quality and diversity of available multilingual pretraining corpora. In this work, we find that docu

Cited by 0SourcePDFScholar
2025

Near-field AoA estimation with Complex Convolutional Kolmogorov-Arnold Network

ICASSP 2025accepted

The development of 5G and beyond puts forward higher requirements for indoor positioning. However, conventional angle of arrival (AoA) estimation algorithms still rely on the far-field assumption, which is not applicable and may lead to a loss of accuracy. In this paper, we investigate the near-fiel…

Cited by 0SourceScholar
2025

Noisy Low-Rank Matrix Completion via Transformed $L_1$ Regularization and its Theoretical Properties

AISTATS 2025poster

This paper focuses on recovering an underlying matrix from its noisy partial entries, a problem commonly known as matrix completion. We delve into the investigation of a non-convex regularization, referred to as transformed $L_1$ (TL1), which interpolates between the rank and the nuclear norm of mat…

Cited by 0SourceScholar
2025

SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?

EMNLP 2025

Evaluating machine translation (MT) quality for under-resourced African languages remains a significant challenge, as existing metrics often suffer from limited language coverage and poor performance in low-resource settings. While recent efforts, such as AfriCOMET, have addressed some of the issues

Cited by 0SourcePDFScholar
2025

Warmup Generations: A Task-Agnostic Approach for Guiding Sequence-to-Sequence Learning with Unsupervised Initial State Generation

ACL 2025long

Traditional supervised fine-tuning (SFT) strategies for sequence-to-sequence tasks often train models to directly generate the target output. Recent work has shown that guiding models with intermediate steps—such as keywords, outlines, or reasoning chains—can significantly improve performance, coher…

Cited by 0SourcePDFScholar
2024

A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models

ICML 2024poster

In this paper, we delve into the statistical analysis of the fitted Q-evaluation (FQE) method, which focuses on estimating the value of a target policy using offline data generated by some behavior policy. We provide a comprehensive theoretical understanding of FQE estimators under both parametric a…

Cited by 0SourcePDFScholar
2024

A New Theoretical Perspective on Data Heterogeneity in Federated Optimization

ICML 2024poster

In federated learning (FL), data heterogeneity is the main reason that existing theoretical analyses are pessimistic about the convergence rate. In particular, for many FL algorithms, the convergence rate grows dramatically when the number of local updates becomes large, especially when the product…

Cited by 5SourcePDFScholar
2024

A Pairwise Pseudo-likelihood Approach for Matrix Completion with Informative Missingness

NeurIPS 2024spotlight

While several recent matrix completion methods are developed to deal with non-uniform observation probabilities across matrix entries, very few allow the missingness to depend on the mostly unobserved matrix measurements, which is generally ill-posed. We aim to tackle a subclass of these ill-posed s…

Cited by 2SourcePDFScholar
2024

AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages

NAACL 2024long

Despite the recent progress on scaling multilingual machine translation (MT) to several under-resourced African languages, accurately measuring this progress remains challenging, since evaluation is often performed on n-gram matching metrics such as BLEU, which typically show a weaker correlation wi…

2024

Strings from the Library of Babel: Random Sampling as a Strong Baseline for Prompt Optimisation

NAACL 2024long

Recent prompt optimisation approaches use the generative nature of language models to produce prompts – even rivaling the performance of human-curated prompts. In this paper, we demonstrate that randomly sampling tokens from the model vocabulary as “separators” can be as effective as language models…

2023

Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation

ACL 2023long

Machine translation technology has made great progress in recent years, but it cannot guarantee error-free results. Human translators perform post-editing on machine translations to correct errors in the scene of computer aided translation. In favor of expediting the post-editing process, many works…

2023

LiveHand: Real-time and Photorealistic Neural Hand Rendering

ICCV 2023poster

The human hand is the main medium through which we interact with our surroundings, making its digitization an important problem. While there are several works modeling the geometry of hands, little attention has been paid to capturing photo-realistic appearance. Moreover, for applications in extende…

Cited by 19PDFcodeScholar
2022

Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD

AAAI 2022technical

Hierarchical SGD (H-SGD) has emerged as a new distributed SGD algorithm for multi-level communication networks. In H-SGD, before each global aggregation, workers send their updated local models to local servers for aggregations. Despite recent research efforts, the effect of local aggregation on glo…

2022

Distinguishing Non-natural from Natural Adversarial Samples for More Robust Pre-trained Language Model

ACL 2022findings

Recently, the problem of robustness of pre-trained language models (PrLMs) has received increasing research interest. Latest studies on adversarial attacks achieve high attack success rates against PrLMs, claiming that PrLMs are not robust. However, we find that the adversarial samples that PrLMs fa…

2022

Learning to Guide Online Multi-Contact Receding Horizon Planning

IROS 2022poster

In Receding Horizon Planning (RHP), it is critical that the motion being executed facilitates the completion of the task, e.g. building momentum to overcome large obstacles. This requires a value function to inform the desirability of robot states. However, given the complex dynamics, value function…

Cited by 7SourceScholar
2021

Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation

EMNLP 2021finding

Quality Estimation (QE) plays an essential role in applications of Machine Translation (MT). Traditionally, a QE system accepts the original source text and translation from a black-box MT system as input. Recently, a few studies indicate that as a by-product of translation, QE benefits from the mod…

Cited by 5SourcePDFScholar
2021

EventHands: Real-Time Neural 3D Hand Pose Estimation From an Event Stream

ICCV 2021poster

3D hand pose estimation from monocular videos is a long-standing and challenging problem, which is now seeing a strong upturn. In this work, we address it for the first time using a single event camera, i.e., an asynchronous vision sensor reacting on brightness changes. Our EventHands approach has c…

Cited by 62PDFcodeScholar
2020

Automatic Gait Pattern Selection for Legged Robots

IROS 2020poster

An important issue when synthesizing legged locomotion plans is the combinatorial complexity that arises from gait pattern selection. Though it can be defined manually, the gait pattern plays an important role in the feasibility and optimality of a motion with respect to a task. Replacing human intu…

Cited by 14SourceScholar
2020

HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalization

ECCV 2020poster

3D hand reconstruction from images is a widely-studied problem in computer vision and graphics, and has a particularly high relevance for virtual and augmented reality. Although several 3D hand reconstruction approaches leverage hand models as a strong prior to resolve ambiguities and achieve more r…

Cited by 87SourcePDFScholar