← Search

Xin Zeng

7 accepted papers

2025

A Continual Learning Approach for Embodied Question Answering with Generative Adversarial Imitation Learning

ICASSP 2025accepted

Embodied Question Answering (EQA) is a task in artificial intelligence where an intelligent agent is required to answer questions about its environment. For example, to answer a question such as "Is the TV on or off?", the agent must navigate to the room with the TV and answer with either "On." or "…

Cited by 0SourceScholar
2025

KLFormer: Karhunen-Loève Transform for Robust 3D Human Pose Estimation

ICASSP 2025accepted

In the scope of 3D human pose estimation, the task encompasses estimating the 3D positions of key skeletal points (i.e., wrists, elbows, and knees) from a 2D image or video sequence. This technology demonstrates widespread applicability across diverse domains, encompassing domains such as kinematic…

Cited by 0SourceScholar
2025

Role-Specific Reward Design with Large Language Model for StarCraft II

ICASSP 2025accepted

Reward acts as a signal to guide the agent’s learning process in Reinforcement Learning (RL), evaluating and assigning rewards to the agent’s actions based on theiralignment with goals. Designing reward is challenging in multiagent environment such as StarCraft II benchmark since agents face credit…

Cited by 0SourceScholar
2023

Bridging the Granularity Gap for Acoustic Modeling

ACL 2023findings

While Transformer has become the de-facto standard for speech, modeling upon the fine-grained frame-level features remains an open challenge of capturing long-distance dependencies and distributing the attention weights. We propose Progressive Down-Sampling (PDS) which gradually compresses the acous…

2023

Modaldrop: Modality-Aware Regularization for Temporal-Spectral Fusion in Human Activity Recognition

ICASSP 2023accepted

Although most of existing works for sensor-based Human Activity Recognition rely on the temporal view, we argue that the spectral view also provides complementary prior and accordingly benchmark a standard multi-view framework with extensive experiments to demonstrate its consistent superiority over…

Cited by 0SourceScholar
2023

xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Data

NeurIPS 2023poster

Advances in high-throughput sequencing technology have led to significant progress in measuring gene expressions at the single-cell level. The amount of publicly available single-cell RNA-seq (scRNA-seq) data is already surpassing 50M records for humans with each record measuring 20,000 genes. This…

Cited by 28SourcePDFScholar
2022

ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation

ACL 2022long

Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). This paper explores a deeper relationship between Transformer and numerical ODE methods. We first show that a residual block of layers in Transformer can be described as a higher-order solution to OD…