← Search

Heng Yu

16 accepted papers

2026

AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusion

CVPR 2026

Reconstructing 3D human motion and human-object interactions (HOI) from Internet videos is a fundamental step toward building large-scale datasets of human behavior. Existing methods struggle to recover globally consistent 3D motion under dynamic cameras, especially for motion types underrepresented

Cited by 0SourceScholar
2026

Themis: Automated Constraint-Aware Test Synthesis Framework for Code Reinforcement Learning

AAAI 2026technical

Reinforcement learning (RL) has shown promise for enhancing code generation capabilities in large language models (LLMs), yet its effectiveness critically depends on high-quality test suites for reliable reward signals. Current approaches suffer from inadequate test case quantity and quality, leadin

Cited by 0SourcePDFScholar
2026

ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Body

CVPR 2026

Human communication is inherently multimodal and social: words, prosody, and body language jointly carry intent. Yet most prior systems model human behavior as a translation task--co-speech gesture or text-to-motion that maps a fixed utterance to motion clips--without requiring agentic decision-maki

Cited by 0SourceScholar
2025

CA-GAR: Context-Aware Alignment of LLM Generation for Document Retrieval

ACL 2025finding

Information retrieval has evolved from traditional sparse and dense retrieval methods to approaches driven by large language models (LLMs). Recent techniques, such as Generation-Augmented Retrieval (GAR) and Generative Document Retrieval (GDR), leverage LLMs to enhance retrieval but face key challen…

Cited by 0SourcePDFScholar
2025

DARR: A Dual-Branch Arithmetic Regression Reasoning Framework for Solving Machine Number Reasoning

AAAI 2025technical

Abstract visual reasoning (AVR) is a critical ability of humans, and it has been widely studied, but arithmetic visual reasoning, a unique task in AVR to reason over number sense, is less studied in the literature. To facilitate this research, we construct a Machine Number Reasoning (MNR) dataset to…

2025

PQR: Improving Dense Retrieval via Potential Query Modeling

ACL 2025long

Dense retrieval has now become the mainstream paradigm in information retrieval. The core idea of dense retrieval is to align document embeddings with their corresponding query embeddings by maximizing their dot product. The current training data is quite sparse, with each document typically associa…

Cited by 0SourcePDFScholar
2025

RADCI: A Synchronized Radar-RGBT Object Detecting-Tracking Dataset And A Benchmark

ICASSP 2025accepted

High-quality perception is crucial in autonomous driving and monitoring systems, where millimeter-wave radar and infrared cameras play important roles due to their robustness and reliability under harsh conditions. Both technologies can serve as low-cost supplements to optical image detection, impro…

Cited by 0SourceScholar
2025

UniRAG: Unified Query Understanding Method for Retrieval Augmented Generation

ACL 2025long

Retrieval-Augmented Generation (RAG) technology effectively addresses the issues of knowledge update lag and hallucinations in large language models (LLMs) by integrating internal and external knowledge. Existing query augmentation methods improve RAG’s performance in handling complex queries but fa…

Cited by 0SourcePDFScholar
2024

4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models

NeurIPS 2024poster

Existing dynamic scene generation methods mostly rely on distilling knowledge from pre-trained 3D generative models, which are typically fine-tuned on synthetic object datasets. As a result, the generated scenes are often object-centric and lack photorealism. To address these limitations, we introd…

Cited by 26SourcePDFScholar
2024

CoGS: Controllable Gaussian Splatting

CVPR 2024poster

Capturing and re-animating the 3D structure of articulated objects present significant barriers. On one hand methods requiring extensively calibrated multi-view setups are prohibitively complex and resource-intensive limiting their practical applicability. On the other hand while single-camera Neura…

Cited by 42SourcePDFScholar
2024

Regression Residual Reasoning with Pseudo-labeled Contrastive Learning for Uncovering Multiple Complex Compositional Relations

IJCAI 2024poster

Abstract Visual Reasoning (AVR) has been widely studied in literature. Our study reveals that AVR models tend to rely on appearance matching rather than a genuine understanding of underlying rules. We hence develop a challenging benchmark, Multiple Complex Compositional Reasoning (MC2R), composed of…

Cited by 4SourcePDFScholar
2023

DyLiN: Making Light Field Networks Dynamic

CVPR 2023poster

Light Field Networks, the re-formulations of radiance fields to oriented rays, are magnitudes faster than their coordinate network counterparts, and provide higher fidelity with respect to representing 3D structures from 2D observations. They would be well suited for generic scene representation and…

2022

Deep Fusing Pre-trained Models into Neural Machine Translation

AAAI 2022technical

Pre-training and fine-tuning have become the de facto paradigm in many natural language processing (NLP) tasks. However, compared to other NLP tasks, neural machine translation (NMT) aims to generate target language sentences through the contextual representation from the source language counterpart…

2022

Dynamic Texture Recognition Using PDV Hashing and Dictionary Learning on Multi-Scale Volume Local Binary Pattern

ICASSP 2022accepted

Spatial-temporal local binary pattern (STLBP) has been widely used in dynamic texture recognition. STLBP often encounters the high-dimension problem as its dimension increases exponentially, so that STLBP could only utilize a small neighborhood. To tackle this problem, we propose a method for dynami…

Cited by 0SourceScholar
2022

Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation

ACL 2022long

The principal task in supervised neural machine translation (NMT) is to learn to generate target sentences conditioned on the source inputs from a set of parallel sentence pairs, and thus produce a model capable of generalizing to unseen instances. However, it is commonly observed that the generaliz…

2021

On Learning Universal Representations Across Languages

ICLR 2021poster

Recent studies have demonstrated the overwhelming advantage of cross-lingual pre-trained models (PTMs), such as multilingual BERT and XLM, on cross-lingual NLP tasks. However, existing approaches essentially capture the co-occurrence among tokens through involving the masked language model (MLM) obj…

Cited by 87SourcePDFScholar