← Search

Yiming Huang

35 accepted papers

2026

Closing the Loop: Universal Repository Representation with RPG-Encoder

ICML 2026poster

Current repository agents encounter a reasoning disconnect due to fragmented representations, as existing methods rely on isolated API documentation or dependency graphs that lack semantic depth. We consider repository comprehension and generation to be inverse processes within a unified cycle: gene…

Cited by 0SourceScholar
2026

DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle

ICLR 2026poster

Real-world enterprise data intelligence workflows encompass data engineering that turns raw sources into analytical-ready tables and data analysis that convert those tables into decision-oriented insights. We introduce DAComp, a benchmark of 236 tasks that mirrors these complex workflows. Data engi…

Cited by 0SourceScholar
2026

DV-World: Benchmarking Data Visualization Agents in Real-World Scenarios

ICML 2026poster

Real-world data visualization (DV) requires native environmental grounding, cross-platform evolution, and proactive intent alignment. Yet, existing benchmarks often suffer from code-sandbox confinement, single-language creation-only tasks, and assumption of perfect intent. To bridge these gaps, we i…

Cited by 0SourceScholar
2026

EndoDDC: Learning Sparse to Dense Reconstruction for Endoscopic Robotic Navigation Via Diffusion Depth Completion

ICRA 2026poster

Accurate depth estimation plays a critical role in the navigation of endoscopic surgical robots, forming the foundation for 3D reconstruction and safe instrument guidance. Fine-tuning pretrained models heavily relies on endoscopic surgical datasets with precise depth annotations. While existing self…

2026

RPG: A Repository Planning Graph for Unified and Scalable Codebase Generation

ICLR 2026poster

Large language models excel at generating individual functions or single files of code, yet generating complete repositories from scratch remains a fundamental challenge. This capability is key to building coherent software systems from high-level specifications and realizing the full potential of a…

Cited by 0SourcecodeScholar
2026

Revitalizing Canonical Pre-Alignment for Irregular Multivariate Time Series Forecasting

AAAI 2026technical

Irregular multivariate time series (IMTS), characterized by uneven sampling and inter-variate asynchrony, fuel many forecasting applications yet remain challenging to model efficiently. Canonical Pre-Alignment (CPA) has been widely adopted in IMTS modeling by padding zeros at every global timestamp,

Cited by 0SourcePDFScholar
2026

SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?

ICML 2026poster

Code performance optimization is paramount in real-world software engineering and critical for production-level systems. While Large Language Models (LLMs) have demonstrated impressive capabilities in code generation and bug fixing, their proficiency in enhancing code performance at the repository l…

Cited by 0SourceScholar
2026

TMR-VLA: Vision-Language-Action Model for Magnetic Motion Control of Tri-Leg Silicone-Based Soft Robot

ICRA 2026poster

In-vivo environments, magnetically actuated soft robots offer advantages such as wireless operation and precise control, showing promising potential for painless detection and therapeutic procedures. We developed a trileg magnetically driven soft robot (TMR) whose multi-legged design enables more fl…

Cited by 0Scholar
2026

TR2M: Transferring Monocular Relative Depth to Metric Depth with Language Descriptions and Dual-Level Scale-Oriented Contrast

CVPR 2026

This work presents a generalizable framework to transfer relative depth to metric depth. Current monocular depth estimation methods are mainly divided into metric depth estimation (MMDE) and relative depth estimation (MRDE). MMDEs estimate depth in metric scale but are often limited to a specific do

Cited by 0SourcecodeScholar
2026

TaREx: Reinforcement Learning for Code-Driven Table Reasoning

AAAI 2026technical

Automatically solving table reasoning tasks remains challenging due to three main factors: (1) diverse and hierarchical table structures that hinder comprehension, (2) the heavy reliance on complex logical and numerical reasoning—which makes purely text-based methods prone to hallucinations—and (3)

Cited by 0SourcePDFScholar
2026

Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generation

ICLR 2026poster

Generating realistic and diverse human-human interactions from text is a crucial yet challenging task in computer vision, graphics, and robotics. Despite recent advances, existing methods have two key limitations. First, two-person interaction synthesis is highly complex, simultaneously requiring in…

Cited by 0SourcecodeScholar
2026

U2E: Uncertainty-Aware Modeling and Uncertainty-Guided Exploration with Deep Ensemble for Quadrupedal Robot

ICRA 2026poster

Reinforcement learning has facilitated agile locomotion in quadrupedal robots. However, most works remain highly dependent on the accuracy of simulation models in describing real-world robot dynamics. Consequently, policy transfer from simulation to hardware is still hindered by the well-known sim-t…

Cited by 0Scholar
2025

Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-Driven Surface Normal-Aware Tracking and Mapping

ICRA 2025

Simultaneous Localization and Mapping (SLAM) is essential for precise surgical interventions and robotic tasks in minimally invasive procedures. While recent advancements in 3D Gaussian Splatting (3DGS) have improved SLAM with high-quality novel view synthesis and fast rendering, these systems strug

Cited by 18SourcecodeScholar
2025

Do BERT-Like Bidirectional Models Still Perform Better on Text Classification in the Era of LLMs?

EMNLP 2025

The rapid adoption of LLMs has overshadowed the potential advantages of traditional BERT-like models in text classification. This study challenges the prevailing “LLM-centric” trend by systematically comparing three category methods, *i.e.,* BERT-like models fine-tuning, LLM internal state utilizati

2025

Exploring Stiffness Gradient Effects in Magnetically Induced Metamorphic Materials via Continuum Simulation and Validation

IROS 2025

Magnetic soft continuum robots are capable of bending with remote control in confined space environments, and they have been applied in various bioengineering contexts. As one type of ferromagnetic soft continuums, the Magnetically Induced Metamorphic Materials (MIMMs)-based continuum (MC) exhibits

Cited by 0SourceScholar
2025

Key-Point-Driven Data Synthesis with Its Enhancement on Mathematical Reasoning

AAAI 2025technical

Large language models have shown great potential in complex reasoning tasks, yet their performance is often hampered by the scarcity of high-quality and reasoning-focused training datasets. Addressing this challenge, we propose Key-PointDriven Data Synthesis (KPDDS), a novel data synthesis framework…

2025

Learning to Perform Low-Contact Autonomous Nasotracheal Intubation by Recurrent Action-Confidence Chunking with Transformer

IROS 2025

Nasotracheal intubation (NTI) is critical for establishing artificial airways in clinical anesthesia and critical care. Current manual methods face significant challenges, including cross-infection, especially during respiratory infection care, and insufficient control of endoluminal contact forces,

Cited by 2SourceScholar
2025

MSV-PCT: Multi-Sparse-View Enhanced Transformer Framework for Salient Object Detection in Point Clouds

AAAI 2025technical

Salient object detection (SOD) methods for 2D images have great significance in the field of human-computer interaction (HCI). However, as a common data format in HCI, the SOD research in the form of 3D point cloud data remains limited. Previous works commonly treat this task as point cloud segmenta…

Cited by 0SourcePDFScholar
2025

PALQO: Physics-informed model for Accelerating Large-scale Quantum Optimization

NeurIPS 2025poster

Variational Quantum Algorithms (VQAs) are emerging as leading strategies with the potential to unlock practical applications and deliver significant advantages in the investigation of many-body quantum systems and quantum chemistry. A key challenge hindering the application of VQAs to large-scale p…

Cited by 0SourceScholar
2025

PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation

NeurIPS 2025poster

Existing video generation models excel at producing photo-realistic videos from text or images, but often lack physical plausibility and 3D controllability. To overcome these limitations, we introduce PhysCtrl, a novel framework for physics-grounded image-to-video generation with physical parameters…

Cited by 0SourceScholar
2025

UtilGen: Utility-Centric Generative Data Augmentation with Dual-Level Task Adaptation

NeurIPS 2025poster

Data augmentation using generative models has emerged as a powerful paradigm for enhancing performance in computer vision tasks. However, most existing augmentation approaches primarily focus on optimizing intrinsic data attributes -- such as fidelity and diversity -- to generate visually high-quali…

Cited by 0SourceScholar
2025

Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulation

CVPR 2025poster

Faithfully reconstructing textured shapes and physical properties from videos presents an intriguing yet challenging problem. Significant efforts have been dedicated to advancing such a system identification problem in this area. Previous methods often rely on heavy optimization pipelines with a dif…

Cited by 0SourcePDFScholar
2024

Competition-Level Problems are Effective LLM Evaluators

ACL 2024findings

Large language models (LLMs) have demonstrated impressive reasoning capabilities, yet there is ongoing debate about these abilities and the potential data contamination problem recently. This paper aims to evaluate the reasoning capacities of LLMs, specifically in solving recent competition-level pr…

Cited by 23SourcePDFScholar
2024

DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models

EMNLP 2024main

We introduce DA-Code, a code generation benchmark specifically designed to assess LLMs on agent-based data science tasks. This benchmark features three core elements: First, the tasks within DA-Code are inherently challenging, setting them apart from traditional code generation tasks and demanding a…

2024

Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives

CVPR 2024poster

We present Ego-Exo4D a diverse large-scale multimodal multiview video dataset and benchmark challenge. Ego-Exo4D centers around simultaneously-captured egocentric and exocentric video of skilled human activities (e.g. sports music dance bike repair). 740 participants from 13 cities worldwide perform…

2024

Higher-Order Graph Convolutional Network with Flower-Petals Laplacians on Simplicial Complexes

AAAI 2024technical

Despite the recent successes of vanilla Graph Neural Networks (GNNs) on various tasks, their foundation on pairwise networks inherently limits their capacity to discern latent higher-order interactions in complex systems. To bridge this capability gap, we propose a novel approach exploiting the ric…

2024

Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent

EMNLP 2024main

Large Language Models (LLMs) have revolutionized open-domain dialogue agents but encounter challenges in multi-character role-playing (MCRP) scenarios. To address the issue, we present Neeko, an innovative framework designed for efficient multiple characters imitation. Neeko employs a dynamic low-ra…

2024

Robust Depth Enhancement via Polarization Prompt Fusion Tuning

CVPR 2024poster

Existing depth sensors are imperfect and may provide inaccurate depth values in challenging scenarios such as in the presence of transparent or reflective objects. In this work we present a general framework that leverages polarization imaging to improve inaccurate depth measurements from various de…

2024

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model

NAACL 2024long

The rapid development of Large Language Models (LLMs) has led to great strides in model capabilities like long-context understanding and reasoning.However, as LLMs are able to process longer contexts, it becomes more challenging to evaluate whether they have acquired certain capabilities, since the…

2024

SDformer: Transformer with Spectral Filter and Dynamic Attention for Multivariate Time Series Long-term Forecasting

IJCAI 2024poster

Transformer has gained widespread adoption in modeling time series due to the exceptional ability of its self-attention mechanism in capturing long-range dependencies. However, when processing time series data with numerous variates, the vanilla self-attention mechanism tends to distribute attention…

2023

S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering

ACL 2023short

Answering multi-hop questions over hybrid factual knowledge from the given text and table (TextTableQA) is a challenging task. Existing models mainly adopt a retriever-reader framework, which have several deficiencies, such as noisy labeling in training retriever, insufficient utilization of heterog…

2022

Towards Reproducible Evaluations for Flying Drone Controllers in Virtual Environments

IROS 2022poster

Research attention on natural user interfaces (NUIs) for drone flights are rising. Nevertheless, NUIs are highly diversified, and primarily evaluated by different physical environments leading to hard-to-compare performance between such solutions. We propose a virtual environment, namely VRFlightSim…

Cited by 0SourcecodeScholar