← Search

Heming Cui

16 accepted papers

2026

SAMPLE EFFICIENT EXPERIENCE REPLAY IN NON-STATIONARY ENVIRONMENTS

ICASSP 2026poster

Reinforcement learning (RL) in non-stationary environments is challenging, as changing dynamics and rewards quickly make past experiences outdated. Traditional experience replay (ER) methods, especially those using TD-error prioritization, struggle to distinguish between changes caused by the agent'…

Cited by 0SourcePDFScholar
2026

StereoVLA: Enhancing Vision-Language-Action Models with Stereo Vision

RSS 2026poster

While Vision-Language-Action (VLA) models excel in generalist manipulation, they often lack fine-grained spatial awareness and struggle with viewpoint generalization. This limitation largely stems from the reliance on pretrained RGB encoders, which lack explicit geometric cues and prioritize semanti…

Cited by 0SourceScholar
2025

EffiBench-X: A Multi-Language Benchmark for Measuring Efficiency of LLM-Generated Code

NeurIPS 2025poster

Existing code generation benchmarks primarily evaluate functional correctness, with limited attention to code efficiency, and they are often restricted to a single language such as Python. To address this gap, we introduce EffiBench‑X, the first large‑scale multi‑language benchmark specifically desi…

Cited by 0SourcecodeScholar
2025

EffiCoder: Enhancing Code Generation in Large Language Models through Efficiency-Aware Fine-tuning

ICML 2025poster

As large language models (LLMs) play an increasingly important role in code generation, enhancing both correctness and efficiency has become crucial. Current methods primarily focus on correctness, often overlooking efficiency. To address this gap, we introduce SWIFTCODE to improve both aspects by f…

Cited by 0SourcePDFScholar
2025

FoldMoE: Efficient Long Sequence MoE Training via Attention-MoE Pipelining

ACL 2025long

Training LLMs with Mixture-of-Experts (MoE) architecture on long sequences poses significant challenges due to the all-to-all communication bottleneck of expert parallelism. While existing approaches attempt to hide the communication costs in computation through token-level pipelining within MoE lay…

Cited by 0SourcePDFScholar
2025

GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Data

CoRL 2025poster

Embodied foundation models are gaining increasing attention for their zero-shot generalization, scalability, and adaptability to new tasks through few-shot post-training. However, existing models rely heavily on real-world data, which is costly and labor-intensive to collect. Synthetic data offers a…

Cited by 0SourceScholar
2025

OMEGA: Efficient Occlusion-Aware Navigation for Air-Ground Robots in Dynamic Environments via State Space Model

RA-L 2025

Air-ground robots (AGRs) are widely used in surveillance and disaster response due to their exceptional mobility and versatility (i.e., flying and driving). Current AGR navigation systems perform well in static occlusion-prone environments (e.g., indoors) by using 3D semantic occupancy networks to p

Cited by 8SourceScholar
2025

Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspective

ICASSP 2025accepted

Deep Reinforcement Learning (DRL) suffers from uncertainties and inaccuracies in the observation signal in real-world applications. Adversarial attack is an effective method for evaluating the robustness of DRL agents. However, existing attack methods targeting individual sampled actions have limite…

Cited by 16SourceScholar
2025

Robust Deep Reinforcement Learning in Robotics via Adaptive Gradient-Masked Adversarial Attacks

IROS 2025

Deep reinforcement learning (DRL) has emerged as a promising approach for robotic control, but its real-world deployment remains challenging due to its vulnerability to environmental perturbations. Existing white-box adversarial attack methods, adapted from supervised learning, fail to effectively t

Cited by 12SourceScholar
2024

AGRNav: Efficient and Energy-Saving Autonomous Navigation for Air-Ground Robots in Occlusion-Prone Environments

ICRA 2024poster

The exceptional mobility and long endurance of air-ground robots are raising interest in their usage to navigate complex environments (e.g., forests and large buildings). However, such environments often contain occluded and unknown regions, and without accurate prediction of unobserved obstacles, t…

Cited by 6SourcecodeScholar
2024

Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulation

NeurIPS 2024poster

Despite significant progress in robotics and embodied AI in recent years, deploying robots for long-horizon tasks remains a great challenge. Majority of prior arts adhere to an open-loop philosophy and lack real-time feedback, leading to error accumulation and undesirable robustness. A handful of ap…

2024

EffiBench: Benchmarking the Efficiency of Automatically Generated Code

NeurIPS 2024poster

Code generation models have increasingly become integral to aiding software development. Although current research has thoroughly examined the correctness of the code produced by code generation models, a vital aspect that plays a pivotal role in green computing and sustainability efforts — the effi…

2024

EffiLearner: Enhancing Efficiency of Generated Code via Self-Optimization

NeurIPS 2024poster

Large language models (LLMs) have shown remarkable progress in code generation, but their generated code often suffers from inefficiency, resulting in longer execution times and higher memory consumption. To address this issue, we propose EffiLearner, a self-optimization framework that utilizes exec…

Cited by 4SourcePDFScholar
2024

HE-Nav: A High-Performance and Efficient Navigation System for Aerial-Ground Robots in Cluttered Environments

RA-L 2024

Existing AGR navigation systems have advanced in lightly occluded scenarios (e.g., buildings) by employing 3D semantic scene completion networks for voxel occupancy prediction and constructing Euclidean Signed Distance Field (ESDF) maps for collision-free path planning. However, these systems exhibi

Cited by 6SourceScholar
2024

Learning Manipulation by Predicting Interaction

RSS 2024poster

Representation learning approaches for robotic manipulation have boomed in recent years. Due to the scarcity of in-domain robot data, prevailing methodologies tend to leverage large-scale human video datasets to extract generalizable features for visuomotor policy learning. Despite the progress achi…