← Search

Pheng Ann Heng

15 accepted papers

2026

EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

ICML 2026poster

This paper introduces EPS3D, a new end-to-end feed-forward framework for open-vocabulary 3D panoptic segmentation. Unlike existing methods relying on additional preprocessing, we design an end-to-end architecture, with a distillation-based training strategy on diverse 3D scenes to predict 3D-aware s…

Cited by 0SourceScholar
2026

LaST$_{0}$: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model

ICML 2026spotlight

Vision-Language-Action (VLA) models have recently shown strong generalization, with some approaches seeking to explicitly generate linguistic reasoning traces or predict future observations prior to execution. However, explicit reasoning typically incurs non-negligible inference latency, which const…

Cited by 0SourceScholar
2026

Native Active Perception as Reasoning for Omni-Modal Understanding

ICML 2026poster

Passive models for long video understanding typically rely on a ``watch-it-all'' paradigm, processing data uniformly regardless of query difficulty, causing input complexity to scale linearly with video duration. Although interactive frameworks have emerged, they often rely on global pre-scanning, f…

Cited by 0SourceScholar
2026

OmniShow: Orchestrating Multimodal Conditions for Human-Object Interaction Video Generation

ICML 2026poster

In this work, we study **Human-Object Interaction Video Generation (HOIVG)**, which aims to synthesize high-quality HOI videos via text, reference image, audio, and pose conditions. To address the challenges of harmonious multimodal injection and heterogeneous data utility, we present **OmniShow**, …

Cited by 0SourceScholar
2026

Proteo-R1: Thinking Foundation Models for De Novo Protein Binder Design

ICML 2026poster

Recent advances in generative diffusion and flow-matching models have revolutionized molecular design, enabling the creation of novel proteins, small molecules, and RNA sequences with unprecedented fidelity. Yet, these models remain intuitive rather than intelligent—they generate without reasoning. …

Cited by 0SourceScholar
2026

RiboSphere: Learning Unified and Efficient Representations of RNA Structures

ICML 2026poster

Accurate RNA structure modeling remains difficult because RNA backbones are highly flexible, non-canonical interactions are prevalent, and experimentally determined 3D structures are comparatively scarce. We introduce RiboSphere, a framework that learns discrete geometric representations of RNA by c…

Cited by 0SourceScholar
2026

TD3B: Transition-Directed Discrete Diffusion for Allosteric Binder Generation

ICML 2026spotlight

Protein function is often controlled by ligands that bias the direction of state transitions, such as agonists and antagonists, rather than stabilizing a single conformation. This is especially important for clinically relevant G protein-coupled receptors (GPCRs), where therapeutic efficacy depends …

Cited by 0SourceScholar
2024

ANEDL: Adaptive Negative Evidential Deep Learning for Open-Set Semi-supervised Learning

AAAI 2024technical

Semi-supervised learning (SSL) methods assume that labeled data, unlabeled data and test data are from the same distribution. Open-set semi-supervised learning (Open-set SSL) con- siders a more practical scenario, where unlabeled data and test data contain new categories (outliers) not observed in l…

Cited by 5SourcePDFScholar
2024

DR-Label: Label Deconstruction and Reconstruction of GNN Models for Catalysis Systems

AAAI 2024technical

Attaining the equilibrium geometry of a catalyst-adsorbate system is key to fundamentally assessing its effective properties, such as adsorption energy. While machine learning methods with advanced representation or supervision strategies have been applied to boost and guide the relaxation processes…

2024

Memory-Efficient Prompt Tuning for Incremental Histopathology Classification

AAAI 2024technical

Recent studies have made remarkable progress in histopathology classification. Based on current successes, contemporary works proposed to further upgrade the model towards a more generalizable and robust direction through incrementally learning from the sequentially delivered domains. Unlike previou…

Cited by 1SourcePDFScholar
2024

PointPatchMix: Point Cloud Mixing with Patch Scoring

AAAI 2024technical

Data augmentation is an effective regularization strategy for mitigating overfitting in deep neural networks, and it plays a crucial role in 3D vision tasks, where the point cloud data is relatively limited. While mixing-based augmentation has shown promise for point clouds, previous methods mix poi…

Cited by 11SourcePDFScholar
2024

SiMA-Hand: Boosting 3D Hand-Mesh Reconstruction by Single-to-Multi-View Adaptation

AAAI 2024technical

Estimating 3D hand mesh from RGB images is a longstanding track, in which occlusion is one of the most challenging problems. Existing attempts towards this task often fail when the occlusion dominates the image space. In this paper, we propose SiMA-Hand, aiming to boost the mesh reconstruction perfo…

2021

Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery

ICRA 2021poster

Automatic surgical gesture recognition is fundamentally important to enable intelligent cognitive assistance in robotic surgery. With recent advancement in robot-assisted minimally invasive surgery, rich information including surgical videos and robotic kinematics can be recorded, which provide comp…

Cited by 47SourceScholar
2017

Learning to Aggregate Ordinal Labels by Maximizing Separating Width

ICML 2017poster

While crowdsourcing has been a cost and time efficient method to label massive samples, one critical issue is quality control, for which the key challenge is to infer the ground truth from noisy or even adversarial data by various users. A large class of crowdsourcing problems, such as those involvi…

Cited by 9SourcePDFScholar