← Search

Yuan Gao

113 accepted papers

2026

A Multi-Camera Coordinated Localization Approach for Robust State Estimation of Flying Robots

RA-L 2026

Ground-air-based visual localization for UAVs, which typically relies on a single camera to track artificial markers, is often hampered by a limited field of view and sensitivity to illumination. Although active camera scheduling can mitigate these issues to some extent, it often incurs high motion

Cited by 0SourceScholar
2026

APT: Towards Universal Scene Graph Generation via Plug-in Adaptive Prompt Tuning

ICLR 2026poster

Scene Graph Generation (SGG) is pivotal for structured visual understanding, yet it remains hindered by a fundamental limitation: the reliance on fixed, frozen semantic representations from pre-trained language models. These semantic priors, while beneficial in other domains, are inherently misalign…

Cited by 0SourcecodeScholar
2026

Astra: General Interactive World Model with Autoregressive Denoising

ICLR 2026poster

Recent advances in diffusion transformers have empowered video generation models to generate high-quality video clips from texts or images. However, world models with the ability to predict long-horizon futures from past observations and actions remain underexplored, especially for general-purpose s…

Cited by 0SourcecodeScholar
2026

Benchmarking Real-Time Question Answering via Executable Code Workflows

IJCAI 2026

Retrieving real-time information is a fundamental capability for search-integrated agents in real-world applications. However, existing benchmarks are predominantly static and therefore fail to capture the temporal dynamics of information and the continuously evolving nature of real-world knowledge.

Cited by 0Scholar
2026

Composite Optimization with Error Feedback: the Dual Averaging Approach

ICLR 2026poster

Communication efficiency is a central challenge in distributed machine learning training, and message compression is a widely used solution. However, standard Error Feedback (EF) methods (Seide et al., 2014), though effective for smooth unconstrained optimization with compression (Karimireddy et al.…

Cited by 0SourceScholar
2026

Emergent Co-Adaptive Strategies in Heterogeneous Multi-Robot Systems Via Meta-Learning

ICRA 2026poster

Abstract— As teamed robots increasingly share public spaces with humans, the ability to co-adapt—to mutually adjust behavior in response to one another—becomes essential for safe, efficient, and socially acceptable operation. This paper introduces a socially co-adaptive framework for heterogeneous m…

Cited by 0Scholar
2026

InfoCLIP: Bridging Vision-Language Pretraining and Open-Vocabulary Semantic Segmentation via Information-Theoretic Alignment Transfer

AAAI 2026technical

Recently, the strong generalization ability of CLIP has facilitated open-vocabulary semantic segmentation, which labels pixels using arbitrary text. However, existing methods that fine-tune CLIP for segmentation on limited seen categories often lead to overfitting and degrade the pretrained vision-l

Cited by 0SourcePDFScholar
2026

LUMIN: A Longitudinal Multi-modal Knowledge Decomposition Network for Predicting Breast Cancer Recurrence

AAAI 2026technical

Accurate prediction of breast cancer recurrence after treatment is essential for improving long-term outcomes. However, existing models are limited by three key challenges: (1) they typically rely on single-modal data, missing cross-modal interactions; (2) they analyze static snapshots, failing to c

Cited by 0SourcePDFScholar
2026

MRMR: A Realistic and Expert-Level Multidisciplinary Benchmark for Reasoning-Intensive Multimodal Retrieval

ICLR 2026poster

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,435 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared to prior benchmarks, MRMR introduces three key advancements…

Cited by 0SourceScholar
2026

NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation

AAAI 2026technical

Long-term, high-fidelity simulation of slow-changing physical systems, such as the ocean and climate, presents a fundamental challenge in scientific computing. Traditional autoregressive machine learning models often fail in these tasks as minor errors accumulate and lead to rapid forecast degradati

Cited by 0SourcePDFScholar
2026

NuRisk: A Visual Question Answering Dataset for Agent-Level Risk Assessment in Autonomous Driving

ICRA 2026poster

Understanding risk in autonomous driving requires not only perception and prediction, but also high-level reasoning about agent behavior and context. Current Vision Language Model (VLM)-based methods primarily ground agents in static images and provide qualitative judgments, lacking the spatio–tempo…

2026

PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting

ICML 2026poster

Coupled spatiotemporal forecasting is important for predicting the future evolution of multiple interacting dynamical systems, such as in climate models. However, existing methods are severely constrained by the persistent bottleneck of compounding errors. In coupled systems, errors from each subsys…

Cited by 0SourceScholar
2026

RLAP-CLIP: Continual Multimodal Learning with Prototype Adaptation and Difficulty-Aware Routing

ICLR 2026poster

Vision-language models, such as CLIP, achieve strong zero-shot performance through contrastive pre-training but face significant challenges in class-incremental image classification scenarios. When learning new tasks sequentially, current methods suffer from degradation in prototype quality due to p…

Cited by 0SourceScholar
2026

Towards Multimodal Continual Knowledge Embedding with Modality Forgetting Modulation

AAAI 2026technical

The continuous emergence of new entities, relations, triples, and multimodal information drives the dynamic evolution of multimodal knowledge graph (MMKG). However, existing MMKG embedding models follow a static setting, where training from scratch for growing MMKG wastes learned knowledge, while fi

Cited by 0SourcePDFScholar
2026

TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysis

ICLR 2026poster

Accurate tumor analysis is central to clinical radiology and precision oncology, where early detection, reliable lesion characterization, and pathology-level risk assessment directly guide diagnosis, staging, and treatment planning. Chain-of-Thought (CoT) reasoning is particularly critical in this s…

Cited by 0SourcecodeScholar
2026

UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation

CVPR 2026

Recent video generation models demonstrate impressive synthesis capabilities but remain limited by single-modality conditioning, constraining their holistic world understanding. This stems from insufficient cross-modal interaction and limited modal diversity for comprehensive world knowledge represe

Cited by 0SourcecodeScholar
2026

Where I Am & Where to Go: Egocentric Indoor Scene Perception with Agent Interaction for Remote Embodied Visual Grounding

ICRA 2026poster

Embodied Referring Expression Grounding (REVERIE) is a Vision-and-Language Navigation (VLN) task that better reflects real-world human instructions. Unlike conventional VLN, REVERIE is more challenging as agents must navigate in unseen environments and ground remote objects described by short, high-…

Cited by 0Scholar
2025

Bridging Class Imbalance and Partial Labeling via Spectral-Balanced Energy Propagation for Skeleton-based Action Recognition

ICCV 2025poster

Skeleton-based action recognition faces class imbalance and insufficient labeling problems in real-world applications. Existing methods typically address these issues separately, lacking a unified framework that can effectively handle both issues simultaneously while considering their inherent relat…

Cited by 0SourcePDFScholar
2025

Bypass Back-propagation: Optimization-based Structural Pruning for Large Language Models via Policy Gradient

ACL 2025long

Recent Large-Language Models (LLMs) pruning methods typically operate at the post-training phase without the expensive weight finetuning, however, their pruning criteria often rely on **heuristically hand-crafted metrics**, potentially leading to suboptimal performance. We instead propose a novel **…

Cited by 0SourcePDFScholar
2025

Configuration-Adaptive Visual Relative Localization for Spherical Modular Self-Reconfigurable Robots

ICRA 2025

Spherical Modular Self-reconfigurable Robots (SMSRs) have been popular in recent years. Their Self-reconfigurable nature allows them to adapt to different en-vironments and tasks, and achieve what a single module could not achieve. To collaborate with each other, relative localization between each m

Cited by 0SourceScholar
2025

Decoder-Only LLMs can be Masked Auto-Encoders

ACL 2025short

Modern NLP workflows (e.g., RAG systems) require different models for generation and embedding tasks, where bidirectional pre-trained encoders and decoder-only Large Language Models (LLMs) dominate respective tasks. Structural differences between models result in extra development costs and limit kn…

2025

Demonstrating GPU Parallelized Robot Simulation and Rendering for Generalizable Embodied AI with ManiSkill3

RSS 2025poster

Simulation has enabled unprecedented compute-scalable approaches to robot learning. However, many existing simulation frameworks typically support a narrow range of scenes/tasks and lack features critical for scaling generalizable robotics and sim2real. We introduce and open source ManiSkill3, the f…

Cited by 0PDFScholar
2025

DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusion

ICCV 2025poster

We propose DepR, a depth-guided single-view scene reconstruction framework that integrates instance-level diffusion within a compositional paradigm. Instead of reconstructing the entire scene holistically, DepR generates individual objects and subsequently composes them into a coherent 3D layout. Un…

Cited by 0SourcePDFScholar
2025

DiffGAD: A Diffusion-based Unsupervised Graph Anomaly Detector

ICLR 2025poster

Graph Anomaly Detection (GAD) is crucial for identifying abnormal entities within networks, garnering significant attention across various fields. Traditional unsupervised methods, which decode encoded latent representations of unlabeled data with a reconstruction focus, often fail to capture critic…

2025

Efficient Representativeness-Aware Coreset Selection

NeurIPS 2025poster

Dynamic coreset selection is a promising approach for improving the training efficiency of deep neural networks by periodically selecting a small subset of the most representative or informative samples, thereby avoiding the need to train on the entire dataset. However, it remains inherently challen…

Cited by 0SourceScholar
2025

Entrospect: Information-Theoretic Self-Reflection Elicits Better Response Refinement of Small Language Models

ACL 2025finding

Self-reflection helps de-hallucinate Large Language Models (LLMs). However, the effectiveness of self-reflection remains insufficiently validated in the context of Small Language Models (SLMs), which exhibit limited semantic capacities. In particular, we demonstrate that the conventional self-reflec…

2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation

ICCV 2025poster

Most knowledge distillation (KD) methods focus on teacher-student pairs with similar architectures, such as both being CNN models. The potential and flexibility of KD can be greatly improved by expanding it to Cross-Architecture KD (CAKD), where the knowledge of homogeneous and heterogeneous teacher…

2025

LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating

ACL 2025long

Large vision language models (LVLMs) have improved the document understanding capabilities remarkably, enabling the handling of complex document elements, longer contexts, and a wider range of tasks. However, existing document understanding benchmarks have been limited to handling only a small numbe…

2025

MERIT: Multilingual Semantic Retrieval with Interleaved Multi-Condition Query

NeurIPS 2025poster

Semantic retrieval is crucial for modern applications yet remains underexplored in current research. Existing datasets are limited to single languages, single images, or singular retrieval conditions, often failing to fully exploit the expressive capacity of visual information as evidenced by maint…

Cited by 0SourcecodeScholar
2025

Multi-Agent Motion Forecasting via Mixed Supervision

RA-L 2025

Accurate motion forecasting is critical for safe decision-making in autonomous driving. Existing methods lack explicit supervision during the generation of multimodal candidate trajectories, which leads to inconsistent candidate quality and difficulty balancing trajectory diversity with scene adapta

Cited by 1SourcecodeScholar
2025

Multimodal Deformation Estimation of Soft Pneumatic Gripper During Operation

IROS 2025

Soft pneumatic robots are gaining significant attention due to their compliance and adaptability in unstructured environments. While emerging dual-chamber soft pneumatic robots can achieve complex 3D deformations beyond conventional single-axis bending, real-time proprioception remains challenging d

Cited by 0SourceScholar
2025

MyoChallenge 2024: A New Benchmark for Physiological Dexterity and Agility in Bionic Humans

NeurIPS 2025poster

Recent advancements in bionic prosthetic technology offer transformative opportunities to restore mobility and functionality for individuals with missing limbs. Users of bionic limbs, or bionic humans, learn to seamlessly integrate prosthetic extensions into their motor repertoire, regaining critica…

Cited by 0SourceScholar
2025

OneForecast: A Universal Framework for Global and Regional Weather Forecasting

ICML 2025poster

Accurate weather forecasts are important for disaster prevention, agricultural planning, etc. Traditional numerical weather prediction (NWP) methods offer physically interpretable high-accuracy predictions but are computationally expensive and fail to fully leverage rapidly growing historical data.…

2025

ProbMED: A Probabilistic Framework for Medical Multimodal Binding

ICCV 2025poster

Medical decision-making requires integrating diverse medical information, from imaging to clinical narratives. These medical modalities are often acquired in a many-to-many manner. However, current medical vision-language pretraining models (Med-VLPMs) fail to directly account for this many-to-many…

2025

Reinforcement Learning for Charged Particle Beam Control to Minimize Injection Mismatch in Particle Accelerators

ICASSP 2025accepted

Particle accelerators are composed of various components, and their properties are finely tuned to optimize certain particle beam qualities as they accelerate. In particular, particle colliders like the Relativistic Heavy Ion Collider (RHIC) at Brookhaven National Lab (BNL) are interested in maximiz…

Cited by 0SourceScholar
2025

Towards Faster Decentralized Stochastic Optimization with Communication Compression

ICLR 2025poster

Communication efficiency has garnered significant attention as it is considered the main bottleneck for large-scale decentralized Machine Learning applications in distributed and federated settings. In this regime, clients are restricted to transmitting small amounts of compressed information to the…

2024

A Novel Two-step Fine-tuning Framework for Transfer Learning in Low-Resource Neural Machine Translation

NAACL 2024findings

Existing transfer learning methods for neural machine translation typically use a well-trained translation model (i.e., a parent model) of a high-resource language pair to directly initialize a translation model (i.e., a child model) of a low-resource language pair, and the child model is then fine-…

Cited by 6SourcePDFScholar
2024

ADHD Diagnosis and Biomarker Detection Based on Multimodal Graph Convolutional Neural Network

ICASSP 2024accepted

In this study, we apply a graph convolutional network (GCN) in attention deficit hyperactivity disorder (ADHD) classification by using multimodal data. Here, multimodal data is integrated to construct a dual graph for leveraging the modality information. Then, a GCN learning model is performed withi…

Cited by 0SourceScholar
2024

Anchor-based Robust Finetuning of Vision-Language Models

CVPR 2024poster

We aim at finetuning a vision-language model without hurting its out-of-distribution (OOD) generalization. We address two types of OOD generalization i.e. i) domain shift such as natural to sketch images and ii) zero-shot capability to recognize the category that was not contained in the finetune da…

Cited by 9SourcePDFScholar
2024

Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost

ICLR 2024poster

We aim at exploiting additional auxiliary labels from an independent (auxiliary) task to boost the primary task performance which we focus on, while preserving a single task inference cost of the primary task. While most existing auxiliary learning methods are optimization-based relying on loss weig…

2024

DMTG: One-Shot Differentiable Multi-Task Grouping

ICML 2024poster

We aim to address Multi-Task Learning (MTL) with a large number of tasks by Multi-Task Grouping (MTG). Given $N$ tasks, we propose to **simultaneously identify the best task groups from $2^N$ candidates and train the model weights simultaneously in one-shot**, with **the high-order task-affinity ful…

2024

DeMatch: Deep Decomposition of Motion Field for Two-View Correspondence Learning

CVPR 2024poster

Two-view correspondence learning has recently focused on considering the coherence and smoothness of the motion field between an image pair. Dominant schemes include controlling the complexity of the field function with regularization or smoothing the field with local filters but the former suffers…

2024

Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question Answering

COLING 2024main

Open Domain Multi-Hop Question Answering (ODMHQA) plays a crucial role in Natural Language Processing (NLP) by aiming to answer complex questions through multi-step reasoning over retrieved information from external knowledge sources. Recently, Large Language Models (LLMs) have demonstrated remarkab…

2024

EControl: Fast Distributed Optimization with Compression and Error Control

ICLR 2024poster

Modern distributed training relies heavily on communication compression to reduce the communication overhead. In this work, we study algorithms employing a popular class of contractive compressors in order to reduce communication overhead. However, the naive implementation often leads to unstable co…

Cited by 10SourcePDFScholar
2024

Efficient Active Domain Adaptation for Semantic Segmentation by Selecting Information-rich Superpixels

ECCV 2024oral

"Unsupervised Domain Adaptation (UDA) for semantic segmentation has been widely studied to exploit the label-rich source data to assist the segmentation of unlabeled samples on target domain. Despite these efforts, UDA performance remains far below that of fully-supervised model owing to the lack of…

2024

Efficient Denoising Diffusion via Probabilistic Masking

ICML 2024poster

Diffusion models have exhibited remarkable advancements in generating high-quality data. However, a critical drawback is their computationally intensive inference process, which requires a large number of timesteps to generate a single sample. Existing methods address this challenge by decoupling th…

Cited by 1SourcePDFScholar
2024

Enhancing Two-Stage Finetuning for Speech Emotion Recognition Using Adapters

ICASSP 2024accepted

This study investigates the effective finetuning of a pretrained model using adapters for speech emotion recognition (SER). Since emotion is related with linguistic and prosodic information and also other attributes such as gender and speaking style, a framework of multi-task learning (MTL) has been…

Cited by 0SourceScholar
2024

Enhancing Vision-Language Pre-training with Rich Supervisions

CVPR 2024highlight

We propose Strongly Supervised pre-training with ScreenShots (S4) - a novel pre-training paradigm for Vision-Language Models using data from large-scale web screenshot rendering. Using web screenshots unlocks a treasure trove of visual and textual cues that are not present in using image-text pairs.…

Cited by 10SourcePDFScholar
2024

High-Accuracy Anxiety Disorder Identification Through Subspace-Enhanced Hypergraph Neural Network

ICASSP 2024accepted

We propose a subspace-enhanced hypergraph neural network (seHGNN) for classifying anxiety disorder (AD). By leveraging a learnable incidence matrix, seHGNN strengthens the influence of hyperedges in graphs and enhances feature extraction performance of HGNNs. Then, we conduct this model within an ex…

Cited by 0SourceScholar
2024

Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation

CVPR 2024poster

Category-level 6D object pose estimation aims to estimate the rotation translation and size of unseen instances within specific categories. In this area dense correspondence-based methods have achieved leading performance. However they do not explicitly consider the local and global geometric inform…

2024

Locality Preserving Refinement for Shape Matching with Functional Maps

AAAI 2024technical

In this paper, we address the nonrigid shape matching with outliers by a novel and effective pointwise map refinement method, termed Locality Preserving Refinement. For accurate pointwise conversion from a given functional map, our method formulates a two-step procedure. Firstly, starting with noisy…

2024

Meta-Reinforcement Learning Based Cooperative Surface Inspection of 3D Uncertain Structures using Multi-robot Systems

ICRA 2024poster

This paper presents a decentralized cooperative motion planning approach for surface inspection of 3D structures which includes uncertainties like size, number, shape, position, using multi-robot systems (MRS). Given that most of existing works mainly focus on surface inspection of single and fully…

Cited by 1SourceScholar
2024

OneRestore: A Universal Restoration Framework for Composite Degradation

ECCV 2024poster

"In real-world scenarios, image impairments often manifest as composite degradations, presenting a complex interplay of elements such as low light, haze, rain, and snow. Despite this reality, existing restoration methods typically target isolated degradation types, thereby falling short in environme…

2024

SD2Event:Self-supervised Learning of Dynamic Detectors and Contextual Descriptors for Event Cameras

CVPR 2024poster

Event cameras offer many advantages over traditional frame-based cameras such as high dynamic range and low latency. Therefore event cameras are widely applied in diverse computer vision applications where event-based keypoint detection is a fundamental task. However achieving robust event-based key…

Cited by 6SourcePDFScholar
2024

Towards Neuron Attributions in Multi-Modal Large Language Models

NeurIPS 2024poster

As Large Language Models (LLMs) demonstrate impressive capabilities, demystifying their internal mechanisms becomes increasingly vital. Neuron attribution, which attributes LLM outputs to specific neurons to reveal the semantic properties they learn, has emerged as a key interpretability approach. H…

Cited by 3SourcePDFScholar
2024

Transformable Inspection Robot Design and Implementation for Complex Pipeline Environment

RA-L 2024

Pipeline inspections are crucial to ensure the reliability of the transmission system. However, with the growing complexity and aging of the pipe system, traditional pipeline inspection robots struggle to adapt to complex environments with obstacles, cracks, changing cross-section, and other challen

Cited by 6SourceScholar
2024

Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding

ICML 2024poster

The vast applications of deep generative models are anchored in three core capabilities---*generating* new instances, *reconstructing* inputs, and learning compact *representations*---across various data types, such as discrete text/protein sequences and continuous images. Existing model families, l…

2024

VideoTetris: Towards Compositional Text-to-Video Generation

NeurIPS 2024poster

Diffusion models have demonstrated great success in text-to-video (T2V) generation. However, existing methods may face challenges when handling complex (long) video generation scenarios that involve multiple objects or dynamic changes in object numbers. To address these limitations, we propose Video…

2024

Vision-Language Model-based Physical Reasoning for Robot Liquid Perception

IROS 2024poster

There is a growing interest in applying large language models (LLMs) in robotic tasks, due to their remarkable reasoning ability and extensive knowledge learned from vast training corpora. Grounding LLMs in the physical world remains an open challenge as they can only process textual input. Recent a…

Cited by 6SourceScholar
2023

ADHD Classification with Biomarker Identification Using a Triplet Loss Attention Auto-Encoding Network

ICASSP 2023accepted

Deep learning methods have been widely applied in Attention Deficit Hyperactivity Disorder (ADHD) classification in the past decade due to their effective learned features. However, these features are lack of neurobiological meanings and hard to be biomarkers. Here, we proposed an attention auto-enc…

Cited by 0SourceScholar
2023

D2Former: Jointly Learning Hierarchical Detectors and Contextual Descriptors via Agent-Based Transformers

CVPR 2023highlight

Establishing pixel-level matches between image pairs is vital for a variety of computer vision applications. However, achieving robust image matching remains challenging because CNN extracted descriptors usually lack discriminative ability in texture-less regions and keypoint detectors are only good…

Cited by 10SourcePDFScholar
2023

Evaluating Post-hoc Explanations for Graph Neural Networks via Robustness Analysis

NeurIPS 2023oral

This work studies the evaluation of explaining graph neural networks (GNNs), which is crucial to the credibility of post-hoc explainability in practical usage. Conventional evaluation metrics, and even explanation methods -- which mainly follow the paradigm of feeding the explanatory subgraph and me…

Cited by 36SourcePDFScholar
2023

Exploit Domain-Robust Optical Flow in Domain Adaptive Video Semantic Segmentation

AAAI 2023technical

Domain adaptive semantic segmentation aims to exploit the pixel-level annotated samples on source domain to assist the segmentation of unlabeled samples on target domain. For such a task, the key is to construct reliable supervision signals on target domain. However, existing methods can only provid…

2023

Fast and Interpretable Dynamics for Fisher Markets via Block-Coordinate Updates

AAAI 2023technical

We consider the problem of large-scale Fisher market equilibrium computation through scalable first-order optimization methods. It is well-known that market equilibria can be captured using structured convex programs such as the Eisenberg-Gale and Shmyrev convex programs. Highly performant determini…

Cited by 3SourcePDFScholar
2023

Inferring Hybrid Neural Fluid Fields from Videos

NeurIPS 2023poster

We study recovering fluid density and velocity from sparse multiview videos. Existing neural dynamic reconstruction methods predominantly rely on optical flows; therefore, they cannot accurately estimate the density and uncover the underlying velocity due to the inherent visual ambiguities of fluid…

Cited by 16SourcePDFScholar
2023

On Prefix-tuning for Lightweight Out-of-distribution Detection

ACL 2023long

Out-of-distribution (OOD) detection, a fundamental task vexing real-world applications, has attracted growing attention in the NLP community. Recently fine-tuning based methods have made promising progress. However, it could be costly to store fine-tuned models for each scenario. In this paper, we d…

Cited by 9SourcePDFScholar
2022

AB-Mapper: Attention and BicNet based Multi-agent Path Planning for Dynamic Environment

IROS 2022poster

Multi-agent path finding in dynamic environments is of great academic and practical value for multi-robot systems in the real world. To improve the effectiveness and efficiency of the learning process during path planning in dynamic environments, we introduce an algorithm called Attention and BicNet…

Cited by 14SourceScholar
2022

Abnormal Occupancy Grid Map Recognition using Attention Network

ICRA 2022poster

The occupancy grid map is a critical component of autonomous positioning and navigation in the mobile robotic system, as many other systems' performance depends heavily on it. To guarantee the quality of the occupancy grid maps, researchers previously had to perform tedious manual recognition for a…

Cited by 4SourcecodeScholar
2022

Domain-Invariant Feature Learning for Cross Corpus Speech Emotion Recognition

ICASSP 2022accepted

To deal with speech emotion recognition (SER) in real-life applications, researchers have to focus on cross corpus SER, where the feature distribution of source and target datasets are different. In this paper, we propose an efficient domain adversarial training method to cope with the non-affective…

Cited by 0SourceScholar
2022

Finding Dynamics Preserving Adversarial Winning Tickets

AISTATS 2022poster

Modern deep neural networks (DNNs) are vulnerable to adversarial attacks and adversarial training has been shown to be a promising method for improving the adversarial robustness of DNNs. Pruning methods have been considered in adversarial context to reduce model capacity and improve adversarial rob…

2022

LAPO: Latent-Variable Advantage-Weighted Policy Optimization for Offline Reinforcement Learning

NeurIPS 2022accept

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new samples. This setting is particularly well-suited for continuous control robotic applications for which online data collection based on trial-and…

Cited by 25SourcePDFScholar
2022

Multilevel Hierarchical Network with Multiscale Sampling for Video Question Answering

IJCAI 2022poster

Video question answering (VideoQA) is challenging given its multimodal combination of visual understanding and natural language processing. While most existing approaches ignore the visual appearance-motion information at different temporal scales, it is unknown how to incorporate the multilevel pro…

2022

Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmap

CVPR 2022poster

As a rising task, panoptic segmentation is faced with challenges in both semantic segmentation and instance segmentation. However, in terms of speed and accuracy, existing LiDAR methods in the field are still limited. In this paper, we propose a fast and high-performance LiDAR-based framework, refer…

Cited by 68PDFScholar
2022

Semi-Supervised Video Semantic Segmentation With Inter-Frame Feature Reconstruction

CVPR 2022poster

One major challenge for semantic segmentation in real-world scenarios is only limited pixel-level labels available due to high expense of human labor though a vast volume of video data is provided. Existing semi-supervised methods attempt to exploit unlabeled data in model training, but they just re…

Cited by 16PDFcodeScholar
2022

Towards Autonomous Atlas-Based Ultrasound Acquisitions in Presence of Articulated Motion

RA-L 2022

Robotic ultrasound (US) imaging aims at overcoming some of the limitations of free-hand US examinations, e.g. difficulty in guaranteeing intra- and inter-operator repeatability. However, due to anatomical and physiological variations between patients and relative movement of anatomical substructures

Cited by 36SourcecodeScholar
2022

VesNet-RL: Simulation-Based Reinforcement Learning for Real-World US Probe Navigation

RA-L 2022

Ultrasound (US) is one of the most common medical imaging modalities since it is radiation-free, low-cost, and real-time. In freehand US examinations, sonographers often navigate a US probe to visualize standard examination planes with rich diagnostic information. However, reproducibility and stabil

Cited by 53SourcecodeScholar
2021

Domain-Adversarial Autoencoder with Attention Based Feature Level Fusion for Speech Emotion Recognition

ICASSP 2021accepted

Over the past two decades, although speech emotion recognition (SER) has garnered considerable attention, the problem of insufficient training data has been unresolved. A potential solution for this problem is to pre-train a model and transfer knowledge from large amounts of audio data. However, the…

Cited by 0SourceScholar
2021

FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentation

IROS 2021poster

The RGB-Thermal (RGB-T) information for semantic segmentation has been extensively explored in recent years. However, most existing RGB-T semantic segmentation usually compromises spatial resolution to achieve real-time inference speed, which leads to poor performance. To better extract detail spati…

Cited by 134SourcecodeScholar
2021

Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation

ICCV 2021poster

Unsupervised disentanglement learning is a crucial issue for understanding and exploiting deep generative models. Recently, SeFa tries to find latent disentangled directions by performing SVD on the first projection of a pre-trained GAN. However, it is only applied to the first layer and works in a…

Cited by 72PDFcodeScholar
2021

Temporal Cue Guided Video Highlight Detection With Low-Rank Audio-Visual Fusion

ICCV 2021poster

Video highlight detection plays an increasingly important role in social media content filtering, however, it remains highly challenging to develop automated video highlight detection methods because of the lack of temporal annotations (i.e., where the highlight moments are in long videos) for super…

Cited by 61PDFScholar
2020

50 Benchmarks for Anthropomorphic Hand Function-based Dexterity Classification and Kinematics-based Hand Design

IROS 2020poster

Robotic hands with anthropomorphism considerations are of prominent popularity in human-centered environment. Existing anthropomorphic robotic hands achieving part or most of human hand comparable dexterity have been applied as various robotic end-effectors and prosthetics. However, two deficiencies…

Cited by 11SourceScholar
2020

Graph-PCNN: Two Stage Human Pose Estimation with Graph Pose Refinement

ECCV 2020poster

Recently, most of the state-of-the-art human pose estimation methods are based on heatmap regression. The final coordinates of keypoints are obtained by decoding heatmap directly. In this paper, we aim to find a better approach to get more accurate localization results. We mainly put forward two sug…

Cited by 117SourcePDFScholar
2020

LineSpyX: A Power Line Inspection Robot Based on Digital Radiography

RA-L 2020

Most of the current power line inspection robots use cameras and LiDARs to inspect the power line surfaces and the surrounding environment. But it is still difficult to detect the internal defects of the power lines. In this letter, the design and implementation of LineSpyX, a novel power line inspe

Cited by 48SourceScholar
2020

MTL-NAS: Task-Agnostic Neural Architecture Search Towards General-Purpose Multi-Task Learning

CVPR 2020poster

We propose to incorporate neural architecture search (NAS) into general-purpose multi-task learning (GP-MTL). Existing NAS methods typically define different search spaces according to different tasks. In order to adapt to different task combinations (i.e., task sets), we disentangle the GP-MTL netw…

Cited by 109PDFcodeScholar
2020

Stochastic Flows and Geometric Optimization on the Orthogonal Group

ICML 2020poster

We present a new class of stochastic, geometrically-driven optimization algorithms on the orthogonal group O(d) and naturally reductive homogeneous manifolds obtained from the action of the rotation group SO(d). We theoretically and experimentally demonstrate that our methods can be applied in vario…

Cited by 9SourcePDFScholar
2019

Deep Generative Learning via Variational Gradient Flow

ICML 2019oral

We propose a framework to learn deep generative models via \textbf{V}ariational \textbf{Gr}adient Fl\textbf{ow} (VGrow) on probability spaces. The evolving distribution that asymptotically converges to the target distribution is governed by a vector field, which is the negative gradient of the first…

2019

Face Anti-Spoofing: Model Matters, so Does Data

CVPR 2019poster

Face anti-spoofing is an important task in full-stack face applications including face detection, verification, and recognition. Previous approaches build models on datasets which do not simulate the real-world data well (e.g., small scale, insignificant variance, etc.). Existing models may rely on…

Cited by 302PDFScholar
2019

Fast Adaptation with Meta-Reinforcement Learning for Trust Modelling in Human-Robot Interaction

IROS 2019poster

In socially assistive robotics, an important research area is the development of adaptation techniques and their effect on human-robot interaction. We present a meta-learning based policy gradient method for addressing the problem of adaptation in human-robot interaction and also investigate its rol…

Cited by 33SourceScholar
2019

NDDR-CNN: Layerwise Feature Fusing in Multi-Task CNNs by Neural Discriminative Dimensionality Reduction

CVPR 2019poster

In this paper, we propose a novel Convolutional Neural Network (CNN) structure for general-purpose multi-task learning (MTL), which enables automatic feature fusing at every layer from different tasks. This is in contrast with the most widely used MTL CNN structures which empirically or heuristicall…

Cited by 347PDFcodeScholar
2017

Exploiting Symmetry and/or Manhattan Properties for 3D Object Structure Estimation From Single and Multiple Images

CVPR 2017poster

Many man-made objects have intrinsic symmetries and Manhattan structure. By assuming an orthographic projection model, this paper addresses the estimation of 3D structures and camera projection using symmetry and/or Manhattan structure cues, which occur when the input is single- or multiple-image fr…

Cited by 49PDFScholar
2016

Joint transceiver designs for secure communications over MIMO relay

ICASSP 2016accepted

This paper addresses the transceiver design problem for secure downlink communications over a multiple-input multiple-output (MIMO) relay system in the presence of multiple eavesdroppers. A new algorithm based on alternating optimization (AO) is first proposed to maximize the signal-to-noise ratio (…

Cited by 0SourceScholar