← Search

Yifan Wang

131 accepted papers

2026

$\pi^3$: Permutation-Equivariant Visual Geometry Learning

ICLR 2026poster

We introduce $\pi^3$, a feed-forward neural network that offers a novel approach to visual geometry reconstruction, breaking the reliance on a conventional fixed reference view. Previous methods often anchor their reconstructions to a designated viewpoint, an inductive bias that can lead to instabil…

Cited by 0SourcecodeScholar
2026

Autonomous Robotic Bone Micro-Milling System With Automatic Calibration and 3D Surface Fitting

RA-L 2026

Automating bone micro-milling using a robotic system presents challenges due to the uncertainties in both the external and internal features of bone tissue. For example, during mouse cranial window creation, a circular path with a radius of 2 to 4 mm needs to be milled on the mouse skull using a mic

Cited by 0SourceScholar
2026

BEACON: Budget-Efficient Discovery of Policy Violations in Large Language Models via Cognitive-Guided Monte Carlo Tree Search

IJCAI 2026

Systematic safety evaluation of large language models must uncover diverse policy violations under tight query budgets. However, most red-teaming methods optimize attack success rate and repeatedly probe a narrow set of vulnerabilities, yielding redundant failures and leaving rarer yet critical viol

Cited by 0Scholar
2026

BraSTORM: A Dual-Branch Self-Supervised Framework for EEG Representation Learning via Input-Level Spatio-Temporal Decomposition

AAAI 2026technical

Prevalent pre-training strategies for Brain-Computer Interfaces (BCIs) are often constrained by spatio-temporal entanglement. This critical issue arises from processing multi-channel Electroencephalography (EEG) signals as monolithic sequences, which intertwines the signal

Cited by 0SourcePDFScholar
2026

Bridging Fairness and Explainability: Can Input-Based Explanations Promote Fairness in Hate Speech Detection?

ICLR 2026poster

Natural language processing (NLP) models often replicate or amplify social bias from training data, raising concerns about fairness. At the same time, their black-box nature makes it difficult for users to recognize biased predictions and for developers to effectively mitigate them. While some studi…

Cited by 1SourcecodeScholar
2026

CELL: A Causal Perspective for Fairness-aware Graph Adaptation

ICML 2026poster

This paper investigates fairness-aware graph adaptation, aiming to transfer knowledge from a labeled source graph to an unlabeled target graph while explicitly accounting for fairness. Most prior methods rely on adversarial learning to learn invariant graph representations of sensitive attributes. H…

Cited by 0SourceScholar
2026

CLINIC: Towards High-quality Graph Out-Of-Distribution Detection

ICML 2026poster

This paper studies the problem of graph out-of-distribution (OOD) detection, which aims to identify anomaly graphs out of a graph dataset. Prior efforts usually focus on the utilization of topological structures with unsupervised graph learning to foster typical pattern recognition, which overlooks …

Cited by 0SourceScholar
2026

CSRv2: Unlocking Ultra-Sparse Embeddings

ICLR 2026poster

In the era of large foundation models, the quality of embeddings has become a central determinant of downstream task performance and overall system capability. Yet widely used dense embeddings are often extremely high-dimensional (e.g., 4096), incurring substantial costs in storage, memory, and inf…

Cited by 0SourcecodeScholar
2026

CURE: Context-driven Diffusion with Progressive Expansion for Single Domain Generalization in Time Series Classification

ICML 2026poster

This paper studies the problem of single domain generalization in time series classification, which aims to learn a generalized time series classification model using a single source domain. This problem is highly challenging due to unreliable supervision from domain scarcity. Although current appro…

Cited by 0SourceScholar
2026

Compactness and Consistency: A Conjoint Framework for Deep Graph Clustering

ICLR 2026oral

Graph clustering is a fundamental task in data analysis, aiming at grouping nodes with similar characteristics in the graph into clusters. This problem has been widely explored using graph neural networks (GNNs) due to their ability to leverage node attributes and graph topology for effective cluste…

Cited by 0SourcecodeScholar
2026

Conformalized Hierarchical Calibration for Uncertainty-Aware Adaptive Hashing

ICLR 2026poster

Unsupervised domain adaptive hashing transfers knowledge from labeled source domains to unlabeled target domains, addressing domain shift challenges in real-world retrieval tasks. Existing methods face two critical limitations: target domain noise severely misleads model training, and indiscriminate…

Cited by 0SourceScholar
2026

DRIFT: Learning from Abundant User Dissatisfaction in Real-World Preference Learning

ICLR 2026poster

Real-world large language model deployments (e.g., conversational AI systems, code generation assistants) naturally generate abundant implicit user dissatisfaction (DSAT) signals, as users iterate toward better answers through refinements, corrections, and expressed preferences, while explicit satis…

Cited by 0SourceScholar
2026

Dynamic Multi-sample Mixup with Gradient Exploration for Open-set Graph Anomaly Detection

ICLR 2026poster

This paper studies the problem of open-set graph anomaly detection, which aims to generalize a graph neural network (GNN) trained with a small number of both normal and abnormal nodes to detect unseen anomalies different from training anomalies during inference. This problem is highly challenging du…

Cited by 0SourceScholar
2026

Efficient Time Series Clustering from Multiscale Reservoir Dynamics with Granular-Ball Anchoring Graph Optimization

IJCAI 2026

Time-series clustering remains challenging due to the inherent trade-off between clustering effectiveness and computational efficiency. Similarity-based methods often suffer from quadratic complexity caused by pairwise distance computations, while deep learning–based approaches typically rely on cos

Cited by 0Scholar
2026

Evidence-aware Integration and Domain Identification of Spatial Transcriptomics Data

AAAI 2026technical

Spatial transcriptomics (ST) enables joint profiling of gene expression and spatial positions, thereby revealing spatially resolved biological functions. However, many existing ST analysis methods often fail to explicitly quantify the belief and uncertainty in decisions caused by noisy ST data, maki

Cited by 0SourcePDFScholar
2026

Evolutionary Multimodal Reasoning via Hierarchical Semantic Representation for Intent Recognition

CVPR 2026

Multimodal intent recognition aims to infer human intents by jointly modeling various modalities, playing a pivotal role in real-world dialogue systems. However, current methods struggle to model hierarchical semantics underlying complex intents and lack the capacity for self-evolving reasoning over

Cited by 0SourcecodeScholar
2026

FairGC: Fostering Individual and Group Fairness for Deep Graph Clustering

AAAI 2026technical

The widespread adoption of graph neural networks (GNNs) has brought increased attention to fairness issues related to sensitive attributes, such as gender and race, in practical scenarios. However, this concern remains largely unexplored in the context of graph clustering. Conventional fair graph cl

Cited by 0SourcePDFScholar
2026

G$^2$VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning

CVPR 2026

Vision-Language Models (VLMs) still lack robustness in spatial intelligence, demonstrating poor performance on spatial understanding and reasoning tasks. We attribute this gap to the absence of a visual geometry learning process capable of reconstructing 3D space from 2D images. We present G^2VLM, a

Cited by 0SourcecodeScholar
2026

GAM-RAG: Gain-Adaptive Memory for Evolving Retrieval in Retrieval-Augmented Generation

ICML 2026poster

Retrieval-Augmented Generation (RAG) grounds large language models with external evidence, but many implementations rely on pre-built indices that remain static after construction. Related queries therefore repeat similar multi-hop traversal, increasing latency and compute. Motivated by \emph{schema…

Cited by 0SourceScholar
2026

GmNet: Revisiting Gating Mechanisms From A Frequency View

ICLR 2026poster

Lightweight neural networks, essential for on-device applications, often suffer from a low-frequency bias due to their constrained capacity and depth. This limits their ability to capture the fine-grained, high-frequency details (e.g., textures, edges) that are crucial for complex computer vision t…

Cited by 0SourceScholar
2026

HGOOD: Hypergraph-enhanced Graph Contrastive Learning for Graph Out-of-Distribution Detection

IJCAI 2026

With the increasing application of graph learning advanced by deep learning, out-of-distribution (OOD) detection for graph-structured data has become an imperative challenge in the real world. Graph neural networks (GNNs) provide a promising solution for OOD detection. However, GNNs' core message-pa

Cited by 0Scholar
2026

HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles

CVPR 2026

Controllable driving scene generation is critical for realistic and scalable autonomous driving simulation, yet existing approaches struggle to jointly achieve photorealism and precise control. We introduce HorizonForge, a unified framework that reconstructs scenes as editable Gaussian Splats and Me

Cited by 0SourceScholar
2026

Identifying and Correcting Label Noise for Robust GNNs via Influence Contradiction

ICML 2026poster

Graph Neural Networks (GNNs) have shown remarkable capabilities in learning from graph-structured data with various applications such as social analysis and bioinformatics. However, the presence of label noise in real scenarios poses a significant challenge in learning robust GNNs, and their effecti…

Cited by 0SourceScholar
2026

Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams

ICML 2026poster

We introduce UCS-Bench, a dataset spanning 170+ hours of egocentric visual observations with 7K+ timestamped questions for diagnosing User-centric Continual Spatial intelligence in egocentric video streams. UCS-Bench targets a new problem that emphasizes dynamic spatial reasoning, long-term memory, …

Cited by 0SourceScholar
2026

Let EEG Models Learn EEG

ICML 2026poster

High-fidelity EEG generation is critical for alleviating data scarcity and addressing privacy constraints in large-scale neural modeling. Despite recent progress, most existing approaches formulate EEG generation via discrete denoising objectives, which inadequately reflect the inherently continuous…

Cited by 0SourceScholar
2026

MdaIF: Robust One-Stop Multi-Degradation-Aware Image Fusion with Language-Driven Semantics

AAAI 2026technical

Infrared and visible image fusion aims to integrate complementary multi-modal information into a single fused result. However, existing methods 1) fail to account for the degradation visible images under adverse weather conditions, thereby compromising fusion performance; and 2) rely on fixed networ

Cited by 0SourcePDFScholar
2026

OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling

ICLR 2026poster

The field of 4D world modeling—aiming to jointly capture spatial geometry and temporal dynamics—has witnessed remarkable progress in recent years, driven by advances in large-scale generative models and multimodal learning. However, the development of truly general 4D world models remains fundamen…

Cited by 0SourcecodeScholar
2026

ReSeek: A Self-Correcting Framework for Search Agents with Instructive Rewards

ICML 2026poster

Search agents powered by Large Language Models have demonstrated significant potential in tackling knowledge-intensive tasks. Reinforcement learning has emerged as a powerful paradigm for training these agents to perform complex, multi-step reasoning. However, prior RL-based methods often rely on sp…

Cited by 0SourceScholar
2026

SPAN: Spatial-Projection Alignment for Monocular 3D Object Detection

CVPR 2026

Existing monocular 3D detectors typically tame the pronounced nonlinear regression of 3D bounding box through decoupled prediction paradigm, which employs multiple branches to estimate geometric center, depth, dimensions, and rotation angle separately.Although this decoupling strategy simplifies the

Cited by 0SourceScholar
2026

TAPO: Dynamic Teacher and Perturbed Answer Injection for Policy Optimization

AAAI 2026technical

Reinforcement learning (RL) has emerged as a powerful framework to improve the reasoning performance of large language models (LLMs), with approaches such as Group Relative Policy Optimization (GRPO) showing promising results. However, GRPO and its variants struggle with collapsed groups (i.e., all-

Cited by 0SourcePDFScholar
2026

The Geometry of Reasoning: Self-Evaluation via Layerwise Trajectory Evolution

ICML 2026poster

Large Reasoning Models (LRMs) enhance performance by generating explicit Chain-of-Thought (CoT) trajectories, yet enabling them to self-evaluate correctness without external supervision remains a critical challenge. Existing methods often rely on ground-truth labels or shallow output probabilities, …

Cited by 0SourceScholar
2026

WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool

ICLR 2026poster

We present WinT3R, a feed-forward reconstruction model capable of online prediction of precise camera poses and high-quality point maps. Previous methods suffer from a trade-off between reconstruction quality and real-time performance. To address this, we first introduce a sliding window mechanism t…

Cited by 0SourcecodeScholar
2026

scGTN: Deep Siamese Graph Transformer Network for Single-cell RNA Sequencing Clustering

IJCAI 2026

Single-cell RNA sequencing (scRNA-seq) serves a pivotal role in characterizing gene expression at the cellular level, enabling the identification of cell types and advancing the understanding of cellular heterogeneity. Despite the significant progress in scRNA-seq data clustering, we argue that curr

Cited by 0Scholar
2025

A Human-in-the-Loop Simulation Framework for Evaluating Control Strategies in Gait Assistive Robots

ICRA 2025

As the global population ages, effective rehabilitation and mobility aids will become increasingly critical. Gait assistive robots are promising solutions, but designing adaptable controllers for various impairments poses a significant challenge. This paper presented a Human-In-The-Loop (HITL) simul

Cited by 0SourceScholar
2025

A Survey on Efficient Large Language Model Training: From Data-centric Perspectives

ACL 2025long

Post-training of Large Language Models (LLMs) is crucial for unlocking their task generalization potential and domain-specific capabilities. However, the current LLM post-training paradigm faces significant data challenges, including the high costs of manual annotation and diminishing marginal retur…

2025

Aether: Geometric-Aware Unified World Modeling

ICCV 2025poster

The integration of geometric reconstruction and generative modeling remains a critical challenge in developing AI systems capable of human-like spatial reasoning. This paper proposes Aether, a unified framework that enables geometry-aware reasoning in world models by jointly optimizing three core ca…

Cited by 0SourcePDFScholar
2025

Aligning Composed Query with Image via Discriminative Perception from Negative Correspondences

AAAI 2025technical

The task of composed image retrieval aims to match the multi-modal query composed of a reference image and a modification sentence with the target image. Most current approaches narrow the distances between the composed queries and targets by investigating matched correspondences in positive triplet…

Cited by 0SourcePDFScholar
2025

CESRec: Constructing Pseudo Interactions for Sequential Recommendation via Conversational Feedback

EMNLP 2025

Sequential Recommendation Systems (SRS) have become essential in many real-world applications. However, existing SRS methods often rely on collaborative filtering signals and fail to capture real-time user preferences, while Conversational Recommendation Systems (CRS) excel at eliciting immediate in

2025

DAAC: Discrepancy-Aware Adaptive Contrastive Learning for Medical Time series

NeurIPS 2025poster

Medical time-series data play a vital role in disease diagnosis but suffer from limited labeled samples and single-center bias, which hinder model generalization and lead to overfitting. To address these challenges, we propose DAAC (Discrepancy-Aware Adaptive Contrastive learning), a learnable multi…

Cited by 0SourcecodeScholar
2025

DANCE: Dual Unbiased Expansion with Group-acquired Alignment for Out-of-distribution Graph Fairness Learning

ICML 2025poster

Graph neural networks (GNNs) have shown strong performance in graph fairness learning, which aims to ensure that predictions are unbiased with respect to sensitive attributes. However, existing approaches usually assume that training and test data share the same distribution, which rarely holds in t…

Cited by 0SourcePDFScholar
2025

DisCo: Graph-Based Disentangled Contrastive Learning for Cold-Start Cross-Domain Recommendation

AAAI 2025technical

Recommender systems are widely used in various real-world applications, but they often encounter the persistent challenge of the user cold-start problem. Cross-domain recommendation (CDR), which leverages user interactions from one domain to improve prediction performance in another, has emerged as…

2025

Discovering Influential Neuron Path in Vision Transformers

ICLR 2025poster

Vision Transformer models exhibit immense power yet remain opaque to human understanding, posing challenges and risks for practical applications. While prior research has attempted to demystify these models through input attribution and neuron role analysis, there's been a notable gap in considerin…

2025

Dual Prototype-Enhanced Contrastive Framework for Class-Imbalanced Graph Domain Adaptation

NeurIPS 2025poster

Graph transfer learning, especially in unsupervised domain adaptation, aims to transfer knowledge from a label-abundant source graph to an unlabeled target graph. However, most existing approaches overlook the common issue of label imbalance in the source domain, typically assuming a balanced label…

Cited by 0SourcecodeScholar
2025

EIC Framework for Hand Exoskeletons Based on a Multimodal Large Language Model

IROS 2025

Current hand exoskeleton interaction methods primarily focus on recognizing a limited range of hand motion intentions and rely on pre-programmed control to execute predefined commands. However, these approaches face significant limitations when confronted with unanticipated or non-predefined scenari

Cited by 1SourceScholar
2025

Enhancing Large Language Model Performance with Gradient-Based Parameter Selection

AAAI 2025technical

Large language models (LLMs) have revolutionized numerous fields of research, driving significant advancements in natural language processing, machine translation, and beyond. Although the extensive number of parameters contributes a lot to the great success, existing studies indicate that not all m…

Cited by 0SourcePDFScholar
2025

FreeTimeGS: Free Gaussian Primitives at Anytime Anywhere for Dynamic Scene Reconstruction

CVPR 2025poster

This paper addresses the challenge of reconstructing dynamic 3D scenes with complex motions. Some recent works define 3D Gaussian primitives in the canonical space and use deformation fields to map canonical primitives to observation spaces, achieving real-time dynamic view synthesis. However, these…

Cited by 0SourcePDFScholar
2025

From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction

NeurIPS 2025poster

Despite remarkable progress in driving world models, their potential for autonomous systems remains largely untapped: the world models are mostly learned for world simulation and decoupled from trajectory planning. While recent efforts aim to unify world modeling and planning in a single framework,…

Cited by 0SourcecodeScholar
2025

From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications

ICML 2025poster

Large Language Models (LLMs) matrices can often be expressed in low-rank format with potential to relax memory and compute resource requirements. Unlike previous works which pivot around developing novel matrix decomposition algorithms, in this work we focus to study the emerging non-uniform low-ran…

Cited by 0SourcePDFScholar
2025

Fusionsense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstruction

ICRA 2025

Humans effortlessly integrate common-sense knowledge with sensory input from vision and touch to understand their surroundings. Emulating this capability, we introduce FusionSense, a novel 3D reconstruction framework that enables robots to fuse priors from foundation models with highly sparse observ

Cited by 6SourceScholar
2025

GigaGS: 3D Gaussian Based Planar Representation for Large-Scene Surface Reconstruction

AAAI 2025technical

3D Gaussian Splatting (3DGS) has shown promising performance in novel view synthesis. Previous methods adapt it to obtaining surfaces of either individual 3D objects or within limited scenes. In this paper, we make the first attempt to tackle the challenging task of large-scale scene surface reconst…

Cited by 0SourcePDFScholar
2025

Improving LLM Reasoning through Interpretable Role-Playing Steering

EMNLP 2025

Role-playing has emerged as an effective technique for enhancing the reasoning capabilities of large language models (LLMs). However, existing methods primarily rely on prompt engineering, which often lacks stability and interpretability. In this paper, we introduce Sparse Autoencoder Role-Playing S

Cited by 0SourcePDFScholar
2025

JTD-UAV: MLLM-Enhanced Joint Tracking and Description Framework for Anti-UAV Systems

CVPR 2025poster

Unmanned Aerial Vehicles (UAVs) are widely adopted across various fields, yet they raise significant privacy and safety concerns, demanding robust monitoring solutions. Existing anti-UAV methods primarily focus on position tracking but fail to capture UAV behavior and intent. To address this, we int…

Cited by 0SourcePDFScholar
2025

LEAF: Large Language Diffusion Model for Time Series Forecasting

EMNLP 2025

This paper studies the problem of time series forecasting, which aims to generate future predictions given historical trajectories. Recent researchers have applied large language models (LLMs) into time series forecasting, which usually align the time series space with textual space and output futur

Cited by 0SourcePDFScholar
2025

LLM-Guided Semantic Relational Reasoning for Multimodal Intent Recognition

EMNLP 2025

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance, constraining relational reasoning over fine-grained semantic

2025

Lock on Target! Precision Unlearning via Directional Control

EMNLP 2025

The unlearning method aims at effectively removing harmful, sensitive, or outdated knowledge without costly retraining the model. However, existing methods suffer from two critical limitations: (1) collateral forgetting, where erasing target data inadvertently removes related but desirable knowledge

Cited by 0SourcePDFScholar
2025

Memory or Reasoning? Explore How LLMs Compute Mixed Arithmetic Expressions

ACL 2025finding

Large language models (LLMs) can solve complex multi-step math reasoning problems, but little is known about how these computations are implemented internally. Many recent studies have investigated the mechanisms of LLMs on simple arithmetic tasks (e.g., a+b, a× b), but how LLMs solve mixed arithmet…

Cited by 0SourcePDFScholar
2025

Mitigating Pervasive Modality Absence Through Multimodal Generalization and Refinement

AAAI 2025technical

The performance of multimodal models often deteriorates when modality absence occurs. The absence disrupts the learned inter-modal correlations, resulting in biased multimodal representations. This challenge is especially pronounced when the absence is pervasive, affecting both the training and infe…

Cited by 0SourcePDFScholar
2025

Modular Self-Reconfigurable Continuum Robot for General Purpose Loco-Manipulation

RA-L 2025

Modular Self-Reconfigurable Robots offer exceptional adaptability and versatility through reconfiguration, but traditional rigid robot designs lack the compliance necessary for effective interaction with complex environments. Recent advancements in modular soft robots address this shortcoming with e

Cited by 4SourcecodeScholar
2025

Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversion

CVPR 2025poster

With the rapid proliferation of 3D devices and the shortage of 3D content, stereo conversion is attracting increasing attention. Recent works introduce pretrained Diffusion Models (DMs) into this task. However, due to the scarcity of large-scale training data and comprehensive benchmarks, the optima…

Cited by 0SourcePDFScholar
2025

MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors

CVPR 2025poster

Perspective projection has been extensively utilized in monocular 3D object detection methods. It introduces geometric priors from 2D bounding boxes and 3D object dimensions to reduce the uncertainty of depth estimation. However, due to errors originating from the object's visual surface, the boundi…

2025

Motion-Agent: A Conversational Framework for Human Motion Generation with LLMs

ICLR 2025poster

While previous approaches to 3D human motion generation have achieved notable success, they often rely on extensive training and are limited to specific tasks. To address these challenges, we introduce **Motion-Agent**, an efficient conversational framework designed for general human motion generati…

2025

ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction

ICLR 2025spotlight

Neural implicit reconstruction via volume rendering has demonstrated its effectiveness in recovering dense 3D surfaces. However, it is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with differing characteristics. To address this issue, previous meth…

2025

NUMINA: A Natural Understanding Benchmark for Multi-dimensional Intelligence and Numerical Reasoning Abilities

EMNLP 2025

Recent advancements in 2D multimodal large language models (MLLMs) have significantly improved performance in vision-language tasks. However, extending these capabilities to 3D environments remains a distinct challenge due to the complexity of spatial reasoning. Nevertheless, existing 3D benchmarks

2025

ORBiT: Optimizing Robot-Assisted Bite Transfer Leveraging a Real2Sim2Real Framework

IROS 2025

Robot-assisted feeding has the potential to enhance the independence of individuals requiring assistance, yet the bite transfer process remains particularly challenging, especially for those with complex conditions. In this paper, we present ORBiT, a novel Real2Sim2Real framework designed to optimiz

Cited by 1SourceScholar
2025

Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering

ICCV 2025poster

While multi-step diffusion models have advanced both forward and inverse rendering, existing approaches often treat these problems independently, leading to cycle inconsistency and slow inference speed. In this work, we present Ouroboros, a framework composed of two single-step diffusion models that…

Cited by 0SourcePDFScholar
2025

PALA: Class-imbalanced Graph Domain Adaptation via Prototype-anchored Learning and Alignment

IJCAI 2025

Graph domain adaptation is a key subfield of graph transfer learning that aims to bridge domain gaps by transferring knowledge from a label-rich source graph to an unlabeled target graph. However, most existing methods assume balanced labels in the source graph, which often fails in practice and lea

2025

Towards Robust Uncertainty Calibration for Composed Image Retrieval

NeurIPS 2025poster

The interactive task of composed image retrieval aims to retrieve the most relevant images with the bi-modal query, consisting of a reference image and a modification sentence. Despite significant efforts to bridge the heterogeneous gap within the bi-modal query and leverage contrastive learning to…

Cited by 0SourceScholar
2025

Unlocking Multimodal Mathematical Reasoning via Process Reward Model

NeurIPS 2025poster

Process Reward Models (PRMs) have shown promise in enhancing the mathematical reasoning capabilities of Large Language Models (LLMs) through Test-Time Scaling (TTS). However, their integration into multimodal reasoning remains largely unexplored. In this work, we take the first step toward unlocking…

Cited by 0SourceScholar
2024

A Survey of Data-Efficient Graph Learning

IJCAI 2024poster

Graph-structured data, prevalent in domains ranging from social networks to biochemical analysis, serve as the foundation for diverse real-world systems. While graph neural networks demonstrate proficiency in modeling this type of data, their success is often reliant on significant amounts of labele…

Cited by 25SourcePDFScholar
2024

A Thorough Examination of Decoding Methods in the Era of LLMs

EMNLP 2024main

Decoding methods play an indispensable role in converting language models from next-token predictors into practical task solvers. Prior research on decoding methods, primarily focusing on task-specific models, may not extend to the current era of general-purpose large language models (LLMs). Moreove…

2024

CrossBind: Collaborative Cross-Modal Identification of Protein Nucleic-Acid-Binding Residues

AAAI 2024technical

Accurate identification of protein nucleic acid binding residues poses a significant challenge with important implications for various biological processes and drug design. Many typical computational methods for protein analysis rely on a single model that could ignore either the semantic context of…

2024

DME: Unveiling the Bias for Better Generalized Monocular Depth Estimation

AAAI 2024technical

This paper aims to design monocular depth estimation models with better generalization abilities. To this end, we have conducted quantitative analysis and discovered two important insights. First, the Simulation Correlation phenomenon, commonly seen in long-tailed classification problems, also exist…

2024

Deep Reinforcement Learning for Early Diagnosis of Lung Cancer

AAAI 2024technical

Lung cancer remains the leading cause of cancer-related death worldwide, and early diagnosis of lung cancer is critical for improving the survival rate of patients. Performing annual low-dose computed tomography (LDCT) screening among high-risk populations is the primary approach for early diagnosis…

2024

Detector-Free Structure from Motion

CVPR 2024poster

We propose a structure-from-motion framework to recover accurate camera poses and point clouds from unordered images. Traditional SfM systems typically rely on the successful detection of repeatable keypoints across multiple views as the first step which is difficult for texture-poor scenes and poor…

2024

E3V-K5: An Authentic Benchmark for Redefining Video-Based Energy Expenditure Estimation

ECCV 2024poster

"Accurately estimating energy expenditure (EE) is crucial for optimizing athletic training, monitoring daily activity levels, and preventing sports-related injuries. Estimating energy expenditure based on video (E3 V) is an appealing research direction. This paper introduces E3V-K5, an authentic dat…

2024

Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speed

CVPR 2024highlight

We present a novel method for efficiently producing semi-dense matches across images. Previous detector-free matcher LoFTR has shown remarkable matching capability in handling large-viewpoint change and texture-poor scenarios but suffers from low efficiency. We revisit its design choices and derive…

2024

EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction

ICRA 2024poster

A robot’s ability to anticipate the 3D action target location of a hand’s movement from egocentric videos can greatly improve safety and efficiency in human-robot interaction (HRI). While previous research predominantly focused on semantic action classification or 2D target region prediction, we arg…

Cited by 2SourceScholar
2024

Hint-Enhanced In-Context Learning Wakes Large Language Models Up For Knowledge-Intensive Tasks

ICASSP 2024accepted

In-context learning (ICL) ability has emerged with the increasing scale of large language models (LLMs), enabling them to learn input-label mappings from demonstrations and perform well on downstream tasks. However, under the standard ICL setting, LLMs may sometimes neglect query-related information…

Cited by 0SourceScholar
2024

Hypergraph-enhanced Dual Semi-supervised Graph Classification

ICML 2024poster

In this paper, we study semi-supervised graph classification, which aims at accurately predicting the categories of graphs in scenarios with limited labeled graphs and abundant unlabeled graphs. Despite the promising capability of graph neural networks (GNNs), they typically require a large number o…

Cited by 18SourcePDFScholar
2024

InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions

NAACL 2024long

Instruction tuning effectively optimizes Large Language Models (LLMs) for downstream tasks. Due to the changing environment in real-life applications, LLMs necessitate continual task-specific adaptation without catastrophic forgetting. Considering the heavy computational cost, replay-based Continual…

Cited by 35SourcePDFScholar
2024

Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perception

CVPR 2024highlight

Multimodal Large Language Model (MLLMs) leverages Large Language Models as a cognitive framework for diverse visual-language tasks. Recent efforts have been made to equip MLLMs with visual perceiving and grounding capabilities. However there still remains a gap in providing fine-grained pixel-level…

2024

MultiSQL: A Schema-Integrated Context-Dependent Text2SQL Dataset with Diverse SQL Operations

ACL 2024findings

Text2SQL is a task that translates natural language into SQL statements. Context-dependent Text2SQL offers a more natural database interaction by simulating dialogues between users and databases, with CoSQL and SparC as representative datasets. Yet, these datasets struggle to accurately replicate re…

2024

MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models

NeurIPS 2024poster

Despite the superior capabilities of Multimodal Large Language Models (MLLMs) across diverse tasks, they still face significant trustworthiness challenges. Yet, current literature on the assessment of trustworthy MLLMs remains limited, lacking a holistic evaluation to offer thorough insights into fu…

Cited by 5SourcecodeScholar
2024

NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstruction

NeurIPS 2024poster

Signed Distance Function (SDF)-based volume rendering has demonstrated significant capabilities in surface reconstruction. Although promising, SDF-based methods often fail to capture detailed geometric structures, resulting in visible defects. By comparing SDF-based volume rendering to density-based…

2024

Online Rotor Fault Detection and Isolation for Vertical Takeoff and Landing Vehicles

IROS 2024poster

Vertical take-off and landing (VTOL) vehicles are becoming increasingly popular for real-world transport; but, as with any vehicle, guaranteeing safety is both extremely critical and highly challenging due to issues like rotor faults. Existing fault detection and isolation (FDI) techniques usually f…

Cited by 1SourceScholar
2024

RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation Framework

EMNLP 2024main

Despite significant advancements in natural language generation, controlling language models to produce texts with desired attributes remains a formidable challenge. In this work, we introduce RSA-Control, a training-free controllable text generation framework grounded in pragmatics. RSA-Control dir…

2024

Rank and Align: Towards Effective Source-free Graph Domain Adaptation

IJCAI 2024poster

Graph neural networks (GNNs) have achieved impressive performance in graph domain adaptation. However, extensive source graphs could be unavailable in real-world scenarios due to privacy and storage concerns. To this end, we investigate an underexplored yet practical problem of source-free graph dom…

Cited by 5SourcePDFScholar
2024

SciNews: From Scholarly Complexities to Public Narratives – a Dataset for Scientific News Report Generation

COLING 2024main

Scientific news reports serve as a bridge, adeptly translating complex research articles into reports that resonate with the broader public. The automated generation of such narratives enhances the accessibility of scholarly insights. In this paper, we present a new corpus to facilitate this paradig…

2024

Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition

AAAI 2024technical

Multimodal intent recognition aims to leverage diverse modalities such as expressions, body movements and tone of speech to comprehend user's intent, constituting a critical task for understanding human language and behavior in real-world multimodal scenarios. Nevertheless, the majority of existing…

2024

Tunable Stiffness Glove for Tremor Suppression Based on 3D Printed Structured Fabrics

IROS 2024poster

Tremors, which are prevalent symptoms in both Parkinson’s disease (PD) and essential tremor (ET), substantially diminish the quality of life for those affected. Traditional treatments, including pharmaceutical medications and invasive surgical procedures, often come with limitations and side effects…

Cited by 1SourceScholar
2023

Concentric Tube Robot Redundancy Resolution via Velocity/Compliance Manipulability Optimization

RA-L 2023

Concentric Tube Robots (CTR) have the potential to enable effective minimally invasive surgeries. While extensive modeling and control work have been proposed in the past decade, limited efforts have been made to improve the path tracking performance from the perspective of manipulability, which can

Cited by 2SourceScholar
2023

Controlling Styles in Neural Machine Translation with Activation Prompt

ACL 2023findings

Controlling styles in neural machine translation (NMT) has attracted wide attention, as it is crucial for enhancing user experience. Earlier studies on this topic typically concentrate on regulating the level of formality and achieve some progress in this area. However, they still encounter two majo…

2023

Efficient Super-Resolution for Compression Of Gaming Videos

ICASSP 2023accepted

Due to the increasing demand for game-streaming services, efficient compression of computer-generated video is more critical than ever, especially when the available bandwidth is low. This paper proposes a super-resolution framework that improves the coding efficiency of computer-generated gaming vi…

Cited by 0SourceScholar
2023

Incorporating Distributions of Discourse Structure for Long Document Abstractive Summarization

ACL 2023long

For text summarization, the role of discourse structure is pivotal in discerning the core content of a text. Regrettably, prior studies on incorporating Rhetorical Structure Theory (RST) into transformer-based summarization models only consider the nuclearity annotation, thereby overlooking the vari…

2023

Isomer: Isomerous Transformer for Zero-shot Video Object Segmentation

ICCV 2023poster

Recent leading zero-shot video object segmentation (ZVOS) works devote to integrating appearance and motion information by elaborately designing feature fusion modules and identically applying them in multiple feature stages. Our preliminary experiments show that with the strong long-range dependenc…

Cited by 15PDFcodeScholar
2023

Jamming Enabled Variable Stiffness Wrist Exoskeleton for Tremor Suppression

RA-L 2023

Parkinson's disease is a chronic disorder that affects the central nervous system of patients. It affects millions of aging populations around the world every year. Approximately 80% of Parkinson's disease patients suffer from tremors which significantly reduce their life quality. In this study, we

Cited by 12SourceScholar
2023

Learning Functional Distributions with Private Labels

ICML 2023poster

We study the problem of learning functional distributions in the presence of noise. A functional is a map from the space of features to *distributions* over a set of labels, and is often assumed to belong to a known class of hypotheses $\mathcal{F}$. Features are generated by a general random proces…

Cited by 4SourcePDFScholar
2023

SunStage: Portrait Reconstruction and Relighting Using the Sun as a Light Stage

CVPR 2023poster

A light stage uses a series of calibrated cameras and lights to capture a subject's facial appearance under varying illumination and viewpoint. This captured information is crucial for facial reconstruction and relighting. Unfortunately, light stages are often inaccessible: they are expensive and re…

Cited by 29SourcePDFScholar
2023

Towards Deeply Unified Depth-aware Panoptic Segmentation with Bi-directional Guidance Learning

ICCV 2023oral

Depth-aware panoptic segmentation is an emerging topic in computer vision which combines semantic and geometric understanding for more robust scene interpretation. Recent works pursue unified frameworks to tackle this challenge but mostly still treat it as two individual learning tasks, which limits…

Cited by 12PDFcodeScholar
2022

Back to Reality: Weakly-Supervised 3D Object Detection With Shape-Guided Label Enhancement

CVPR 2022poster

In this paper, we propose a weakly-supervised approach for 3D object detection, which makes it possible to train a strong 3D detector with position-level annotations (i.e. annotations of object centers). In order to remedy the information loss from box annotations to centers, our method, namely Back…

Cited by 36PDFcodeScholar
2022

DisenCite: Graph-Based Disentangled Representation Learning for Context-Specific Citation Generation

AAAI 2022technical

Citing and describing related literature are crucial to scientific writing. Many existing approaches show encouraging performance in citation recommendation, but are unable to accomplish the more challenging and onerous task of citation text generation. In this paper, we propose a novel disentangled…

2022

Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT

ACL 2022long

Transformer-based pre-trained models, such as BERT, have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However, deploying these models can be prohibitively costly, as the standard self-attention mechanism of the Transformer suffer…

2022

Inverse Kinematics and Dexterous Workspace Formulation for 2-Segment Continuum Robots With Inextensible Segments

RA-L 2022

The inverse kinematics (IK) problem of continuum robots has been investigated in depth in the past decades. Under the constant-curvature bending assumption, closed-form IK solution has been obtained for continuum robots with variable segment lengths. Attempting to close the gap towards a complete so

Cited by 12SourceScholar
2022

LUNA: Learning Slot-Turn Alignment for Dialogue State Tracking

NAACL 2022long

Dialogue state tracking (DST) aims to predict the current dialogue state given the dialogue history. Existing methods generally exploit the utterances of all dialogue turns to assign value for each slot. This could lead to suboptimal results due to the information introduced from irrelevant utteranc…

2022

Multi-Source Uncertainty Mining for Deep Unsupervised Saliency Detection

CVPR 2022poster

Deep learning-based image salient object detection (SOD) heavily relies on large-scale training data with pixel-wise labeling. High-quality labels involve intensive labor and are expensive to acquire. In this paper, we propose a novel multi-source uncertainty mining method to facilitate unsupervised…

Cited by 44PDFScholar
2022

OPERA: Operation-Pivoted Discrete Reasoning over Text

NAACL 2022long

Machine reading comprehension (MRC) that requires discrete reasoning involving symbolic operations, e.g., addition, sorting, and counting, is a challenging task. According to this nature, semantic parsing-based methods predict interpretable but complex logical forms. However, logical form generation…

2022

P3LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training

EMNLP 2022finding

Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong local dependencies.To address the aforementioned problem, we propose P3LM, a probabilistically permuted prophet language…

Cited by 0SourcePDFScholar
2022

TGNN: A Joint Semi-supervised Framework for Graph-level Classification

IJCAI 2022poster

This paper studies semi-supervised graph classification, a crucial task with a wide range of applications in social network analysis and bioinformatics. Recent works typically adopt graph neural networks to learn graph-level representations for classification, failing to explicitly leverage features…

Cited by 48SourcePDFScholar
2022

You Only Infer Once: Cross-Modal Meta-Transfer for Referring Video Object Segmentation

AAAI 2022technical

We present YOFO (You Only inFer Once), a new paradigm for referring video object segmentation (RVOS) that operates in an one-stage manner. Our key insight is that the language descriptor should serve as target-specific guidance to identify the target object, while a direct feature fusion of image an…

Cited by 59SourcePDFScholar
2021

Can Scale-Consistent Monocular Depth Be Learned in a Self-Supervised Scale-Invariant Manner?

ICCV 2021poster

Geometric constraints are shown to enforce scale consistency and remedy the scale ambiguity issue in self-supervised monocular depth estimation. Meanwhile, scale-invariant losses focus on learning relative depth, leading to accurate relative depth prediction. To combine the best of both worlds, we l…

Cited by 49PDFScholar
2021

Optimal Dynamic Duct Static Pressure Method in a Multi-Zone Variable Air Volume System

RA-L 2021

Reducing the energy consumption of a variable air volume (VAV) system in heating, ventilation, and air-conditioning (HVAC) systems attracts many attentions. In this letter, a novel method, namely, optimal dynamic duct static pressure (ODSP) method is proposed to find the globally optimal solutions o

Cited by 5SourceScholar
2021

RoR: Read-over-Read for Long Document Machine Reading Comprehension

EMNLP 2021finding

Transformer-based pre-trained models, such as BERT, have achieved remarkable results on machine reading comprehension. However, due to the constraint of encoding length (e.g., 512 WordPiece tokens), a long document is usually split into multiple chunks that are independently read. It results in the…

2021

SGG: Learning to Select, Guide, and Generate for Keyphrase Generation

NAACL 2021long

Keyphrases, that concisely summarize the high-level topics discussed in a document, can be categorized into present keyphrase which explicitly appears in the source text and absent keyphrase which does not match any contiguous subsequence but is highly semantically related to the source. Most existi…

2020

CLIFFNet for Monocular Depth Estimation with Hierarchical Embedding Loss

ECCV 2020poster

This paper proposes a hierarchical loss for monocular depth estimation, which measures the differences between the prediction and ground truth in hierarchical embedding spaces of depth maps. In order to find an appropriate embedding space, we design different architectures for hierarchical embedding…

2018

Dual Principal Component Pursuit: Improved Analysis and Efficient Algorithms

NeurIPS 2018poster

Recent methods for learning a linear subspace from data corrupted by outliers are based on convex L1 and nuclear norm optimization and require the dimension of the subspace and the number of outliers to be sufficiently small [27]. In sharp contrast, the recently proposed Dual Principal Component Pur…

Cited by 61SourcePDFScholar
2018

Learning to Parse Wireframes in Images of Man-Made Environments

CVPR 2018poster

In this paper, we propose a learning-based approach to the task of automatically extracting a "wireframe" representation for images of cluttered man-made environments. The wireframe contains all salient straight lines and their junctions of the scene that encode efficiently and accurately large-scal…

2017

Learning to Detect Salient Objects With Image-Level Supervision

CVPR 2017poster

Deep Neural Networks (DNNs) have substantially improved the state-of-the-art in salient object detection. However, training DNNs requires costly pixel-level annotations. In this paper, we leverage the observation that image-level tags provide important cues of foreground salient objects, and develop…

Cited by 1450PDFScholar
2017

MarrNet: 3D Shape Reconstruction via 2.5D Sketches

NeurIPS 2017poster

3D object reconstruction from a single image is a highly under-determined problem, requiring strong prior knowledge of plausible 3D shapes. This introduces challenge for learning-based approaches, as 3D object annotations in real images are scarce. Previous work chose to train on synthetic data with…

Cited by 536SourcePDFScholar