← Search

Haoyu Wang

110 accepted papers

2026

A Generative Model for Controllable Feature Heterophily in Graphs

ICASSP 2026poster

We introduce a principled generative framework for graph signals that enables explicit control of feature heterophily, a key property underlying the effectiveness of graph learning methods. Our model combines a Lipschitz graphon-based random graph generator with Gaussian node features filtered throu…

Cited by 0SourcePDFScholar
2026

A Simple "Motivation" Can Enhance Reinforcement Finetuning of Large Reasoning Models

ICLR 2026poster

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful learn-to-reason paradigm for Large Reasoning Models to tackle complex tasks. However, current RLVR paradigm is still not efficient enough, as it works in a trial-and-error manner. To perform better, the model needs to e…

Cited by 0SourcecodeScholar
2026

Alternating Reinforcement Learning for Rubric-Based Reward Modeling in Non-Verifiable LLM Post-Training

ICML 2026poster

Standard reward models typically predict scalar scores that fail to capture the multifaceted nature of response quality in non-verifiable domains, such as creative writing or open-ended instruction following. To address this limitation, we propose Rubric-ARM, a framework that jointly optimizes a rub…

Cited by 0SourceScholar
2026

Brownian Bridge Augmented Surrogate Simulation and Injection Planning for Geological CO2 Storage

AAAI 2026technical

Geological CO2 storage (GCS) involves injecting captured CO2 into deep subsurface formations to support climate goals. The effective management of GCS relies on adaptive injection planning to dynamically control injection rates and well pressures to balance both storage safety and efficiency. Prior

Cited by 0SourcePDFScholar
2026

DTT-BSR: GAN-BASED DTTNET WITH ROPE TRANSFORMER ENHANCEMENT FOR MUSIC SOURCE RESTORATION

ICASSP 2026poster

Music source restoration (MSR) aims to recover unprocessed stems from mixed and mastered recordings. The challenge lies in both separating overlapping sources and reconstructing signals degraded by production effects such as compression and reverberation. We therefore propose DTT-BSR, a hybrid gener…

Cited by 0SourcePDFScholar
2026

ECG-R1: Protocol-Guided and Modality-Agnostic MLLM for Reliable ECG Interpretation

ICML 2026poster

Electrocardiography (ECG) serves as an indispensable diagnostic tool in clinical practice, yet existing multimodal large language models (MLLMs) remain unreliable for ECG interpretation, often producing plausible but clinically incorrect analyses. To address this, we propose ECG-R1, the first reason…

Cited by 0SourceScholar
2026

Emotion-Conditioned Motion Sub-spaces with Flow Matching for Real-Time Audio-Driven Talking Heads

AAAI 2026technical

Recent advances in audio-driven talking-head synthesis have brought lip-sync precision close to human perception, yet emotional fidelity and real-time inference remain open challenges. Existing pipelines typically disentangle lip articulation, facial expression, and head pose in latent space; this

Cited by 0SourcePDFScholar
2026

Escaping the Subspace Trap: The Role of Optimizer Geometry in Model Width Expansion

ICML 2026poster

Pre-training large language models from scratch is prohibitively expensive as model scales increase. A practical alternative is Model Width Expansion (MWE), which grows a larger model from a well-pretrained ''seed'' model to inherit existing capabilities at initialization. However, we identify a phe…

Cited by 0SourceScholar
2026

From Natural Alignment to Conditional Controllability in Multimodal Dialogue

ICLR 2026poster

The recent advancement of Artificial Intelligence Generated Content (AIGC) has led to significant strides in modeling human interaction, particularly in the context of multi-modal dialogue. While current methods impressively generates realistic dialogue in speech and vision modalities, challenges r…

Cited by 0SourcecodeScholar
2026

Implicit Turn-Wise Policy Optimization for Proactive User-LLM Interaction

ICML 2026poster

Multi-turn human-AI collaboration is fundamental to deploying interactive services such as adaptive tutoring, conversational recommendation, and professional consultation. However, optimizing these interactions via reinforcement learning is hindered by the sparsity of verifiable intermediate rewards…

Cited by 0SourceScholar
2026

JoDiffusion: Jointly Diffusing Image with Pixel-Level Annotations for Semantic Segmentation Promotion

AAAI 2026technical

Given the inherently costly and time-intensive nature of pixel-level annotation, the generation of synthetic datasets comprising sufficiently diverse synthetic images paired with ground-truth pixel-level annotations has garnered increasing attention recently for training high-performance semantic se

Cited by 0SourcePDFScholar
2026

LC-QAT: Data-Efficient 2-Bit QAT for LLMs via Linear-Constrained Vector Quantization

ICML 2026poster

Quantization-aware training (QAT) is essential for extremely low-bit large language models (LLMs). Current QAT methods are mainly based on scalar quantization (SQ), which enables efficient optimization but suffers from severe performance degradation at 2-bit precision. On the other hand, vector quan…

Cited by 0SourceScholar
2026

Language-based Trial and Error Falls Behind in the Era of Experience

ICML 2026poster

While Large Language Models (LLMs) excel in language-based agentic tasks, their applicability to unseen, nonlinguistic environments (e.g., symbolic or spatial tasks) remains limited. Previous work attributes this performance gap to the mismatch between the pretraining distribution and the testing di…

Cited by 0SourceScholar
2026

MEANFLOW-ACCELERATED MULTIMODAL VIDEO-TO-AUDIO SYNTHESIS VIA ONE-STEP GENERATION

ICASSP 2026poster

A key challenge in synthesizing audios from silent videos is the inherent trade-off between synthesis quality and inference efficiency in existing methods. For instance, flow matching based models rely on modeling instantaneous velocity, inherently require an iterative sampling process, leading to s…

Cited by 0SourcePDFScholar
2026

MMIFEvol: Towards Evolutionary Multimodal Instruction Following

AAAI 2026technical

Multimodal Instruction Following serves as a fundamental capability of multimodal language models, involving accurate comprehension and execution of user-provided instructions. However, existing multimodal instruction-following datasets and benchmarks face the shortcomings outlined below: (a) Lack o

Cited by 0SourcePDFScholar
2026

Mechanistic Detection and Mitigation of Hallucination in Large Reasoning Models

ICLR 2026poster

Large Reasoning Models (LRMs) have shown impressive capabilities in multi-step reasoning tasks. However, alongside these successes, a more deceptive form of model error has emerged—**Reasoning Hallucination**—where logically coherent but factually incorrect reasoning traces lead to persuasive yet fa…

Cited by 0SourcecodeScholar
2026

MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decoupling

ICLR 2026poster

Existing video generation models predominantly emphasize appearance fidelity while exhibiting limited ability to synthesize complex human motions, such as whole-body movements, long-range dynamics, and fine-grained human–environment interactions. This often leads to unrealistic or physically implaus…

Cited by 0SourceScholar
2026

ROBUST MULTIMODAL REPRESENTATION LEARNING IN HEALTHCARE

ICASSP 2026poster

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from multiple sources, which poses significant challenges for medical m…

Cited by 0SourcePDFScholar
2026

Representation Alignment for Diffusion Transformers without External Components

ICLR 2026poster

Recent studies have demonstrated that learning a meaningful internal represen- tation can accelerate generative training. However, existing approaches necessi- tate to either introduce an off-the-shelf external representation task or rely on a large-scale, pre-trained external representation encoder…

Cited by 0SourcecodeScholar
2026

Rethinking Multi-Modal Point Cloud Completion: Query-Aware Gating Attention and Gramian Volume Alignment

IJCAI 2026

Multi-modal point cloud completion aims to recover complete 3D geometric structures from partial observations by integrating auxiliary data. Although image-guided techniques are well-established, the potential of natural language as a source of high-level semantic cues remains under-explored. Theref

Cited by 0Scholar
2026

SEED: Spectral Entropy-Guided Evaluation of Spatial-Temporal Dependencies for Multivariate Time Series Forecasting

AAAI 2026technical

Effective multivariate time series forecasting often benefits from accurately modeling complex inter-variable dependencies. However, existing attention- or graph-based methods face three key issues: (a) strong temporal self-dependencies are often disrupted by irrelevant variables; (b) softmax normal

Cited by 0SourcePDFScholar
2026

Stabilized Supralinear Networks Learn to Switch Coding Strategies Balancing Cost and Performance

ICML 2026poster

Lateral connections (LCs) are ubiquitous in the cortical circuits. While modern deep learning architectures have rich intralayer interactions (e.g., convolutional mixing, normalization, or attention) to support feature selectivity and contextual modulation, explicit excitatory and inhibitory (E-I) L…

Cited by 0SourceScholar
2026

Text Before Vision: Staged Knowledge Injection Matters for Agentic RLVR in Ultra-High-Resolution Remote Sensing Understanding

ICML 2026poster

Multimodal reasoning for ultra-high-resolution (UHR) remote sensing (RS) is usually bottlenecked by visual evidence acquisition: the model necessities localizing tiny task-relevant regions in massive pixel spaces. While Agentic Reinforcement Learning with Verifiable Rewards (RLVR) using zoom-in tool…

Cited by 0SourceScholar
2026

Towards Automated Kernel Generation in the Era of LLMs: A Survey

IJCAI 2026

The performance of modern AI systems is fundamentally constrained by the quality of their underlying kernels, which translate high-level algorithmic semantics into low-level hardware operations. Achieving near-optimal kernels requires expert-level understanding of hardware architectures and programm

Cited by 0Scholar
2026

Towards Understanding Continual Factual Knowledge Acquisition of Language Models: From Theory to Algorithm

ICML 2026poster

Continual Pre-Training (CPT) is essential for enabling Language Models (LMs) to integrate new factual knowledge without erasing old. While classical CPT techniques like data replay have become the standard paradigm, the mechanisms underlying how LMs acquire and retain facts over time, termed as cont…

Cited by 0SourceScholar
2026

UltraHorizon: Benchmarking LLM-Agent Capabilities in Ultra Long-Horizon Scenarios

ICML 2026poster

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development, commercial investment, and scientific discovery, unfold in …

Cited by 0SourceScholar
2026

UniSVQ: 2-bit Unified Scalar-Vector Quantization

ICML 2026poster

Post-training quantization at the 2-bit level enables low-cost deployment and inference acceleration for large language models (LLMs). Scalar quantization (SQ) and vector quantization (VQ) are two primary quantization methods, however, the former suffers from significant performance degradation, and…

Cited by 0SourceScholar
2026

What Makes Value Learning Efficient in Residual Reinforcement Learning?

ICML 2026spotlight

Residual reinforcement learning (RL) enables stable online refinement of expressive pretrained policies by freezing the base and learning only bounded corrections. However, value learning in residual RL poses unique challenges that remain poorly understood. In this work, we identify two key bottlene…

Cited by 0SourceScholar
2025

A Kinematic Constrained Batch Informed Trees Algorithm With Varied Density Sampling for Mobile Robot Path Planning

RA-L 2025

we proposed a novel Kinematic Batch Informed Trees algorithm (K-BIT*) to solve problems of the low efficiency, poor geometric smoothness and local optimum when conducting path planning for mobile robots. A variable density sampling strategy is designed which can automatically adjust the searching ra

Cited by 3SourceScholar
2025

AceSearcher: Bootstrapping Reasoning and Search for LLMs via Reinforced Self-Play

NeurIPS 2025spotlight

Search-augmented LLMs often struggle with complex reasoning tasks due to ineffective multi-hop retrieval and limited reasoning ability. We propose AceSearcher, a cooperative self-play framework that trains a single large language model (LLM) to alternate between two roles: a decomposer that breaks d…

Cited by 0SourceScholar
2025

AutoCT: Automating Interpretable Clinical Trial Prediction with LLM Agents

EMNLP 2025

Clinical trials are critical for advancing medical treatments but remain prohibitively expensive and time-consuming. Accurate prediction of clinical trial outcomes can significantly reduce research and development costs and accelerate drug discovery. While recent deep learning models have shown prom

Cited by 0SourcePDFScholar
2025

Boosting Lightweight Camouflaged Object Detection with Multi-Scale Context and Boundary Awareness

ICASSP 2025accepted

To adapt to the resource-limited environment, this study introduces the lightweight boundary-aware camouflaged object detection(COD) network LMABnet. We enhance the feature representation capability of the lightweight network through a multi-scale feature fusion architecture, while effectively avoid…

Cited by 0SourceScholar
2025

CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models

NAACL 2025long

Large language models (LLMs) have achieved remarkable performance on various NLP tasks, yet their potential in more challenging task like finance, has not been fully explored. In this paper, we present CFinBench: a meticulously crafted, the most comprehensive evaluation benchmark to date, for assess…

2025

DCI: Dual-Conditional Inversion for Boosting Diffusion-Based Image Editing

NeurIPS 2025poster

Diffusion models have achieved remarkable success in image generation and editing tasks. Inversion within these models aims to recover the latent noise representation for a real or generated image, enabling reconstruction, editing, and other downstream tasks. However, to date, most inversion approac…

Cited by 0SourcecodeScholar
2025

Discrete Unit-based Low-latency Multi-lingual Speech Synthesis for LIMMITS'25 Challenge

ICASSP 2025accepted

In this paper, we present the system developed by our team, CCATTS, for the LIMMITS’25 challenge, focusing on few-shot and zero-shot TTS. We adopt a two-stage TTS strategy. In track 1, we fine-tune the pre-trained ZMM-TTS model and successfully achieve multilingual low-latency TTS. In track 2, we pr…

Cited by 0SourceScholar
2025

Dual-view X-ray Detection: Can AI Detect Prohibited Items from Dual-view X-ray Images like Humans?

CVPR 2025poster

To detect prohibited items in challenging categories, human inspectors typically rely on images from two distinct views (vertical and side). Can AI detect prohibited items from dual-view X-ray images in the same way humans do? Existing X-ray datasets often suffer from limitations, such as single-vie…

2025

Eagle-Scale Flapping-Wing Robot with Aggressive Roll Maneuverability: Bio-Inspired Actuation, Fluid-Structure Interaction Simulation and Flight Experiment

IROS 2025

Large flapping-wing aerial vehicles (FWAVs) face dual challenges in aerodynamic and structural design, with long-standing technical bottlenecks, particularly in roll maneuvers. In this study, by reverse-engineering the biomechanical mechanisms of raptor flight, we propose a bio-inspired wing-shoulde

Cited by 0SourceScholar
2025

Emergent Orientation Maps —— Mechanisms, Coding Efficiency and Robustness

ICLR 2025spotlight

Extensive experimental studies have shown that in lower mammals, neuronal orientation preference in the primary visual cortex is organized in disordered "salt-and-pepper" organizations. In contrast, higher-order mammals display a continuous variation in orientation preference, forming pinwheel-like…

Cited by 0SourcePDFScholar
2025

Evaluating and Mitigating Linguistic Discrimination in Large Language Models: Perspectives on Safety Equity and Knowledge Equity

IJCAI 2025

Large language models (LLMs) typically provide multilingual support and demonstrate remarkable capabilities in solving tasks described in different languages. However, LLMs can exhibit linguistic discrimination due to the uneven distribution of training data across languages. That is, LLMs struggle

2025

Exoskeleton Gait Adaptation Framework via Hm-DMP and PI2 Optimization for Dynamic Patient Mobility Matching

IROS 2025

Repetitive gait training with lower-limb exoskeletons enhances neuroplasticity and reduces muscle atrophy by promoting patient engagement in active rehabilitation training. Importantly, the therapeutic efficacy of such engagement critically depends on providing patients with task difficulty levels m

Cited by 0SourceScholar
2025

From Learning to Mastery: Achieving Safe and Efficient Real-World Autonomous Driving with Human-in-the-Loop Reinforcement Learning

IROS 2025

Autonomous driving with reinforcement learning (RL) has significant potential. However, applying RL in real-world settings remains challenging due to the need for safe, efficient, and robust learning. Incorporating human expertise into the learning process can help overcome these challenges by reduc

Cited by 0SourcecodeScholar
2025

GeoLink: Empowering Remote Sensing Foundation Model with OpenStreetMap Data

NeurIPS 2025poster

Integrating ground-level geospatial data with rich geographic context, like OpenStreetMap (OSM), into remote sensing (RS) foundation models (FMs) is essential for advancing geospatial intelligence and supporting a broad spectrum of tasks. However, modality gap between RS and OSM data, including diff…

Cited by 0SourcecodeScholar
2025

HeStIa: Asynchronous Embodied Dynamic Locomotion Learning for Walking Robots through Multimodal Large Language Models

IROS 2025

The control of locomotion in walking robots with various architectural designs presents significant challenges. While existing approaches primarily rely on low-level state information and isolated visual features, lacking the high-level semantic understanding that humans use to reason about movement

Cited by 0SourceScholar
2025

Imitation-Enhanced Reinforcement Learning With Privileged Smooth Transition for Hexapod Locomotion

RA-L 2025

Deep reinforcement learning (DRL) methods have shown significant promise in controlling the movement of quadruped robots. However, for systems like hexapod robots, which feature a higher-dimensional action space, it remains challenging for an agent to devise an effective control strategy directly. C

Cited by 9SourceScholar
2025

Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline

CVPR 2025poster

Interactive Medical Image Segmentation (IMIS) has long been constrained by the limited availability of large-scale, diverse, and densely annotated datasets, which hinders model generalization and consistent evaluation across different models. In this paper, we introduce the IMed-361M benchmark datas…

2025

LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Models

ACL 2025long

We propose a training-free framework that enables large language models (LLMs) to effectively process long texts, using a divide-and-conquer strategy for comprehensive document understanding.The proposed LLM×MapReduce framework splits the entire document into several chunks for LLMs to read and then…

Cited by 0SourcePDFScholar
2025

Lifelong Safety Alignment for Language Models

NeurIPS 2025poster

LLMs have made impressive progress, but their growing capabilities also expose them to highly flexible jailbreaking attacks designed to bypass safety alignment. While many existing defenses focus on known types of attacks, it is more critical to prepare LLMs for *unseen* attacks that may arise durin…

Cited by 0SourcecodeScholar
2025

Low-Biased General Annotated Dataset Generation

CVPR 2025poster

Pre-training backbone networks on a general annotated dataset (e.g., ImageNet) that comprises numerous manually collected images with category annotations has proven to be indispensable for enhancing the generalization capacity of downstream visual tasks. However, those manually collected images oft…

2025

MST-HA: Multi-Modal Signal Fusion with Bayesian Optimization for Robust Industrial Robot Joint Health Assessment

ICASSP 2025accepted

This paper presents a novel multi-modal deep learning framework for industrial robot joint health assessment and prediction, leveraging non-invasive signal fusion and Bayesian optimization. The proposed method addresses the challenges of comprehensive joint state monitoring in complex industrial env…

Cited by 0SourceScholar
2025

MV-VTON: Multi-View Virtual Try-On with Diffusion Models

AAAI 2025technical

The goal of image-based virtual try-on is to generate an image of the target person naturally wearing the given clothing. However, existing methods solely focus on the frontal try-on using the frontal clothing. When the views of the clothing and person are significantly inconsistent, particularly wh…

2025

Mastering Massive Multi-Task Reinforcement Learning via Mixture-of-Expert Decision Transformer

ICML 2025poster

Despite recent advancements in offline multi-task reinforcement learning (MTRL) have harnessed the powerful capabilities of the Transformer architecture, most approaches focus on a limited number of tasks, with scaling to extremely massive tasks remaining a formidable challenge. In this paper, we f…

2025

Meta-Conscious Driven Domain-Aware Federated Learning

ICASSP 2025accepted

Cross-domain collaboration can drive comprehensive knowledge innovation and foster synergistic advancements. Federated learning (FL) enables such collaboration while ensuring data security. However, cross-domain FL often faces challenges due to knowledge interference between domains, which can resul…

Cited by 0SourceScholar
2025

Mitigating Heterogeneous Token Overfitting in LLM Knowledge Editing

ICML 2025poster

Large language models (LLMs) have achieved remarkable performance on various natural language tasks. However, they are trained on static corpora and their knowledge can become outdated quickly in the fast-changing world. This motivates the development of knowledge editing (KE) to update specific kn…

Cited by 3SourcePDFScholar
2025

PARROT: A Benchmark for Evaluating LLMs in Cross-System SQL Translation

NeurIPS 2025poster

Large language models (LLMs) have shown increasing effectiveness in Text-to-SQL tasks. However, another closely related problem, Cross-System SQL Translation (a.k.a., SQL-to-SQL), which adapts a query written for one database system (e.g., MySQL) into its equivalent one for another system (e.g., Cli…

Cited by 0SourcecodeScholar
2025

Perplexity Trap: PLM-Based Retrievers Overrate Low Perplexity Documents

ICLR 2025poster

Previous studies have found that PLM-based retrieval models exhibit a preference for LLM-generated content, assigning higher relevance scores to these documents even when their semantic quality is comparable to human-written ones. This phenomenon, known as source bias, threatens the sustainable deve…

2025

Prompt-Free Conditional Diffusion for Multi-object Image Augmentation

IJCAI 2025

Diffusion model has underpinned much recent advances of dataset augmentation in various computer vision tasks. However, when involving generating multi-object images as real scenarios, most existing methods either rely entirely on text condition, resulting in a deviation between the generated object

2025

ProsodyFlow: High-fidelity Text-to-Speech through Conditional Flow Matching and Prosody Modeling with Large Speech Language Models

COLING 2025main

Text-to-speech (TTS) has seen significant advancements in high-quality, expressive speech synthesis. However, achieving diverse and natural prosody in synthesized speech remains challenging. In this paper, we propose ProsodyFlow, an end-to-end TTS model that integrates large self-supervised speech m…

Cited by 0SourcePDFScholar
2025

Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model

ICLR 2025poster

Electrocardiogram (ECG) is essential for the clinical diagnosis of arrhythmias and other heart diseases, but deep learning methods based on ECG often face limitations due to the need for high-quality annotations. Although previous ECG self-supervised learning (eSSL) methods have made significant pro…

2025

RoseRAG: Robust Retrieval-augmented Generation with Small-scale LLMs via Margin-aware Preference Optimization

ACL 2025finding

Large language models (LLMs) have achieved impressive performance but face high computational costs and latency, limiting their deployment in resource-constrained settings. In contrast, small-scale LLMs (SLMs) are more efficient yet struggle to capture evolving real-world knowledge. Retrieval-augmen…

2025

Spatial Alignment and Temporal Matching Adapter for Video-Radar Remote Physiological Measurement

ICCV 2025poster

Remote physiological measurement (RPM) based on video and radar has made significant progress in recent years. However, unimodal methods based solely on video or radar sensor have notable limitations due to their measurement principles, and multimodal RPM that combines these modalities has emerged a…

Cited by 0SourcePDFScholar
2025

The Dual Nature of Plasticity Loss in Deep Continual Learning: Dissection and Mitigation

NeurIPS 2025poster

Loss of plasticity (LoP) is the primary cause of cognitive decline in normal aging brains next to cell loss. Recent works show that similar LoP also plagues neural networks during deep continual learning (DCL). While it has been shown that random perturbations of learned weights can alleviate LoP,…

Cited by 0SourceScholar
2025

Towards Federated RLHF with Aggregated Client Preference for LLMs

ICLR 2025poster

Reinforcement learning with human feedback (RLHF) fine-tunes a pretrained large language model (LLM) using user preference data, enabling it to generate content aligned with human preferences. However, due to privacy concerns, users may be reluctant to share sensitive preference data. To address thi…

Cited by 0SourcePDFScholar
2025

Towards Precise Embodied Dialogue Localization via Causality Guided Diffusion

CVPR 2025poster

Embodied localization based on vision and natural language dialogues presents a persistent challenge in embodied intelligence. Existing methods often approach this task as an image translation problem, leveraging encoder-decoder architectures to predict heatmaps. However, these methods frequently ex…

Cited by 0SourcePDFScholar
2025

UACOF: A USV-AUV Collaboration Framework for Underwater Tasks Under Extreme Sea Conditions (Student Abstract)

AAAI 2025technical

Ocean exploration requires effective collaboration between the unmanned surface vehicle (USV) and autonomous underwater vehicles (AUVs). We propose UACOF, a USV-AUV collaboration framework that enhances multi-AUV performance under extreme sea conditions. The framework includes high-precision multi-A…

2025

Unlocking Efficient, Scalable, and Continual Knowledge Editing with Basis-Level Representation Fine-Tuning

ICLR 2025poster

Large language models (LLMs) have achieved remarkable performance on vari- ous natural language tasks. However, they are trained on static corpora and their knowledge can become outdated quickly in the fast-changing world. This moti- vates the development of knowledge editing methods designed to upd…

Cited by 1SourcePDFScholar
2025

Whole-Body Constrained Learning for Legged Locomotion via Hierarchical Optimization

RA-L 2025

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real world still suffer from inevitable safety issues, such as joi

Cited by 2SourceScholar
2025

Word-Level Emotional Expression Control in Zero-Shot Text-to-Speech Synthesis

NeurIPS 2025spotlight

While emotional text-to-speech (TTS) has made significant progress, most existing research remains limited to utterance-level emotional expression and fails to support word-level control. Achieving word-level expressive control poses fundamental challenges, primarily due to the complexity of modelin…

Cited by 0SourceScholar
2024

Arm-Constrained Curriculum Learning for Loco-Manipulation of a Wheel-Legged Robot

IROS 2024poster

Incorporating a robotic manipulator into a wheellegged robot enhances its agility and expands its potential for practical applications. However, the presence of potential instability and uncertainties presents additional challenges for control objectives. In this paper, we introduce an arm-constrain…

Cited by 5SourcecodeScholar
2024

Augmenting Reasoning Capabilities of LLMs with Graph Structures in Knowledge Base Question Answering

EMNLP 2024finding

Recently, significant progress has been made in employing Large Language Models (LLMs) for semantic parsing to address Knowledge Base Question Answering (KBQA) tasks. Previous work utilize LLMs to generate query statements on Knowledge Bases (KBs) for retrieving answers. However, LLMs often generate…

2024

BLINK: Multimodal Large Language Models Can See but Not Perceive

ECCV 2024poster

"We introduce , a new benchmark for multimodal language models (LLMs) that focuses on core visual perception abilities not found in other evaluations. Most of the tasks can be solved by humans “within a blink” (, relative depth estimation, visual correspondence, forensics detection, and multi-view r…

2024

BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering

EMNLP 2024main

Retrieval-augmented Large Language Models (LLMs) offer substantial benefits in enhancing performance across knowledge-intensive scenarios. However, these methods often struggle with complex inputs and encounter difficulties due to noisy knowledge retrieval, notably hindering model effectiveness. To…

Cited by 16SourcePDFScholar
2024

Contactless Radar Heart Rate Variability Monitoring Via Deep Spatio-Temporal Modeling

ICASSP 2024accepted

Radar sensing has been a promising solution for contactless monitoring of Heart Rate Variability (HRV), an essential indicator of the cardiovascular and autonomic nervous systems. However, existing works neglect heartbeat-driven body surface motions spreading across the entire body with spatial vari…

Cited by 0SourceScholar
2024

Cross-video Identity Correlating for Person Re-identification Pre-training

NeurIPS 2024poster

Recent researches have proven that pre-training on large-scale person images extracted from internet videos is an effective way in learning better representations for person re-identification. However, these researches are mostly confined to pre-training at the instance-level or single-video trackle…

2024

Effective In-Context Example Selection through Data Compression

ACL 2024findings

In-context learning has been extensively validated in large language models. However, the mechanism and selection strategy for in-context example selection, which is a crucial ingredient in this approach, lacks systematic and in-depth research. In this paper, we propose a data compression approach t…

Cited by 1SourcePDFScholar
2024

Efficient Training of Spiking Neural Networks with Multi-Parallel Implicit Stream Architecture

ECCV 2024poster

"Spiking neural networks (SNNs) are a novel type of bio-plausible neural network with energy efficiency. However, SNNs are non-differentiable and the training memory costs increase with the number of simulation steps. To address these challenges, this work introduces an implicit training method for…

2024

Event Causality Identification with Synthetic Control

EMNLP 2024main

Event causality identification (ECI), a process that extracts causal relations between events from text, is crucial for distinguishing causation from correlation. Traditional approaches to ECI have primarily utilized linguistic patterns and multi-hop relational inference, risking false causality ide…

Cited by 1SourcePDFScholar
2024

LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models

ICML 2024spotlight

Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g., female), raising severe fairness concerns. As remedies, pri…

Cited by 0SourcePDFScholar
2024

Logic Rules as Explanations for Legal Case Retrieval

COLING 2024main

In this paper, we address the issue of using logic rules to explain the results from legal case retrieval. The task is critical to legal case retrieval because the users (e.g., lawyers or judges) are highly specialized and require the system to provide logic, faithful, and interpretable explanations…

2024

NoiseGPT: Label Noise Detection and Rectification through Probability Curvature

NeurIPS 2024poster

Machine learning craves high-quality data which is a major bottleneck during realistic deployment, as it takes abundant resources and massive human labor to collect and label data. Unfortunately, label noise where image data mismatches with incorrect label exists ubiquitously in all kinds of dataset…

2024

Ospreys-inspired Self-takeoff Strategy of An Eagle-scale Flapping-wing Robot: System Design and Flight Experiments

ICRA 2024poster

In this work, we achieved a self-takeoff of an eagle-scale flapping-wing robot for the first time. Inspired by the takeoff process of Ospreys, we propose a bio-inspired takeoff strategy, then discuss the dynamic model and the requirements for self-takeoff. Based on the requirements of flight strateg…

Cited by 6SourceScholar
2024

RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning

EMNLP 2024main

Pre-trained language models, trained on large-scale corpora, demonstrate strong generalizability across various NLP tasks. Fine-tuning these models for specific tasks typically involves updating all parameters, which is resource-intensive. Parameter-efficient fine-tuning (PEFT) methods, such as the…

2024

Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes

ICLR 2024poster

Merging multi-exposure images is a common approach for obtaining high dynamic range (HDR) images, with the primary challenge being the avoidance of ghosting artifacts in dynamic scenes. Recent methods have proposed using deep neural networks for deghosting. However, the methods typically rely on suf…

2024

UltraLink: An Open-Source Knowledge-Enhanced Multilingual Supervised Fine-tuning Dataset

ACL 2024long

Open-source large language models (LLMs) have gained significant strength across diverse fields. Nevertheless, the majority of studies primarily concentrate on English, with only limited exploration into the realm of multilingual abilities.In this work, we therefore construct an open-source multilin…

2024

Visual Pinwheel Centers Act as Geometric Saliency Detectors

NeurIPS 2024poster

During natural evolution, the primary visual cortex (V1) of lower mammals typically forms salt-and-pepper organizations, while higher mammals and primates develop pinwheel structures with distinct topological properties. Despite the general belief that V1 neurons primarily serve as edge detectors, t…

Cited by 1SourcePDFScholar
2023

Adaptive Learning and Sliding Mode Control for a Magnetic Microrobot Precision Tracking With Uncertainties

RA-L 2023

Magnetic microrobots have potential applications in many medical diagnosis and treatment due to the unique characteristics in biological fine manipulation, such as precise drug delivery and hyperthermia. Precise and robust trajectory tracking control of magnetic microrobots under complex disturbance

Cited by 23SourceScholar
2023

Are All Steps Equally Important? Benchmarking Essentiality Detection in Event Processes

EMNLP 2023short main

Natural language often describes events in different granularities, such that more coarse-grained (goal) events can often be decomposed into fine-grained sequences of (step) events. A critical but overlooked challenge in understanding an event process lies in the fact that the step events are not eq…

Cited by 0SourceScholar
2023

Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistency

CVPR 2023poster

Deep neural networks are proven to be vulnerable to backdoor attacks. Detecting the trigger samples during the inference stage, i.e., the test-time trigger sample detection, can prevent the backdoor from being triggered. However, existing detection methods often require the defenders to have high ac…

2023

Generic Temporal Reasoning with Differential Analysis and Explanation

ACL 2023long

Temporal reasoning is the task of predicting temporal relations of event pairs. While temporal reasoning models can perform reasonably well on in-domain benchmarks, we have little idea of these systems’ generalizability due to existing datasets’ limitations. In this work, we introduce a novel task n…

Cited by 18SourcePDFScholar
2023

Glocal Energy-Based Learning for Few-Shot Open-Set Recognition

CVPR 2023poster

Few-shot open-set recognition (FSOR) is a challenging task of great practical value. It aims to categorize a sample to one of the pre-defined, closed-set classes illustrated by few examples while being able to reject the sample from unknown classes. In this work, we approach the FSOR task by proposi…

2023

HadSkip: Homotopic and Adaptive Layer Skipping of Pre-trained Language Models for Efficient Inference

EMNLP 2023long findings

Pre-trained language models~(LMs) have brought remarkable performance on numerous NLP tasks. However, they require significant resources and entail high computational costs for inference, making them challenging to deploy in real-world and real-time systems. Existing early exiting methods aim to red…

Cited by 0SourceScholar
2023

Learning Better with Less: Effective Augmentation for Sample-Efficient Visual Reinforcement Learning

NeurIPS 2023poster

Data augmentation (DA) is a crucial technique for enhancing the sample efficiency of visual reinforcement learning (RL) algorithms. Notably, employing simple observation transformations alone can yield outstanding performance without extra auxiliary representation tasks or pre-trained encoders. Howe…

2023

Macedon: Minimizing Representation Coding Rate Reduction for Cross-Lingual Natural Language Understanding

EMNLP 2023long findings

Cross-lingual natural language understanding(NLU) is one of the fundamental tasks of NLP. The goal is to learn a model which can generalize well on both high-resource and low-resource language data. Recent pre-trained multilingual language models, e.g., multilingual BERT, XLM, have shown impressive…

Cited by 0SourceScholar
2023

SimFair: A Unified Framework for Fairness-Aware Multi-Label Classification

AAAI 2023technical

Recent years have witnessed increasing concerns towards unfair decisions made by machine learning algorithms. To improve fairness in model decisions, various fairness notions have been proposed and many fairness-aware methods are developed. However, most of existing definitions and methods focus onl…

Cited by 6SourcePDFScholar
2022

CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving

ECCV 2022poster

"Contemporary deep-learning object detection methods for autonomous driving usually assume prefixed categories of common traffic participants, such as pedestrians and cars. Most existing detectors are unable to detect uncommon objects and corner cases (e.g., a dog crossing a street), which may lead…

2022

Estimating Spatially-Varying Lighting in Urban Scenes with Disentangled Representation

ECCV 2022poster

"We present an end-to-end network for spatially-varying outdoor lighting estimation in urban scenes given a single limited field-of-view LDR image and any assigned 2D pixel position. We use three disentangled latent spaces learned by our network to represent sky light, sun light, and lighting-indepe…

Cited by 15SourcePDFScholar
2022

RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios

NAACL 2022system demonstrations

We introduce RESIN-11, a new schema-guided event extraction&prediction framework that can be applied to a large variety of newsworthy scenarios. The framework consists of two parts: (1) an open-domain end-to-end multimedia multilingual information extraction system with weak-supervision and zero-sho…

2022

Self-Knowledge Distillation via Feature Enhancement for Speaker Verification

ICASSP 2022accepted

As the most widely used technique, deep speaker embedding learning has become predominant in speaker verification task recently. Very large neural networks such as ECAPA-TDNN and ResNet can achieve the state-of-the-art performance. However, large models are computationally unfriendly in general, whi…

Cited by 0SourceScholar
2021

Learning Constraints and Descriptive Segmentation for Subevent Detection

EMNLP 2021main

Event mentions in text correspond to real-world events of varying degrees of granularity. The task of subevent detection aims to resolve this granularity issue, recognizing the membership of multi-granular events in event complexes. Since knowing the span of descriptive contexts of event complexes h…

Cited by 26SourcePDFScholar
2021

REGNet: REgion-based Grasp Network for End-to-end Grasp Detection in Point Clouds

ICRA 2021poster

Reliable robotic grasping in unstructured environments is a crucial but challenging task. The main problem is to generate the optimal grasp of novel objects from partial noisy observations. This paper presents an end-to-end grasp detection network taking one single-view point cloud as input to tackl…

Cited by 104SourcecodeScholar
2021

RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System

NAACL 2021system demonstrations

We present a new information extraction system that can automatically construct temporal event graphs from a collection of news documents from multiple sources, multiple languages (English and Spanish for our experiment), and multiple data modalities (speech, text, image and video). The system advan…

2018

Saliency-Based Feature Selection Strategy in Stereoscopic Panoramic Video Generation

ICASSP 2018accepted

In this paper, we present one saliency-based feature selection and tracking strategy in the feature-based stereoscopic panoramic video generation system. Many existing stereoscopic video composition approaches aim at producing high-quality panoramas from multiple input cameras; however, most of them…

Cited by 0SourceScholar