← Search

Rui Li

111 accepted papers

2026

FIRE: Learning to Navigate and Act on Real-World Files via Stateful Reinforcement Learning

ICML 2026poster

Large language models still struggle to reliably answer questions grounded in real-world files like spreadsheets and slides, where evidence is scattered across irregular layouts and heterogeneous formats. We address this by formalizing File Reasoning, a setting where agents must interact directly wi…

Cited by 0SourceScholar
2026

FedP²EFT: Federated Learning to Personalize PEFT for Multilingual LLMs

AAAI 2026technical

Federated learning (FL) has enabled training of multilingual large language models (LLMs) on diverse and decentralized multilingual data, especially on low-resource languages. To improve client-specific performance, personalization via the use of parameter-efficient fine-tuning (PEFT) modules such a

Cited by 0SourcePDFScholar
2026

From Diagnosis to Generalization: A Cognitive Approach to Data Selection for Educational LLMs

AAAI 2026technical

Specializing Large Language Models for educational domains is a key frontier in creating personalized learning tools. The central challenge is not data scarcity but its abundance: efficiently selecting a curated data subset from vast corpora to enhance specialized skills and foster generalization, w

Cited by 0SourcePDFScholar
2026

HierarchicalPrune: Position-Aware Compression for Large-Scale Diffusion Models

AAAI 2026technical

State-of-the-art text-to-image diffusion models (DMs) achieve remarkable quality, yet their massive parameter scale (8-11B) poses significant challenges for inferences on resource-constrained devices. In this paper, we present HierarchicalPrune, a novel compression framework grounded in a key observ

Cited by 0SourcePDFScholar
2026

LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoning

ICML 2026poster

We present Layered Ray Intersections (LaRI), a fully supervised method for occluded geometry reasoning from a single image. Unlike conventional depth estimation, which is limited to visible surfaces, LaRI predicts multiple surfaces intersected by the camera rays using layered point maps. Compared to…

Cited by 0SourceScholar
2026

LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory

ICML 2026poster

Automated laboratories hold the promise of accelerating scientific discovery, yet their deployment is bottlenecked by the difficulty of designing safe and executable environments. While simulator-based design offers scalability, existing 3D scene generation methods are primarily tailored for househo…

Cited by 0SourceScholar
2026

Large Language Models Struggle with Unreasonability in Math Problems

AAAI 2026technical

Large Language Models (LLMs) have shown remarkable success on a wide range of math and reasoning benchmarks. However, we observe that they often struggle when faced with unreasonable math problems. Instead of recognizing these issues, models frequently proceed as if the problem is well-posed, produc

Cited by 0SourcePDFScholar
2026

LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoning

AAAI 2026technical

Text-to-SQL is a critical task in natural language processing that aims to transform natural language questions into accurate and executable SQL queries. In real-world scenarios, these reasoning tasks are often accompanied by complex mathematical computations, domain knowledge, and hypothetical reas

Cited by 0SourcePDFScholar
2026

MA-RWG: A Multi-Agent Framework for Thematically Structuring and Generation of Related Work

IJCAI 2026

AI-driven survey generation has advanced rapidly, yet related work generation (RWG) remains relatively underexplored. Unlike surveys that provide broad literature overviews, RWG synthesizes prior studies for a single focal paper, requiring contextual fit, cross-paper comparison, and accurate attribu

Cited by 0Scholar
2026

Post-hoc Probabilistic Vision-Language Models

ICLR 2026poster

Vision-language models (VLMs), such as CLIP and SigLIP, have found remarkable success in classification, retrieval, and generative tasks. For this, VLMs deterministically map images and text descriptions to a joint latent space in which their similarity is assessed using the cosine similarity. Howev…

Cited by 0SourcecodeScholar
2026

Prompt and Parameter Co-Optimization for Large Language Models

ICLR 2026poster

Prompt optimization and fine-tuning are two major approaches to improve the performance of Large Language Models (LLMs). They enhance the capabilities of LLMs from complementary perspectives: the former through explicit natural language, and the latter through implicit parameter updates. However, p…

Cited by 0SourceScholar
2026

Seeing What Matters: Visual Preference Policy Optimization for Visual Generation

CVPR 2026

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines rely on a single scalar reward per sample, treating each im

Cited by 0SourceScholar
2026

Shortcut Diffusion Training with Cumulative Consistency Loss: An Optimal Control View

ICLR 2026poster

Although iterative denoising (i.e., diffusion/flow) methods offer strong generative performance, they suffer from low generation efficiency, requiring hundreds of steps of network forward passes to simulate a single sample. Mitigating this requires taking larger step-sizes during simulation, thereby…

Cited by 0SourcecodeScholar
2026

Topology-aware Feature Propagation for Unsupervised Non-rigid Point Cloud Correspondence

CVPR 2026

Unsupervised non-rigid point cloud correspondence aims to predict point-to-point correspondences without annotations. Existing methods leverage the spatial-relation-based feature propagation strategy that includes non-physical connections, which are sensitive to non-rigid deformation. To address thi

Cited by 0SourceScholar
2025

AIDC: Benchmark for Analytical Learning in Incremental Disease Classification

ICASSP 2025accepted

Class Incremental Learning (CIL) aims to enable models to continuously learn new categories while retaining previous classification abilities. In medical scenarios, where new disease categories frequently emerge, CIL becomes crucial. Traditional CIL approaches often face "catastrophic forgetting". A…

Cited by 0SourceScholar
2025

Automated Clinical Data Extraction with Knowledge Conditioned LLMs

COLING 2025industry

The extraction of lung lesion information from clinical and medical imaging reports is crucial for research on and clinical care of lung-related diseases. Large language models (LLMs) can be effective at interpreting unstructured text in reports, but they often hallucinate due to a lack of domain-sp…

Cited by 11SourcePDFScholar
2025

Beyond Single Frames: Can LMMs Comprehend Implicit Narratives in Comic Strip?

EMNLP 2025

Large Multimodal Models (LMMs) have demonstrated strong performance on vision-language benchmarks, yet current evaluations predominantly focus on single-image reasoning. In contrast, real-world scenarios always involve understanding sequences of images. A typical scenario is comic strips understandi

Cited by 0SourcePDFScholar
2025

CA-GAR: Context-Aware Alignment of LLM Generation for Document Retrieval

ACL 2025finding

Information retrieval has evolved from traditional sparse and dense retrieval methods to approaches driven by large language models (LLMs). Recent techniques, such as Generation-Augmented Retrieval (GAR) and Generative Document Retrieval (GDR), leverage LLMs to enhance retrieval but face key challen…

Cited by 0SourcePDFScholar
2025

CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension

NeurIPS 2025poster

Current Large Language Models (LLMs) are confronted with overwhelming information volume when comprehending long-form documents. This challenge raises the imperative of a cohesive memory module, which can elevate vanilla LLMs into autonomous reading agents. Despite the emergence of some heuristic ap…

Cited by 0SourceScholar
2025

CursorCore: Assist Programming through Aligning Anything

ICML 2025poster

Large language models have been successfully applied to programming assistance tasks, such as code completion, code insertion, and instructional code editing. However, these applications remain insufficiently automated and struggle to effectively integrate various types of information during the pro…

2025

Distribution-Driven Dense Retrieval: Modeling Many-to-One Query-Document Relationship

AAAI 2025technical

Dense retrieval has emerged as the leading approach in information retrieval, aiming to find semantically relevant documents based on natural language queries. Given that a single document can be retrieved by multiple distinct queries, existing methods aim to represent a document with multiple vecto…

2025

Dovetail: A CPU/GPU Heterogeneous Speculative Decoding for LLM inference

EMNLP 2025

With the continuous advancement in the performance of large language models (LLMs), their demand for computational resources and memory has significantly increased, which poses major challenges for efficient inference on consumer-grade devices and legacy servers. These devices typically feature rela

2025

Facilitating Semi-Supervised Pedestrian Detection with Structurally Controllable Instance Synthesis

ICASSP 2025accepted

The performance of pedestrian detectors typically relies on sufficient labeled data, and semi-supervised learning is a promising way to address the deficiency in manual annotations by utilizing sufficient unlabeled images. In this work, we design a Structure-Controllable Pedestrian Instance Generati…

Cited by 0SourceScholar
2025

Fixed-Time Variable Gain Trajectory Tracking Control for 6-DOF Manipulators With Unknown Disturbances

RA-L 2025

In this paper, fixed-time variable gain trajectory tracking control is designed for solving nonlinear unknown disturbance problems of 6-DOF manipulators. The designed control method comprises a fixed-time variable gain disturbance observer (FTVGDOB) and a fixed-time variable gain controller (FTVGC),

Cited by 0SourceScholar
2025

Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference

EMNLP 2025

The auto-regressive decoding of Large Language Models (LLMs) results in significant overheads in their hardware performance. While recent research has explored various speculative decoding techniques for multi-token generation, these methods introduce high memory costs from the additional weights an

2025

Harnessing Heterogeneous Statistical Strength for Personalized Federated Learning via Hierarchical Bayesian Inference

ICML 2025poster

Personalized federated learning (PFL) based on Bayesian approach tackle the challenges from statistical heterogeneity of client data by computing a personalized posterior distribution over the parameters of each client's local model and constructing a global distribution by aggregating the parameter…

Cited by 0SourcePDFScholar
2025

How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulation

ACL 2025finding

Recently, LLMs have garnered increasing attention across academic disciplines for their potential as human digital twins, virtual proxies designed to replicate individuals and autonomously perform tasks such as decision-making, problem-solving, and reasoning on their behalf.However, current evaluati…

2025

LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents

NeurIPS 2025poster

Scientific embodied agents play a crucial role in modern laboratories by automating complex experimental workflows. Compared to typical household environments, laboratory settings impose significantly higher demands on perception of physical-chemical transformations and long-horizon planning, making…

Cited by 0SourcecodeScholar
2025

Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment

EMNLP 2025

With rapid advancement and increasing accessibility of LLMs, fine-tuning aligned models has become a critical step for adapting them to real-world applications, which makes the safety of this fine-tuning process more important than ever. However, recent studies have highlighted a critical challenge:

2025

MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistants

NeurIPS 2025poster

LLM-based agents have been widely applied as personal assistants, capable of memorizing information from user messages and responding to personal queries. However, there still lacks an objective and automatic evaluation on their memory capability, largely due to the challenges in constructing reliab…

Cited by 0SourcecodeScholar
2025

Multi-perspective Preference Alignment of LLMs for Programming-Community Question Answering

COLING 2025main

Programming-Community Question Answering (PCQA) aims to tackle issues through generating functional code and guiding descriptions. It involves multiple candidates, with different users having varying preferences for them. Additionally, one may contain outdated APIs. These undoubtedly present a chall…

2025

PQR: Improving Dense Retrieval via Potential Query Modeling

ACL 2025long

Dense retrieval has now become the mainstream paradigm in information retrieval. The core idea of dense retrieval is to align document embeddings with their corresponding query embeddings by maximizing their dot product. The current training data is quite sparse, with each document typically associa…

Cited by 0SourcePDFScholar
2025

Progressive Prefix-Memory Tuning for Complex Logical Query Answering on Knowledge Graphs

IJCAI 2025

Conducting complex logical queries over knowledge graphs remains a significant challenge. Recent research has successfully leveraged Pre-trained Language Models (PLMs) to tackle Knowledge Graph Complex Query Answering (KGCQA) tasks, which is attributed to PLMs' ability to comprehend logical semantic

2025

Prompt-augmented Feature with Cross-domain Contrastive Learning for Efficient Multi-domain Sentiment Analysis

ICASSP 2025accepted

Pre-trained language models (PrLMs) demonstrate impressive performance on the sentiment analysis task. However, the large number of trainable parameters brings about heavy computational costs, which become more serious in multi-domain scenarios. In this paper, we propose to extract multi-layer featu…

Cited by 0SourceScholar
2025

Refining Sentence Embedding Model through Ranking Sentences Generation with Large Language Models

ACL 2025finding

Sentence embedding is essential for many NLP tasks, with contrastive learning methods achieving strong performance using annotated datasets like NLI. Yet, the reliance on manual labels limits scalability. Recent studies leverage large language models (LLMs) to generate sentence pairs, reducing annot…

2025

Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Views

CVPR 2025poster

We present a Gaussian Splatting method for surface reconstruction using sparse input views. Previous methods relying on dense views struggle with extremely sparse Structure-from-Motion points for initialization. While learning-based Multi-view Stereo (MVS) provides dense 3D points, directly combinin…

2025

SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines

NeurIPS 2025poster

Large language models (LLMs) have demonstrated remarkable proficiency in mainstream academic disciplines such as mathematics, physics, and computer science. However, human knowledge encompasses over 200 specialized disciplines, far exceeding the scope of existing benchmarks. The capabilities of LLMs…

Cited by 215SourceScholar
2025

Towards Harmonized Uncertainty Estimation for Large Language Models

ACL 2025long

To facilitate robust and trustworthy deployment of large language models (LLMs), it is essential to quantify the reliability of their generations through uncertainty estimation. While recent efforts have made significant advancements by leveraging the internal logic and linguistic features of LLMs t…

Cited by 0SourcePDFScholar
2025

Towards Straggler-Resilient Split Federated Learning: An Unbalanced Update Approach

NeurIPS 2025poster

Split Federated Learning (SFL) enables scalable training on edge devices by combining the parallelism of Federated Learning (FL) with the computational offloading of Split Learning (SL). Despite its great success, SFL suffers significantly from the well-known straggler issue in distributed learning…

Cited by 0SourceScholar
2025

TrendSim: Simulating Trending Topics in Social Media Under Poisoning Attacks with LLM-based Multi-agent System

NAACL 2025findings

Trending topics have become a significant part of modern social media, attracting users to participate in discussions of breaking events. However, they also bring in a new channel for poisoning attacks, resulting in negative impacts on society. Therefore, it is urgent to study this critical problem…

2025

UniRAG: Unified Query Understanding Method for Retrieval Augmented Generation

ACL 2025long

Retrieval-Augmented Generation (RAG) technology effectively addresses the issues of knowledge update lag and hallucinations in large language models (LLMs) by integrating internal and external knowledge. Existing query augmentation methods improve RAG’s performance in handling complex queries but fa…

Cited by 0SourcePDFScholar
2025

Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarios

ICRA 2025

Monocular depth estimation from RGB images plays a pivotal role in 3D vision. However, its accuracy can deteriorate in challenging environments such as nighttime or adverse weather conditions. While long-wave infrared cameras offer stable imaging in such challenging conditions, they are inherently l

Cited by 6SourceScholar
2025

VERSE: Verification-based Self-Play for Code Instructions

AAAI 2025technical

Instruction-tuned Code Large Language Models (Code LLMs) have excelled in diverse code-related tasks, such as program synthesis, automatic program repair, and code explanation. To collect training datasets for instruction-tuning, a popular method involves having models autonomously generate instruct…

2024

A Spiny Claws Climbing Robot Based on Self-Sensing Soles

RA-L 2024

Adaptive climbing on different surfaces is a great challenge for conventional robots due to a lack of self-sensing capabilities. Inspired by the exceptional sensing ability of feline soles, this study proposes a quadrupedal climbing robot based on self-sensing spiny-claw soles. First, a spiny-claw s

Cited by 2SourceScholar
2024

A Unified Adaptive Testing System Enabled by Hierarchical Structure Search

ICML 2024poster

Adaptive Testing System (ATS) is a promising testing mode, extensively utilized in standardized tests like the GRE. It offers personalized ability assessment by dynamically adjusting questions based on individual ability levels. Compared to traditional exams, ATS can improve the accuracy of ability…

Cited by 4SourcePDFScholar
2024

APDDv2: Aesthetics of Paintings and Drawings Dataset with Artist Labeled Scores and Comments

NeurIPS 2024poster

Datasets play a pivotal role in training visual models, facilitating the development of abstract understandings of visual features through diverse image samples and multidimensional attributes. However, in the realm of aesthetic evaluation of artistic images, datasets remain relatively scarce. Exist…

2024

Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations

ICML 2024poster

Large-scale recommendation systems are characterized by their reliance on high cardinality, heterogeneous features and the need to handle tens of billions of user actions on a daily basis. Despite being trained on huge volume of data with thousands of features, most Deep Learning Recommendation Mode…

2024

Be a Multitude to Itself: A Prompt Evolution Framework for Red Teaming

EMNLP 2024finding

Large Language Models (LLMs) have gained increasing attention for their remarkable capacity, alongside concerns about safety arising from their potential to produce harmful content. Red teaming aims to find prompts that could elicit harmful responses from LLMs, and is essential to discover and mitig…

Cited by 0SourcePDFScholar
2024

Breakthrough from Nuance and Inconsistency: Enhancing Multimodal Sarcasm Detection with Context-Aware Self-Attention Fusion and Word Weight Calculation.

COLING 2024main

Multimodal sarcasm detection has received considerable attention due to its unique role in social networks. Existing methods often rely on feature concatenation to fuse different modalities or model the inconsistencies among modalities. However, sarcasm is often embodied in local and momentary nuanc…

2024

CONSIDER: Commonalities and Specialties Driven Multilingual Code Retrieval Framework

AAAI 2024technical

Multilingual code retrieval aims to find code snippets relevant to a user's query from a multilingual codebase, which plays a crucial role in software development and expands their application scenarios compared to classical monolingual code retrieval. Despite the performance improvements achieved b…

2024

Design and Validation of Flexible Aerial Robotics for Safe Human-Robot Interaction

IROS 2024poster

This work addresses the critical challenge of integrating drones into human-aerial robot interaction by presenting a novel Soft Flexible Aerial Robotics (SFAR) design. SFAR features an innovative low-pressure inflatable airbag structure that replaces traditional rigid frames, enhancing safety by mit…

Cited by 0SourceScholar
2024

Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier Domain

AAAI 2024technical

RAW to sRGB mapping, which aims to convert RAW images from smartphones into RGB form equivalent to that of Digital Single-Lens Reflex (DSLR) cameras, has become an important area of research. However, current methods often ignore the difference between cell phone RAW images and DSLR camera RGB image…

2024

Feature Structure Matching for Multi-source Sentiment Analysis with Efficient Adaptive Tuning

COLING 2024main

Recently, fine-tuning the large pre-trained language models on the labeled sentiment dataset achieves appealing performance. However, the obtained model may not generalize well to the other domains due to the domain shift, and it is expensive to update the entire parameters within the large models.…

2024

Frequency-Adaptive Pan-Sharpening with Mixture of Experts

AAAI 2024technical

Pan-sharpening involves reconstructing missing high-frequency information in multi-spectral images with low spatial resolution, using a higher-resolution panchromatic image as guidance. Although the inborn connection with frequency domain, existing pan-sharpening research has not almost investigated…

2024

Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization

ICML 2024poster

Recent advances in knowledge graph embedding (KGE) rely on Euclidean/hyperbolic orthogonal relation transformations to model intrinsic logical patterns and topological structures. However, existing approaches are confined to rigid relational orthogonalization with restricted dimension and homogeneou…

2024

Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning

CVPR 2024poster

Recovering the 3D scene geometry from a single view is a fundamental yet ill-posed problem in computer vision. While classical depth estimation methods infer only a 2.5D scene representation limited to the image plane recent approaches based on radiance fields reconstruct a full 3D representation. H…

2024

Optimal Transport-based Labor-free Text Prompt Modeling for Sketch Re-identification

NeurIPS 2024poster

Sketch Re-identification (Sketch Re-ID), which aims to retrieve target person from an image gallery based on a sketch query, is crucial for criminal investigation, law enforcement, and missing person searches. Existing methods aim to alleviate the modality gap by employing semantic metrics constra…

Cited by 0SourcePDFScholar
2024

Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models

EMNLP 2024main

Code retrieval aims to identify code from extensive codebases that semantically aligns with a given query code snippet. Collecting a broad and high-quality set of query and code pairs is crucial to the success of this task. However, existing data collection methods struggle to effectively balance sc…

Cited by 5SourcePDFScholar
2024

PS-Loc: Robust LiDAR Localization with Prior Structural Reference

IROS 2024poster

Prior structural reference like floor plan is readily accessible in indoor scene, which exhibits the potential of improving localization quality without the requirements of a previously-built high-precision map. This paper introduces a novel optimal transport-based framework for prior structural ref…

Cited by 0SourceScholar
2024

RePair: Automated Program Repair with Process-based Feedback

ACL 2024findings

The gap between the trepidation of program reliability and the expense of repairs underscore the indispensability for Automated Program Repair (APR). APR is instrumental in transforming vulnerable programs into more robust ones, bolstering program reliability while simultaneously diminishing the fin…

2024

Reflective Multi-Agent Collaboration based on Large Language Models

NeurIPS 2024poster

Benefiting from the powerful language expression and planning capabilities of Large Language Models (LLMs), LLM-based autonomous agents have achieved promising performance in various downstream tasks. Recently, based on the development of single-agent systems, researchers propose to construct LLM-ba…

Cited by 4SourcePDFScholar
2024

SGM: A Dataset for 3D Garment Reconstruction from Single Hand-Drawn Sketch

ICASSP 2024accepted

High-fidelity garment reconstruction is essential for various applications such as garment design and virtual try-on. While image-based reconstruction methods have made significant progress with deep generative models, generating 3D models from hand-drawn sketches to meet design intentions remains c…

Cited by 0SourceScholar
2024

ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors

EMNLP 2024finding

The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs’ responses in an aligned, customizable and explainable manner. In this paper, we propose ShieldLM, an LLM-based safety de…

2024

Solving the inverse problem of microscopy deconvolution with a residual Beylkin-Coifman-Rokhlin neural network

ECCV 2024poster

"Optic deconvolution in light microscopy (LM) refers to recovering the object details from images, revealing the ground truth of samples. Traditional explicit methods in LM rely on the point spread function (PSF) during image acquisition. Yet, these approaches often fall short due to inaccurate PSF…

2024

Text-conditional Attribute Alignment across Latent Spaces for 3D Controllable Face Image Synthesis

CVPR 2024poster

With the advent of generative models and vision language pretraining significant improvement has been made in text-driven face manipulation. The text embedding can be used as target supervision for expression control.However it is non-trivial to associate with its 3D attributesi.e. pose and illumina…

Cited by 0SourcePDFScholar
2024

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge

ICML 2024poster

On-device training is essential for user personalisation and privacy. With the pervasiveness of IoT devices and microcontroller units (MCUs), this task becomes more challenging due to the constrained memory and compute resources, and the limited availability of labelled user data. Nonetheless, prior…

2024

When Generative Adversarial Networks Meet Sequence Labeling Challenges

EMNLP 2024main

The current framework for sequence labeling encompasses a feature extractor and a sequence tagger. This study introduces a unified framework named SLGAN, which harnesses the capabilities of Generative Adversarial Networks to address the challenges associated with Sequence Labeling tasks. SLGAN not o…

2023

Feature Alignment and Uniformity for Test Time Adaptation

CVPR 2023poster

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains. We first address TTA as a feature revision problem due to the…

2023

Heterogeneous Diversity Driven Active Learning for Multi-Object Tracking

ICCV 2023poster

The existing one-stage multi-object tracking (MOT) algorithms have achieved satisfactory performance benefiting from a large amount of labeled data. However, acquiring plenty of laborious annotated frames is not practical in real applications. To reduce the cost of human annotations, we propose Hete…

Cited by 6PDFScholar
2023

Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models

ICML 2023poster

Approximate inference in Gaussian process (GP) models with non-conjugate likelihoods gets entangled with the learning of the model hyperparameters. We improve hyperparameter learning in GP models and focus on the interplay between variational inference (VI) and the learning target. While VI's lower…

2023

Knowledge Acquisition for Human-In-The-Loop Image Captioning

AISTATS 2023poster

Image captioning offers a computational process to understand the semantics of images and convey them using descriptive language. However, automated captioning models may not always generate satisfactory captions due to the complex nature of the images and the quality/size of the training data. We p…

2023

Learning To Fuse Monocular and Multi-View Cues for Multi-Frame Depth Estimation in Dynamic Scenes

CVPR 2023poster

Multi-frame depth estimation generally achieves high accuracy relying on the multi-view geometric consistency. When applied in dynamic scenes, e.g., autonomous driving, this consistency is usually violated in the dynamic areas, leading to corrupted estimations. Many multi-frame methods handle dynami…

2023

Learning on Large-scale Text-attributed Graphs via Variational Inference

ICLR 2023top-5%

This paper studies learning on text-attributed graphs (TAGs), where each node is associated with a text description. An ideal solution for such a problem would be integrating both the text and graph structure information with large language models and graph neural networks (GNNs). However, the probl…

2023

Prototype Knowledge Distillation for Medical Segmentation with Missing Modality

ICASSP 2023accepted

Multi-modality medical imaging is crucial in clinical treatment as it can provide complementary information for medical image segmentation. However, collecting multi-modal data in clinical is difficult due to the limitation of the scan time and other clinical situations. As such, it is clinically me…

Cited by 0SourceScholar
2023

TEFISTA-NET: GTD Parameter Estimation of Low-Frequency Ultra- Wideband Radar via Model-Based Deep Learning

ICASSP 2023accepted

The geometrical theory of diffraction (GTD) has been widely investigated to describe the target scattering behaviors with the low-frequency ultra-wideband (LFW) radar. In this paper, we propose a new model-based deep learning method for GTD parameter estimation. The proposed method is designed by un…

Cited by 0SourceScholar
2023

To Copy Rather Than Memorize: A Vertical Learning Paradigm for Knowledge Graph Completion

ACL 2023long

Embedding models have shown great power in knowledge graph completion (KGC) task. By learning structural constraints for each training triple, these methods implicitly memorize intrinsic relation rules to infer missing links. However, this paper points out that the multi-hop relation rules are hard…

2022

A New Perspective on the Effects of Spectrum in Graph Neural Networks

ICML 2022spotlight

Many improvements on GNNs can be deemed as operations on the spectrum of the underlying graph matrix, which motivates us to directly study the characteristics of the spectrum and their effects on GNN performance. By generalizing most existing GNN architectures, we show that the correlation issue cau…

2022

Asymmetric Mutual Learning for Multi-source Unsupervised Sentiment Adaptation with Dynamic Feature Network

COLING 2022main

Recently, fine-tuning the pre-trained language model (PrLM) on labeled sentiment datasets demonstrates impressive performance. However, collecting labeled sentiment dataset is time-consuming, and fine-tuning the whole PrLM brings about much computation cost. To this end, we focus on multi-source uns…

2022

Co-promotion Predictions of Financing Market and Sales Market: A Cooperative-Competitive Attention Approach

AAAI 2022technical

Market popularity prediction has always been a hot research topic, such as sales prediction and crowdfunding prediction. Most of these studies put the perspective on isolated markets, relying on the knowledge of certain market to maximize the prediction performance. However, these market-specific ap…

Cited by 3SourcePDFScholar
2022

Dilated Continuous Random Field for Semantic Segmentation

ICRA 2022poster

Mean field approximation methodology has laid the foundation of modern Continuous Random Field (CRF) based solutions for the refinement of semantic segmentation. In this paper, we propose to relax the hard constraint of mean field approximation - minimizing the energy term of each node from probabil…

Cited by 1SourcecodeScholar
2022

Dual-Level Adaptive Information Filtering for Interactive Image Segmentation

AISTATS 2022poster

Image segmentation can be performed interactively by accepting user annotations to refine the segmentation. It seeks frequent feedback from humans, and the model is updated with a smaller batch of data in each iteration of the feedback loop. Such a training paradigm requires effective information fi…

Cited by 1SourcePDFScholar
2022

Heterogeneity-Aware Twitter Bot Detection with Relational Graph Transformers

AAAI 2022technical

Twitter bot detection has become an important and challenging task to combat misinformation and protect the integrity of the online discourse. State-of-the-art approaches generally leverage the topological structure of the Twittersphere, while they neglect the heterogeneity of relations and influenc…

2022

HousE: Knowledge Graph Embedding with Householder Parameterization

ICML 2022spotlight

The effectiveness of knowledge graph embedding (KGE) largely depends on the ability to model intrinsic relation patterns and mapping properties. However, existing approaches can only capture some of them with insufficient modeling capacity. In this work, we propose a more powerful KGE framework name…

2022

UNET-TTS: Improving Unseen Speaker and Style Transfer in One-Shot Voice Cloning

ICASSP 2022accepted

One-shot voice cloning aims to transform speaker voice and speaking style in speech synthesized from a text-to-speech (TTS) system, where only a shot recording from the target reference speech can be used. Out-of-domain transfer is still a challenging task, and one important aspect that impacts the…

Cited by 0SourceScholar
2022

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

IJCAI 2022poster

In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for the accurate alignment of these multi-modal images. However,…

2021

A Channel Coding Benchmark for Meta-Learning

NeurIPS 2021poster

Meta-learning provides a popular and effective family of methods for data-efficient learning of new tasks. However, several important issues in meta-learning have proven hard to study thus far. For example, performance degrades in real-world settings where meta-learners must learn from a wide and po…

Cited by 11SourcecodeScholar
2021

A Continual Learning Framework for Uncertainty-Aware Interactive Image Segmentation

AAAI 2021technical

Deep learning models have achieved state-of-the-art performance in semantic image segmentation, but the results provided by fully automatic algorithms are not always guaranteed satisfactory to users. Interactive segmentation offers a solution by accepting user annotations on selective areas of the i…

2021

IntraTomo: Self-Supervised Learning-Based Tomography via Sinogram Synthesis and Prediction

ICCV 2021poster

We propose IntraTomo, a powerful framework that combines the benefits of learning-based and model-based approaches for solving highly ill-posed inverse problems in the Computed Tomography (CT) context. IntraTomo is composed of two core modules: a novel sinogram prediction module, and a geometry refi…

Cited by 106PDFcodeScholar
2021

Motion-Focused Contrastive Learning of Video Representations

ICCV 2021poster

Motion, as the most distinct phenomenon in a video to involve the changes over time, has been unique and critical to the development of video representation learning. In this paper, we ask the question: how important is the motion particularly for self-supervised video representation learning. To th…

Cited by 47PDFcodeScholar
2021

Treasures Outside Contexts: Improving Event Detection via Global Statistics

EMNLP 2021main

Event detection (ED) aims at identifying event instances of specified types in given texts, which has been formalized as a sequence labeling task. As far as we know, existing neural-based ED models make decisions relying entirely on the contextual semantic features of each word in the inputted text,…

2020

Combinatorial Multi-Armed Bandits with Concave Rewards and Fairness Constraints

IJCAI 2020poster

The problem of multi-armed bandit (MAB) with fairness constraint has emerged as an important research topic recently. For such problems, one common objective is to maximize the total rewards within a fixed round of pulls, while satisfying the fairness requirement of a minimum selection fraction for…

Cited by 0SourcePDFScholar
2020

Dynamic Fusion of Eye Movement Data and Verbal Narrations in Knowledge-rich Domains

NeurIPS 2020poster

We propose to jointly analyze experts' eye movements and verbal narrations to discover important and interpretable knowledge patterns to better understand their decision-making processes. The discovered patterns can further enhance data-driven statistical models by fusing experts' domain knowledge t…

Cited by 2SourcePDFScholar
2020

Model Adaptation: Unsupervised Domain Adaptation Without Source Data

CVPR 2020poster

In this paper, we investigate a challenging unsupervised domain adaptation setting --- unsupervised model adaptation. We aim to explore how to rely only on unlabeled target data to improve performance of an existing source prediction model on the target domain, since labeled source data may not be a…

Cited by 0PDFScholar
2020

Reflection Separation via Multi-bounce Polarization State Tracing

ECCV 2020poster

Reflection removal from photographs is an important task in computational photography, but also for computer vision tasks that involve imaging through windows and similar settings. Traditionally, the problem is approached as a single reflection removal problem under very controlled scenarios. In thi…

Cited by 34SourcePDFScholar
2019

Enhancing TripleGAN for Semi-Supervised Conditional Instance Synthesis and Classification

CVPR 2019poster

Learning class-conditional data distributions is crucial for Generative Adversarial Networks (GAN) in semi-supervised learning. To improve both instance synthesis and classification in this setting, we propose an enhanced TripleGAN (EnhancedTGAN) model in this work. We follow the adversarial trainin…

Cited by 41PDFScholar
2017

Human-inspired compliant strategy for peg-in-hole assembly using environmental constraint and coarse force information

IROS 2017poster

Automated assembly, especially peg-in-hole insertion, is a common task in manufacturing. In particular, the high-precision assembly is achieved by high-precision manipulator and sensing system. However, uncertainty and various parts for assembly are still challenges for robotic assembly, especially…

Cited by 29SourceScholar
2015

Measurement of shear and slip with a GelSight tactile sensor

ICRA 2015poster

Artificial tactile sensing is still underdeveloped, especially in sensing shear and slip on a contact surface. For a robot hand to manually explore the environment or perform a manipulation task such as grasping, sensing of shear forces and detecting incipient slip is important. In this paper, we in…

Cited by 319SourceScholar