← Search

Zhiwei Li

33 accepted papers

2026

A Survey of Personalized Federated Foundation Models for Privacy-Preserving Recommendation

IJCAI 2026

Integrating Foundation Models (FMs) into recommendation systems is an emerging and promising research direction. However, centralized paradigms face growing pressure from privacy concerns and strict regulatory requirements. Federated learning offers a viable solution that enables collaborative model

Cited by 0Scholar
2026

DiffPlace: Street View Generation Via Place-Controllable Diffusion Model Enhancing Place Recognition

ICRA 2026poster

Generative models have advanced significantly in realistic image synthesis, with diffusion models excelling in quality and stability. Recent multi-view diffusion models improve 3D-aware street view generation, but they struggle to produce place-aware and background-consistent urban scenes from text,…

2026

Federated Vision-Language-Recommendation with Personalized Fusion

AAAI 2026technical

Applying large pre-trained Vision-Language Models to recommendation is a burgeoning field, a direction we term Vision-Language-Recommendation (VLR). Bringing VLR to user-oriented on-device intelligence within a federated learning framework is a crucial step for enhancing user privacy and delivering

Cited by 0SourcePDFScholar
2026

LatentChem: From Textual CoT to Latent Thinking in Chemical Reasoning

ICML 2026poster

Current chemical large language models (LLMs) predominantly rely on explicit Chain-of-Thought (CoT) to solve complex reasoning problems. However, forcing nonverbal tacit chemical logic into discrete natural language imposes a fundamental ``modality mismatch,'' creating an artificial bottleneck for r…

Cited by 0SourceScholar
2026

OWOD-FSL: Open-World Object Detection Via Few-Shot Learning and Dynamic Prototypes

ICRA 2026poster

Open-World Object Detection (OWOD) presents a critical challenge for modern computer vision systems: detecting known classes, identifying unknown objects, and incrementally learning to recognize them over time. However, current approaches have two fundamental limitations: (1) the fixed-dimensional c…

Cited by 0Scholar
2026

TTP: Test-Time Padding for Adversarial Detection and Robust Adaptation on Vision-Language Models

CVPR 2026

Vision-Language Models (VLMs), such as CLIP, have achieved impressive zero-shot recognition performance but remain highly susceptible to adversarial perturbations, posing significant risks in safety-critical scenarios. Previous training-time defenses rely on adversarial fine-tuning, which requires l

Cited by 0SourcecodeScholar
2026

The Structure-Equivalent Prior: Unifying Temporal Dynamics and 3D Evolution in 4D Latent Space

AAAI 2026technical

Recent advances in deep learning-based 3D representation have achieved remarkable success, particularly in modeling static high-fidelity geometries. However, the extension of these techniques to dynamic 3D scenes introduces a critical challenge of effectively representing spatio-temporal dependencie

Cited by 0SourcePDFScholar
2026

TransFR: Transferable Federated Recommendation with Adapter Tuning on Pre-trained Language Models

AAAI 2026technical

Federated recommendations (FRs), facilitating multiple local clients to collectively learn a global model without disclosing user private data, have emerged as a prevalent on-device service. In conventional FRs, a dominant paradigm is to utilize discrete identities to represent clients and items, wh

Cited by 0SourcePDFScholar
2026

Uncertainty-Aware Clarification in LLM Agents with Information Gain

ICML 2026poster

Large Language Model (LLM) agents often operate under underspecified user instructions, where latent uncertainty over user intent leads to erroneous tool actions. To address this challenge, we propose a goal-oriented clarification framework that aligns clarification behavior with ambiguity resolutio…

Cited by 0SourceScholar
2025

Compress Large Language Models via Collaboration Between Learning and Matrix Approximation

NeurIPS 2025poster

Sparse and low-rank matrix composite approximation has emerged as a promising paradigm for compressing large language models (LLMs), offering a more flexible pruning structure than conventional methods based solely on sparse matrices. The significant variation in weight redundancy across layers, alo…

Cited by 0SourceScholar
2025

Computation and Memory-Efficient Model Compression with Gradient Reweighting

NeurIPS 2025poster

Pruning is a commonly employed technique for deep neural networks (DNNs) aiming at compressing the model size to reduce computational and memory costs during inference. In contrast to conventional neural networks, large language models (LLMs) pose a unique challenge regarding pruning efficiency due…

Cited by 0SourceScholar
2025

Efficient Representativeness-Aware Coreset Selection

NeurIPS 2025poster

Dynamic coreset selection is a promising approach for improving the training efficiency of deep neural networks by periodically selecting a small subset of the most representative or informative samples, thereby avoiding the need to train on the entire dataset. However, it remains inherently challen…

Cited by 0SourceScholar
2025

FaStFact: Faster, Stronger Long-Form Factuality Evaluations in LLMs

EMNLP 2025

Evaluating the factuality of long-form generations from Large Language Models (LLMs) remains challenging due to accuracy issues and costly human assessment. Prior evaluation pipelines attempt this by decomposing text into claims, searching for evidence, and verifying claims, but suffer from critical

2025

MMTL-UniAD: A Unified Framework for Multimodal and Multi-Task Learning in Assistive Driving Perception

CVPR 2025poster

Advanced driver assistance systems require a comprehensive understanding of the driver's mental/physical state and traffic context but existing works often neglect the potential benefits of joint learning between these tasks. This paper proposes MMTL-UniAD, a unified multi-modal multi-task learning…

2025

Personalized Federated Collaborative Filtering: A Variational AutoEncoder Approach

AAAI 2025technical

Federated Collaborative Filtering (FedCF) is an emerging field focused on developing a new recommendation framework with preserving privacy in a federated setting. Existing FedCF methods typically combine distributed Collaborative Filtering (CF) algorithms with privacy-preserving mechanisms, and the…

2025

SVRM: Composing Various Network Service Fuzzing Corpus with One Single Model

ICASSP 2025accepted

Discovering vulnerabilities in network service is of great significance. Currently, coverage-guided fuzzing (CGF) is widely regarded as the most effective method. However, the efficiency of CGF depends on the quality of initial corpus. The initial corpus is a set of valid input examples used to init…

Cited by 0SourceScholar
2025

Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoning

NeurIPS 2025poster

Scientific discoveries increasingly rely on complex multimodal reasoning based on information-intensive scientific data and domain-specific expertise. Empowered by expert-level scientific benchmarks, scientific Multimodal Large Language Models (MLLMs) hold the potential to significantly enhance this…

Cited by 0SourceScholar
2025

TEM3-Learning: Time-Efficient Multimodal Multi-Task Learning for Advanced Assistive Driving

IROS 2025

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene understanding and inefficient architectures impeding real-tim

Cited by 3SourcecodeScholar
2024

Can Large Language Models Mine Interpretable Financial Factors More Effectively? A Neural-Symbolic Factor Mining Agent Model

ACL 2024findings

Finding interpretable factors for stock returns is the most vital issue in the empirical asset pricing domain. As data-driven methods, existing factor mining models can be categorized into symbol-based and neural-based models. Symbol-based models are interpretable but inefficient, while neural-based…

Cited by 1SourcePDFScholar
2024

Low Precision Local Training is Enough for Federated Learning

NeurIPS 2024poster

Federated Learning (FL) is a prevalent machine learning paradigm designed to address challenges posed by heterogeneous client data while preserving data privacy. Unlike distributed training, it typically orchestrates resource-constrained edge devices to communicate via a low-bandwidth communica…

2024

USD-SLAM: A Universal Visual SLAM Based on Large Segmentation Model in Dynamic Environments

RA-L 2024

Visual Simultaneous Localization and Mapping (SLAM) has been widely adopted in autonomous driving and robotics. While most SLAM systems operate effectively in static or low-dynamic environments, achieving precise pose estimation in diverse unknown dynamic environments continues to pose a significant

Cited by 9SourceScholar
2023

Generalized Discriminative Deep Non-Negative Matrix Factorization Based on Latent Feature and Basis Learning

IJCAI 2023poster

As a powerful tool for data representation, deep NMF has attracted much attention in recent years. Current deep NMF builds the multi-layer structure by decomposing either basis matrix or feature matrix into multiple factors, and probably complicates the learning process when data is insufficient or…

2022

IPS300+: a Challenging multi-modal data sets for Intersection Perception System

ICRA 2022poster

Due to high complexity and occlusion, insufficient perception in the crowded urban intersection can be a serious safety risk for both human drivers and autonomous algorithms, whereas CVIS (Cooperative Vehicle Infrastructure System) is a proposed solution for full-participants perception under this s…

Cited by 36SourceScholar
2021

AVP-Loc: Surround View Localization and Relocalization Based on HD Vector Map for Automated Valet Parking

IROS 2021poster

Localization is a crucial prerequisite for automated valet parking, in which a vehicle is required to navigate itself in a GPS-denied parking lot. Traditional visual localization methods usually build a feature map and use it for future localizations. However, the feature map is not robust to change…

Cited by 13SourceScholar
2021

DT-Loc: Monocular Visual Localization on HD Vector Map Using Distance Transforms of 2D Semantic Detections

IROS 2021poster

Localizing a vehicle on a prebuilt HD vector map is a prerequisite for many autonomous driving applications. Existing visual localization approaches usually require a separate local feature layer to function. The separate localization layer suffers from the robustness issue inherited from the local…

Cited by 11SourceScholar
2021

Robust LiDAR Localization on an HD Vector Map without a Separate Localization Layer

IROS 2021poster

Many autonomous driving applications nowadays come along with a prebuilt vector map for routing and planning purposes. In order to localize on this map, traditional LiDAR localization methods usually require a separate localization layer to function. On one hand, the separate layer occupies large st…

Cited by 11SourceScholar
2018

Simplified Quasi-Steady Aeromechanic Model for Flapping-Wing Robots with Passively Rotating Hinges

ICRA 2018poster

At millimeter and centimeter scales, flapping-wing robots often employ flexural passive wing hinges to eliminate extra actuation and mechanical complexity. In this paper, we propose a modified quasi-steady model for predicting aerodynamic forces from a flapping wing with a passively rotating hinge.…

Cited by 7SourceScholar
2017

Locality-Sensitive Deconvolution Networks With Gated Fusion for RGB-D Indoor Semantic Segmentation

CVPR 2017poster

This paper focuses on indoor semantic segmentation using RGB-D data. Although the commonly used deconvolution networks (DeconvNet) have achieved impressive results on this task, we find there is still room for improvements in two aspects. One is about the boundary segmentation. DeconvNet aggregates…

Cited by 273PDFScholar
2016

Joint Multiview Segmentation and Localization of RGB-D Images Using Depth-Induced Silhouette Consistency

CVPR 2016poster

In this paper, we propose an RGB-D camera localization approach which takes an effective geometry constraint, i.e. silhouette consistency, into consideration. Unlike existing approaches which usually assume the silhouettes are provided, we consider more practical scenarios and generate the silhouett…

Cited by 7PDFScholar
2015

MeshStereo: A Global Stereo Model With Mesh Alignment Regularization for View Interpolation

ICCV 2015oral

We present a novel global stereo model designed for view interpolation. Unlike existing stereo models which only output a disparity map, our model is able to output a 3D triangular mesh, which can be directly used for view interpolation. To this aim, we partition the input stereo images into 2D tria…

Cited by 206PDFScholar
2015

Query Adaptive Similarity Measure for RGB-D Object Recognition

ICCV 2015poster

This paper studies the problem of improving the top-1 accuracy of RGB-D object recognition. Despite of the impressive top-5 accuracies achieved by existing methods, their top-1 accuracies are not very satisfactory. The reasons are in two-fold: (1) existing similarity measures are sensitive to object…

Cited by 18PDFScholar