← Search

Yifan Lu

27 accepted papers

2026

CHIPS: Efficient CLIP Adaptation via Curvature-aware Hybrid Influence-based Data Selection

CVPR 2026

Adapting CLIP to vertical domains is typically approached by novel fine-tuning strategies or by continual pre-training (CPT) on large domain-specific datasets. Yet, data itself remains an underexplored factor in this process. We revisit this task from a data-centric perspective: Can effective data s

Cited by 0SourcecodeScholar
2026

ChronoEdit: Towards Temporal Reasoning for In-Context Image Editing and World Simulation

ICLR 2026poster

Recent advances in large generative models have significantly advanced image editing and in-context image generation, yet a critical gap remains in ensuring physical consistency, where edited objects must remain coherent. This capability is especially vital for world simulation related tasks. In thi…

Cited by 0SourcecodeScholar
2026

FAFO: Lossy KV Cache Compression for Lossless Inference Acceleration via Draftless Fumble Decoding

ICML 2026poster

Lossy KV cache compression is a well-explored subfield of machine learning efficiency, with improved latency being one of its major gains. However, lossy compression techniques can fumble from time to time, exhibiting various — and often catastrophic — failure patterns that are not only difficult to…

Cited by 0SourceScholar
2026

RouterArena: An Open Platform for Comprehensive Comparison of LLM Routers

ICLR 2026poster

Today's LLM ecosystem comprises a wide spectrum of models that differ in size, capability, and cost. No single model is optimal for all scenarios; hence, LLM routers have become essential for selecting the most appropriate model under varying circumstances. However, the rapid emergence of various ro…

Cited by 0SourceScholar
2026

``Noisier'’ Noise Contrastive Estimation is (Almost) Maximum Likelihood

ICLR 2026poster

Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between distributions that differ substantially, which significantly limits the applicability of NCE on modern hig…

Cited by 0SourcecodeScholar
2025

Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing

ACL 2025finding

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challenges. First, they often rely on entity-specific localization, making them ineffect…

Cited by 0SourcePDFScholar
2025

CoMatch: Dynamic Covisibility-Aware Transformer for Bilateral Subpixel-Level Semi-Dense Image Matching

ICCV 2025poster

This prospective study proposes CoMatch, a novel semi-dense image matcher with dynamic covisibility awareness and bilateral subpixel accuracy. Firstly, observing that modeling context interaction over the entire coarse feature map elicits highly redundant computation due to the neighboring represent…

2025

DeMo: Deep Motion Field Consensus with Learnable Kernels for Two-view Correspondence Learning

AAAI 2025technical

As a long-range prior, motion consensus essentially forces the overall spatial transformation between a pair of images to be smooth and consistent, which is naturally well-suited for two-view correspondence learning. However, such precious property remains under-explored by most existing studies due…

2025

GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control

CVPR 2025highlight

We present GEN3C, a generative video model with precise Camera Control and temporal 3D Consistency. Prior video models already generate realistic videos, but they tend to leverage little 3D information, leading to inconsistencies, such as objects popping in and out of existence. Camera control, if i…

2025

InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models

ICCV 2025poster

We present InfiniCube, a scalable and controllable method to generate unbounded and dynamic 3D driving scenes with high fidelity.Previous methods for scene generation are constrained either by their applicability to indoor scenes or by their lack of controllability.In contrast, we take advantage of…

Cited by 0SourcePDFScholar
2025

Knowledge Editing with Dynamic Knowledge Graphs for Multi-Hop Question Answering

AAAI 2025technical

Multi-hop question answering (MHQA) poses a significant challenge for large language models (LLMs) due to the extensive knowledge demands involved. Knowledge editing, which aims to precisely modify the LLMs to incorporate specific knowledge without negatively impacting other unrelated knowledge, off…

2025

MI-TRQR: Mutual Information-Based Temporal Redundancy Quantification and Reduction for Energy-Efficient Spiking Neural Networks

NeurIPS 2025poster

Brain-inspired spiking neural networks (SNNs) provide energy-efficient computation through event-driven processing. However, the shared weights across multiple timesteps lead to serious temporal feature redundancy, limiting both efficiency and performance. This issue is further aggravated when proce…

Cited by 0SourcecodeScholar
2025

MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable Evaluations

ICLR 2025spotlight

Large language models (LLMs) can give out erroneous answers to factually rooted questions either as a result of undesired training outcomes or simply because the world has moved on after a certain knowledge cutoff date. Under such scenarios, *knowledge editing* often comes to the rescue by deliverin…

2025

Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations

EMNLP 2025

Large Vision-Language Models (LVLMs) suffer from serious hallucination problems, where the model-generated responses are inconsistent with the visual inputs. Existing hallucination mitigation methods are mainly based on preference alignment and require external human annotations or auxiliary models

2025

RETAIN: Reliable Topology Augmentation for both Heterophilic and Homophilic Graphs

ICASSP 2025accepted

Current graph topology augmentation methods are mostly static and heavily rely on the assumption of homophily, where connected nodes are presumed to share the same labels by default. Due to the complexity of real-world graphs, the underlying assumption is often disrupted, thus performance declines,…

Cited by 0SourceScholar
2025

Reflection on Knowledge Graph for Large Language Models Reasoning

ACL 2025finding

Recent research shows that supplementing Large Language Models (LLMs) with knowledge graphs can enhance their performance. However, existing methods often introduce noise in the retrieval and reasoning pipeline, hindering LLMs’ ability to effectively integrate external knowledge for complex multi-ho…

2025

RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulation

ICCV 2025poster

Roadside Collaborative Perception refers to a system where multiple roadside units collaborate to pool their perceptual data, assisting vehicles in enhancing their environmental awareness. Existing roadside perception methods concentrate on model design but overlook data issues like calibration erro…

2024

An Extensible Framework for Open Heterogeneous Collaborative Perception

ICLR 2024poster

Collaborative perception aims to mitigate the limitations of single-agent perception, such as occlusions, by facilitating data exchange among multiple agents. However, most current works consider a homogeneous scenario where all agents use identity sensors and perception models. In reality, heteroge…

2024

Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents

CVPR 2024highlight

Scene simulation in autonomous driving has gained significant attention because of its huge potential for generating customized data. However existing editable scene simulation approaches face limitations in terms of user interaction efficiency multi-camera photo-realistic rendering and external dig…

2024

Locality Preserving Refinement for Shape Matching with Functional Maps

AAAI 2024technical

In this paper, we address the nonrigid shape matching with outliers by a novel and effective pointwise map refinement method, termed Locality Preserving Refinement. For accurate pointwise conversion from a given functional map, our method formulates a two-step procedure. Firstly, starting with noisy…

2024

SCube: Instant Large-Scale Scene Reconstruction using VoxSplats

NeurIPS 2024poster

We present SCube, a novel method for reconstructing large-scale 3D scenes (geometry, appearance, and semantics) from a sparse set of posed images. Our method encodes reconstructed scenes using a novel representation VoxSplat, which is a set of 3D Gaussians supported on a high-resolution sparse-voxel…

Cited by 10SourcePDFScholar
2024

Set Prediction Guided by Semantic Concepts for Diverse Video Captioning

AAAI 2024technical

Diverse video captioning aims to generate a set of sentences to describe the given video in various aspects. Mainstream methods are trained with independent pairs of a video and a caption from its ground-truth set without exploiting the intra-set relationship, resulting in low diversity of generated…

Cited by 3SourcePDFScholar
2023

Asynchrony-Robust Collaborative Perception via Bird's Eye View Flow

NeurIPS 2023poster

Collaborative perception can substantially boost each agent's perception ability by facilitating communication among multiple agents. However, temporal asynchrony among agents is inevitable in the real world due to communication delays, interruptions, and clock misalignments. This issue causes infor…

2023

Collaboration Helps Camera Overtake LiDAR in 3D Detection

CVPR 2023poster

Camera-only 3D detection provides an economical solution with a simple configuration for localizing objects in 3D space compared to LiDAR-based detection systems. However, a major challenge lies in precise depth estimation due to the lack of direct 3D measurements in the input. Many previous methods…

2023

Robust Collaborative 3D Object Detection in Presence of Pose Errors

ICRA 2023poster

Collaborative 3D object detection exploits information exchange among multiple agents to enhance accuracy of object detection in presence of sensor impairments such as occlusion. However, in practice, pose estimation errors due to imperfect localization would cause spatial message misalignment and s…

Cited by 116SourcecodeScholar
2023

Robust and Scalable Gaussian Process Regression and Its Applications

CVPR 2023poster

This paper introduces a robust and scalable Gaussian process regression (GPR) model via variational learning. This enables the application of Gaussian processes to a wide range of real data, which are often large-scale and contaminated by outliers. Towards this end, we employ a mixture likelihood mo…

2022

RainNet: A Large-Scale Imagery Dataset and Benchmark for Spatial Precipitation Downscaling

NeurIPS 2022accept

AI-for-science approaches have been applied to solve scientific problems (e.g., nuclear fusion, ecology, genomics, meteorology) and have achieved highly promising results. Spatial precipitation downscaling is one of the most important meteorological problem and urgently requires the participation of…