← Search

Yao Zhu

32 accepted papers

2026

Adaptive Nonlinear Compression for Large Foundation Models

ICLR 2026poster

Despite achieving superior performance, large foundation models (LFMs) have substantial memory requirements, leading to a growing demand for model compression methods. While low-rank approximation presents a promising hardware-friendly solution, existing linear methods suffer significant information…

Cited by 0SourceScholar
2026

Dual-Seed Evolutionary Algorithm for Noise Optimization in Diffusion Models

AAAI 2026technical

Diffusion models have emerged as state-of-the-art generative methods, particularly excelling in conditional tasks such as prompt-driven image synthesis. While recent research emphasizes the pivotal role of noise seeds in enhancing text-image alignment and generating human-preferred outputs,these wor

Cited by 0SourcePDFScholar
2026

Generation then Reconstruction: Accelerating Masked Autoregressive Models via Two-Stage Sampling

ICLR 2026poster

Masked Autoregressive (MAR) models promise better efficiency in visual generation than continuous autoregressive (AR) models for the ability of parallel generation, yet their acceleration potential remains constrained by the modeling complexity of spatially correlated visual tokens in a single step.…

Cited by 0SourcecodeScholar
2026

Mitigating Error Propagation in Low-Rank Approximation of Large Models via Distribution-Aware Whitening

ICML 2026poster

Low-rank approximation has emerged as a cornerstone technique for model compression and parameter-efficient fine-tuning, enabling substantial reductions in computation and memory without altering model architectures. However, existing approaches often overlook the shifts in feature distributions ind…

Cited by 0SourceScholar
2026

Phantom: Physical Object Interactions as Dynamic Triggers for NMS-Exploited Backdoors

CVPR 2026

Backdoor attacks pose potential threats to object detection models, highlighting the importance of studying their security. However, existing backdoor attacks mainly rely on trigger-specific intrinsic features, which limits their practicality in real-world scenarios. In this paper, we propose a nove

Cited by 0SourceScholar
2026

PlugGuard: A Streaming Safeguard for Large Models via Latent Dynamics-Guided Risk Detection

ICML 2026poster

Large models (LMs) are powerful content generators, yet their open‑ended nature can also introduce potential risks, such as generating harmful or biased content. Existing guardrails mostly perform post-hoc detection that may expose unsafe content before it is caught, and the latency constraints furt…

Cited by 0SourceScholar
2026

Pruning as a Cooperative Game: Surrogate-Assisted Layer Contribution Estimation for Large Language Models

ICLR 2026poster

While large language models (LLMs) demonstrate impressive performance across various tasks, their deployment in real-world scenarios is still constrained by high computational demands. Layer-wise pruning, a commonly employed strategy to mitigate inference costs, can partially address this challenge.…

Cited by 0SourceScholar
2026

Resource-Efficient Reinforcement for Reasoning Large Language Models via Dynamic One-Shot Policy Refinement

ICML 2026poster

Large language models (LLMs) have exhibited remarkable performance on complex reasoning tasks, with reinforcement learning under verifiable rewards (RLVR) emerging as a principled framework for aligning model behavior with reasoning chains. Despite its promise, RLVR remains prohibitively resource-in…

Cited by 0SourceScholar
2025

An Efficient Framework for Enhancing Discriminative Models via Diffusion Techniques

AAAI 2025technical

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative models, which offer the advantage of zero-shot classification. How…

2025

Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarios

ICCV 2025poster

With the rapid advancement of generative models, highly realistic image synthesis has posed new challenges to digital security and media credibility. Although AI-generated image detection methods have partially addressed these concerns, a substantial research gap remains in evaluating their performa…

Cited by 0SourcePDFScholar
2025

Enhanced Event-based Dense Stereo via Cross-Sensor Knowledge Distillation

ICCV 2025poster

Accurate stereo matching under fast motion and extreme lighting conditions is a challenge for many vision applications. Event cameras have the advantages of low latency and high dynamic range, thus providing a reliable solution to this challenge. However, since events are sparse, this makes it an il…

Cited by 0SourcePDFScholar
2025

Enhancing Out-of-Distribution Detection through Dynamic Activation Function

ICASSP 2025accepted

In the fields of machine learning and deep learning, ensuring model robustness and reliability is critical. One major challenge is the handling of Out-of-Distribution (OOD) samples, the presence of In-Distribution (ID) noise in existing OOD datasets. It can increase the risk of misclassification and…

Cited by 0SourceScholar
2025

FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mixture-of-Experts

NeurIPS 2025poster

Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for foundation models, but it suffers from parameter interference, resulting in suboptimal performance. Although Mixture-of-Experts (MoE)-based LoRA variants show promise in mitigating intra-task correlations in singl…

Cited by 0SourcecodeScholar
2025

High Dynamic Range Video Compression: A Large-Scale Benchmark Dataset and A Learned Bit-depth Scalable Compression Algorithm

CVPR 2025poster

Recently, learned video compression (LVC) is undergoing a period of rapid development. However, due to absence of large and high-quality high dynamic range (HDR) video training data, LVC on HDR video is still unexplored. In this paper, we are the first to collect a large-scale HDR video benchmark da…

2025

Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis

CVPR 2025poster

Diffusion models have achieved impressive success in generating photorealistic images, but challenges remain in ensuring precise semantic alignment with input prompts. Optimizing the initial noisy latent offers a more efficient alternative to modifying model architectures or prompt engineering for i…

Cited by 0SourcePDFScholar
2025

SHIFT: Smoothing Hallucinations by Information Flow Tuning for Multimodal Large Language Models

ICCV 2025poster

Large Language Models (LLMs) are prone to hallucinations, which pose significant risks in their applications. Most existing hallucination detection methods rely on internal probabilities or external knowledge, and they are limited to identifying hallucinations at the sentence or passage level. In th…

Cited by 0SourcePDFScholar
2025

Towards Annotation-Free Evaluation: KPAScore for Human Keypoint Detection

ICCV 2025poster

Human keypoint detection is fundamental in computer vision, with applications in pose estimation and action recognition. However, existing evaluation metrics (e.g., OKS, PCP, PDJ) rely on human-annotated ground truth, a labor-intensive process that increases costs, limits scalability. To address thi…

Cited by 0SourcePDFScholar
2025

Towards Understanding How Knowledge Evolves in Large Vision-Language Models

CVPR 2025poster

Large Vision-Language Models (LVLMs) are gradually becoming the foundation for many artificial intelligence applications. However, understanding their internal working mechanisms has continued to puzzle researchers, which in turn limits the further enhancement of their capabilities. In this paper, w…

2024

Unleashing the Potential of Large Language Models through Spectral Modulation

EMNLP 2024finding

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, garnering significant attention from both academia and industry. However, enhancing the performance of LLMs typically requires scaling up model sizes or fine-tuning with additional datasets, which results…

2023

COCO-O: A Benchmark for Object Detectors under Natural Distribution Shifts

ICCV 2023poster

Practical object detection application can lose its effectiveness on image inputs with natural distribution shifts. This problem leads the research community to pay more attention on the robustness of detectors under Out-Of-Distribution (OOD) inputs. Existing works construct datasets to benchmark th…

Cited by 23PDFcodeScholar
2023

ImageNet-E: Benchmarking Neural Network Robustness via Attribute Editing

CVPR 2023poster

Recent studies have shown that higher accuracy on ImageNet usually leads to better robustness against different corruptions. In this paper, instead of following the traditional research paradigm that investigates new out-of-distribution corruptions or perturbations deep models may encounter, we cond…

2023

Inequality phenomenon in $l_{\infty}$-adversarial training, and its unrealized threats

ICLR 2023top-25%

The appearance of adversarial examples raises attention from both academia and industry. Along with the attack-defense arms race, adversarial training is the most effective against adversarial examples. However, we find inequality phenomena occur during the $l_{\infty}$-adversarial training, that fe…

Cited by 0SourcePDFScholar
2023

Transaudio: Towards the Transferable Adversarial Audio Attack Via Learning Contextualized Perturbations

ICASSP 2023accepted

In a transfer-based attack against Automatic Speech Recognition (ASR) systems, attacks are unable to access the architecture and parameters of the target model. Existing attack methods are mostly investigated in voice assistant scenarios with restricted voice commands, prohibiting their applicabilit…

Cited by 0SourceScholar
2022

A-PixelHop: A Green, Robust and Explainable Fake-Image Detector

ICASSP 2022accepted

A novel method for detecting CNN-generated images, called Attentive PixelHop (or A-PixelHop), is proposed in this work. It has three advantages: 1) low computational complexity and a small model size, 2) high detection performance against a wide range of generative models, and 3) mathematical transp…

Cited by 0SourceScholar
2022

Boosting Out-of-distribution Detection with Typical Features

NeurIPS 2022accept

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or introducing diverse outlier examples to retrain the model, we delve…

Cited by 61SourcePDFScholar
2022

Enhance the Visual Representation via Discrete Adversarial Training

NeurIPS 2022accept

Adversarial Training (AT), which is commonly accepted as one of the most effective approaches defending against adversarial examples, can largely harm the standard performance, thus has limited usefulness on industrial-scale production and applications. Surprisingly, this phenomenon is totally oppos…

2021

Relation-Aware Neighborhood Matching Model for Entity Alignment

AAAI 2021technical

Entity alignment which aims at linking entities with the same meaning from different knowledge graphs (KGs) is a vital step for knowledge fusion. Existing research focused on learning embeddings of entities by utilizing structural information of KGs for entity alignment. These methods can aggregate…

Cited by 116SourcePDFScholar
2021

Towards Understanding the Generative Capability of Adversarially Robust Classifiers

ICCV 2021poster

Recently, some works found an interesting phenomenon that adversarially robust classifiers can generate good images comparable to generative models. We investigate this phenomenon from an energy perspective and provide a novel explanation. We reformulate adversarial example generation, adversarial t…

Cited by 24PDFcodeScholar