← Search

Rongyu Zhang

15 accepted papers

2026

Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation

AAAI 2026technical

Continual Test-Time Adaptation (CTTA), which aims to adapt the pre-trained model to ever-evolving target domains, emerges as an important task for vision models. As current vision models appear to be heavily biased towards texture, continuously adapting the model from one domain distribution to anot

Cited by 0SourcePDFScholar
2026

Linking Perception, Confidence and Accuracy in MLLMs

CVPR 2026

Recent advances in Multi-modal Large Language Models (MLLMs) have predominantly focused on enhancing visual \perception to improve \accuracy. However, a critical question remains unexplored: Do models know when they do not know? Through a probing experiment, we reveal a severe \confidence miscalibra

Cited by 0SourcecodeScholar
2026

MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation

AAAI 2026technical

Vision-Language-Action (VLA) models enable robotic systems to perform embodied tasks but face deployment challenges due to the high computational demands of the dense Large Language Models (LLMs), with existing early-exit-based sparsification methods often overlooking the critical semantic role of f

Cited by 0SourcePDFScholar
2026

PANDA: Empowering Small Language Models for Proactive Dialogue Through Agent-Based Synthesis (Student Abstract)

AAAI 2026technical

Proactive dialogue systems, which are designed to guide conversations toward predetermined goals. However, contemporary LLMs predominantly function as passive assistants, mechanically executing human instructions. A key challenge contributing to this limitation is the inherent difficulty in acquirin

Cited by 0SourcePDFScholar
2026

Predicting What Matters: Robust Generalist Robot Policy Learning via Future Semantic Mask

ICML 2026poster

World models derived from large-scale video generative pre-training have emerged as a promising paradigm for generalist robot policy learning. However, standard approaches often focus on high-fidelity RGB video prediction, but this can result in overfitting to irrelevant factors, such as dynamic bac…

Cited by 0SourceScholar
2026

SpikeGen: Decoupled “Rods and Cones” Visual Representation Processing with Latent Generative Framework

ICLR 2026poster

The process through which humans perceive and learn visual representations in dynamic environments is highly complex. From a structural perspective, the human eye decouples the functions of cone and rod cells: cones are primarily responsible for color perception, while rods are specialized in detect…

Cited by 0SourcecodeScholar
2025

Empowering World Models with Reflection for Embodied Video Prediction

ICML 2025poster

Video generation models have made significant progress in simulating future states, showcasing their potential as world simulators in embodied scenarios. However, existing models often lack robust understanding, limiting their ability to perform multi-step predictions or handle Out-of-Distribution (…

Cited by 0SourcePDFScholar
2025

FBQuant: FeedBack Quantization for Large Language Models

IJCAI 2025

Deploying Large Language Models (LLMs) on edge devices is increasingly important, as it eliminates reliance on network connections, reduces expensive API calls, and enhances user privacy. However, on-device deployment is challenging due to the limited computational resources of edge devices. In part

Cited by 0SourcePDFScholar
2025

Orochi: Versatile Biomedical Image Processor

NeurIPS 2025spotlight

Deep learning has emerged as a pivotal tool for accelerating research in the life sciences, with the low-level processing of biomedical images (e.g., registration, fusion, restoration, super-resolution) being one of its most critical applications. Platforms such as ImageJ (Fiji) and napari have enab…

Cited by 0SourceScholar
2025

PAT: Pruning-Aware Tuning for Large Language Models

AAAI 2025technical

Large language models (LLMs) excel in language tasks, especially with supervised fine-tuning after pre-training. However, their substantial memory and computational requirements hinder practical applications. Structural pruning, which reduces less significant weight dimensions, is one solution. Yet,…

2024

BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection

ICRA 2024poster

Vision-centric bird-eye-view (BEV) perception has shown promising potential in autonomous driving. Recent works mainly focus on improving efficiency or accuracy but neglect the challenges when facing environment changing, resulting in severe degradation of transfer performance. For BEV perception, w…

Cited by 5SourcecodeScholar
2024

Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation

AAAI 2024technical

The Mixture-of-Experts (MoE) approach has demonstrated outstanding scalability in multi-task learning including low-level upstream tasks such as concurrent removal of multiple adverse weather effects. However, the conventional MoE architecture with parallel Feed Forward Network (FFN) experts leads t…

Cited by 21SourcePDFScholar
2023

BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networks

CVPR 2023poster

Bird's-Eye-View (BEV) 3D Object Detection is a crucial multi-view technique for autonomous driving systems. Recently, plenty of works are proposed, following a similar paradigm consisting of three essential components, i.e., camera feature extraction, BEV feature construction, and task heads. Among…

Cited by 28SourcePDFScholar
2023

Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-World

CVPR 2023poster

When facing changing environments in the real world, the lightweight model on client devices suffer from severe performance drop under distribution shifts. The main limitations of existing device model lie in: (1) unable to update due to the computation limit of the device, (2) limited generalizatio…

Cited by 20SourcePDFScholar
2020

A Dense U-Net with Cross-Layer Intersection for Detection and Localization of Image Forgery

ICASSP 2020accepted

In this paper, we apply cross-layer intersection mechanism to dense u-net for image forgery detection and localization. We first train DenseNet for binary classification. Spatial rich model (SRM) filters are adopted for capturing residual signals in the detected images. Then we propose a new approac…

Cited by 0SourceScholar