← Search

Yaoyan Zheng

5 accepted papers

2026

CoVFT: Context-aware Visual Fine-tuning for Multimodal Large Language Models

CVPR 2026

Multimodal large language models (MLLMs) achieve remarkable progress in cross-modal perception and reasoning, yet a fundamental question remains unresolved: should the vision encoder be fine-tuned or frozen? Despite the success of models such as LLaVA and Qwen-VL, inconsistent design choices and het

Cited by 0Source ↗code ↗Scholar ↗
2025

Implicit Modeling for Transferability Estimation of Vision Foundation Models

NeurIPS 2025poster

Transferability estimation identifies the best pre-trained models for downstream tasks without incurring the high computational cost of full fine-tuning. This capability facilitates deployment and advances the pre-training and fine-tuning paradigm. However, existing methods often struggle to accurat…

Cited by 0Source ↗Scholar ↗
2025

Progressive Parameter Efficient Transfer Learning for Semantic Segmentation

ICLR 2025poster

Parameter Efficient Transfer Learning (PETL) excels in downstream classification fine-tuning with minimal computational overhead, demonstrating its potential within the pre-train and fine-tune paradigm. However, recent PETL methods consistently struggle when fine-tuning for semantic segmentation tas…

2024

Crowd-SAM:SAM as a smart annotator for object detection in crowded scenes

ECCV 2024poster

"Object detection is an important task that finds its application in a wide range of scenarios. Generally, it requires extensive labels for training, which is quite time-consuming, especially in crowded scenes. Recently, Segment Anything Model (SAM) has emerged as a powerful zero-shot segmenter, off…

2021

Checkerboard Context Model for Efficient Learned Image Compression

CVPR 2021poster

For learned image compression, the autoregressive context model is proved effective in improving the rate-distortion (RD) performance. Because it helps remove spatial redundancies among latent representations. However, the decoding process must be done in a strict scan order, which breaks the parall…

Cited by 334PDF ↗Scholar ↗