← Search

Yaoyan Zheng

5 accepted papers

2026

CoVFT: Context-aware Visual Fine-tuning for Multimodal Large Language Models

CVPR 2026

Multimodal large language models (MLLMs) achieve remarkable progress in cross-modal perception and reasoning, yet a fundamental question remains unresolved: should the vision encoder be fine-tuned or frozen? Despite the success of models such as LLaVA and Qwen-VL, inconsistent design choices and het

Cited by 0SourcecodeScholar
2025

Implicit Modeling for Transferability Estimation of Vision Foundation Models

NeurIPS 2025poster

Transferability estimation identifies the best pre-trained models for downstream tasks without incurring the high computational cost of full fine-tuning. This capability facilitates deployment and advances the pre-training and fine-tuning paradigm. However, existing methods often struggle to accurat…

Cited by 0SourceScholar
2025

Progressive Parameter Efficient Transfer Learning for Semantic Segmentation

ICLR 2025poster

Parameter Efficient Transfer Learning (PETL) excels in downstream classification fine-tuning with minimal computational overhead, demonstrating its potential within the pre-train and fine-tune paradigm. However, recent PETL methods consistently struggle when fine-tuning for semantic segmentation tas…

2024

Crowd-SAM:SAM as a smart annotator for object detection in crowded scenes

ECCV 2024poster

"Object detection is an important task that finds its application in a wide range of scenarios. Generally, it requires extensive labels for training, which is quite time-consuming, especially in crowded scenes. Recently, Segment Anything Model (SAM) has emerged as a powerful zero-shot segmenter, off…

2021

Checkerboard Context Model for Efficient Learned Image Compression

CVPR 2021poster

For learned image compression, the autoregressive context model is proved effective in improving the rate-distortion (RD) performance. Because it helps remove spatial redundancies among latent representations. However, the decoding process must be done in a strict scan order, which breaks the parall…

Cited by 334PDFScholar