CPA-Enhancer: Chain-of-Thought Prompted Adaptive Enhancer for Downstream Vision Tasks Under Unknown Degradations

Abstract

Extracting valuable visual cues for downstream vision tasks poses a particular challenge under unknown degradations. A straightforward solution is to preprocess images using image restoration methods, but their high computational complexity renders them unsuitable for real-time tasks. Recent efforts have aimed to enhance image representations optimized by downstream task losses. However, these approaches are confined to known single degradation scenarios, constraining their practical applicability in unpredictable environments. Therefore, we propose a Chain-of-thought Prompted Adaptive Enhancer, CPA-Enhancer, for enhancing important features crucial for downstream vision tasks under unknown degradations. Specifically, CPA-Enhancer progressively adapts its enhancement strategies under the step-by-step guidance of CoT prompts that encode degradation-related information. Overall, CPA-Enhancer is a plug-and-play lightweight enhancement model that can be integrated into any vision pipeline and trained with task-related losses, without any prior knowledge of the degradation type. Extensive experiments demonstrate that CPA-Enhancer significantly improves performance across various vision tasks under unknown degradations. The codes is available at https://github.com/zyw-stu/CPA-Enhancer.