← Search

Junjie Ke

10 accepted papers

2025

Calibrated Multi-Preference Optimization for Aligning Diffusion Models

CVPR 2025poster

Aligning text-to-image (T2I) diffusion models with prefer-ence optimization is valuable for human-annotated datasets, but the heavy cost of manual data collection limits scalability. Using reward models offers an alternative, however, current preference optimization methods fall short in exploiting…

Cited by 5SourcePDFScholar
2025

Cropper: Vision-Language Model for Image Cropping through In-Context Learning

CVPR 2025poster

The goal of image cropping is to identify visually appealing crops in an image. Conventional methods are trained on specific datasets and fail to adapt to new requirements. Recent breakthroughs in large vision-language models (VLMs) enable visual in-context learning without explicit training. Howeve…

Cited by 2SourcePDFScholar
2024

ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling

ECCV 2024poster

"Recognizing and disentangling visual attributes from objects is a foundation to many computer vision applications. While large vision-language representations like CLIP had largely resolved the task of zero-shot object recognition, zero-shot visual attribute recognition remains a challenge because…

2024

Optical Diffusion Models for Image Generation

NeurIPS 2024poster

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output, creating significant latency and energy consumption on digital…

Cited by 2SourcePDFScholar
2024

Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generation

ECCV 2024oral

"Recent works have demonstrated that using reinforcement learning (RL) with multiple quality rewards can improve the quality of generated images in text-to-image (T2I) generation. However, manually adjusting reward weights poses challenges and may cause over-optimization in certain metrics. To solve…

Cited by 22SourcePDFScholar
2024

Rich Human Feedback for Text-to-Image Generation

CVPR 2024poster

Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen have made significant progress in generating high-resolution images based on text descriptions. However many generated images still suffer from issues such as artifacts/implausibility misalignment with text descriptions…

2023

VILA: Learning Image Aesthetics From User Comments With Vision-Language Pretraining

CVPR 2023poster

Assessing the aesthetics of an image is challenging, as it is influenced by multiple factors including composition, color, style, and high-level semantics. Existing image aesthetic assessment (IAA) methods primarily rely on human-labeled rating scores, which oversimplify the visual aesthetic informa…

2021

Adversarially Adaptive Normalization for Single Domain Generalization

CVPR 2021poster

Single domain generalization aims to learn a model that performs well on many unseen domains with only one domain data for training. Existing works focus on studying the adversarial domain augmentation (ADA) to improve the model's generalization capability. The impact on domain generalization from t…

Cited by 161PDFScholar
2021

Rich Features for Perceptual Quality Assessment of UGC Videos

CVPR 2021poster

Video quality assessment for User Generated Content (UGC) is an important topic in both industry and academia. Most existing methods only focus on one aspect of the perceptual quality assessment, such as technical quality or compression artifacts. In this paper, we create a large scale dataset to co…

Cited by 105PDFScholar