← Search

Yunsung Lee

9 accepted papers

2026

D2E: Scaling Vision-Action Pretraining on Desktop Data for Transfer to Embodied AI

ICLR 2026poster

Large language models leverage internet-scale text data, yet embodied AI remains constrained by the prohibitive costs of physical trajectory collection. Desktop environments---particularly gaming---offer a compelling alternative: they provide rich sensorimotor interactions at scale while maintaining…

Cited by 0SourcecodeScholar
2024

Multi-Architecture Multi-Expert Diffusion Models

AAAI 2024technical

In this paper, we address the performance degradation of efficient diffusion models by introducing Multi-architecturE Multi-Expert diffusion models (MEME). We identify the need for tailored operations at different time-steps in diffusion processes and leverage this insight to create compact yet high…

2023

Addressing Negative Transfer in Diffusion Models

NeurIPS 2023poster

Diffusion-based generative models have achieved remarkable success in various domains. It trains a shared model on denoising tasks that encompass different noise levels simultaneously, representing a form of multi-task learning (MTL). However, analyzing and improving diffusion models from an MTL per…

2023

Cross Encoding as Augmentation: Towards Effective Educational Text Classification

ACL 2023findings

Text classification in education, usually called auto-tagging, is the automated process of assigning relevant tags to educational content, such as questions and textbooks. However, auto-tagging suffers from a data scarcity problem, which stems from two major challenges: 1) it possesses a large tag s…

Cited by 5SourcePDFScholar
2023

Evaluation of Question Generation Needs More References

ACL 2023findings

Question generation (QG) is the task of generating a valid and fluent question based on a given context and the target answer. According to various purposes, even given the same context, instructors can ask questions about different concepts, and even the same concept can be written in different way…

Cited by 2SourcePDFScholar
2023

Towards Practical Plug-and-Play Diffusion Models

CVPR 2023poster

Diffusion-based generative models have achieved remarkable success in image generation. Their guidance formulation allows an external model to plug-and-play control the generation process for various tasks without fine-tuning the diffusion model. However, the direct use of publicly available off-the…

2021

CATs: Cost Aggregation Transformers for Visual Correspondence

NeurIPS 2021poster

We propose a novel cost aggregation network, called Cost Aggregation Transformers (CATs), to find dense correspondences between semantically similar images with additional challenges posed by large intra-class appearance and geometric variations. Cost aggregation is a highly important process in mat…

2021

SWAD: Domain Generalization by Seeking Flat Minima

NeurIPS 2021poster

Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains. Although a variety of DG methods have been proposed, a recent study shows that under a fair evaluation protocol, called DomainBed, the simple empirical r…

2020

Reference-Based Sketch Image Colorization Using Augmented-Self Reference and Dense Semantic Correspondence

CVPR 2020poster

This paper tackles the automatic colorization task of a sketch image given an already-colored reference image. Colorizing a sketch image is in high demand in comics, animation, and other content creation applications, but it suffers from information scarcity of a sketch image. To address this, a ref…

Cited by 382PDFScholar