ACL 2024long10 citations

Prompt Expansion for Adaptive Text-to-Image Generation

Siddhartha Datta, Alexander Ku, Deepak Ramachandran, Peter Anderson

Abstract

Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the images can be repetitive. This paper proposes the Prompt Expansion framework that helps users generate high-quality, diverse images with less effort. The Prompt Expansion model takes a text query as input and outputs a set of expanded text prompts that are optimized such that when passed to a text-to-image model, they generate a wider variety of appealing images. We conduct a human evaluation study that shows that images generated through Prompt Expansion are more aesthetically pleasing and diverse than those generated by baseline methods. Overall, this paper presents a novel and effective approach to improving the text-to-image generation experience.

BibTeX
@inproceedings{datta-etal-2024-prompt,
    title = "Prompt Expansion for Adaptive Text-to-Image Generation",
    author = "Datta, Siddhartha  and
      Ku, Alexander  and
      Ramachandran, Deepak  and
      Anderson, Peter",
    editor = "Ku, Lun-Wei  and
      Martins, Andre  and
      Srikumar, Vivek",
    booktitle = "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
    month = aug,
    year = "2024",
    address = "Bangkok, Thailand",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.acl-long.189/",
    doi = "10.18653/v1/2024.acl-long.189",
    pages = "3449--3476"
}
Prompt Expansion for Adaptive Text-to-Image Generation · ACL 2024