← Search

Qingyi Liu

3 accepted papers

2024

Adaptive Prompt Routing for Arbitrary Text Style Transfer with Pre-trained Language Models

AAAI 2024technical

Recently, arbitrary text style transfer (TST) has made significant progress with the paradigm of prompt learning. In this paradigm, researchers often design or search for a fixed prompt for any input. However, existing evidence shows that large language models (LLMs) are prompt-sensitive and it is s…

2024

Autoregressive Pre-Training on Pixels and Texts

EMNLP 2024main

The integration of visual and textual information represents a promising direction in the advancement of language models. In this paper, we explore the dual modality of language—both visual and textual—within an autoregressive framework, pre-trained on both document images and texts. Our method empl…

2024

On Training Data Influence of GPT Models

EMNLP 2024main

Amidst the rapid advancements in generative language models, the investigation of how training data shapes the performance of GPT models is still emerging. This paper presents GPTfluence, a novel approach that leverages a featurized simulation to assess the impact of training examples on the trainin…