← Search

Xiaodi Sun

5 accepted papers

2024

AMPO: Automatic Multi-Branched Prompt Optimization

EMNLP 2024main

Prompt engineering is very important to enhance the performance of large language models (LLMs). When dealing with complex issues, prompt engineers tend to distill multiple patterns from examples and inject relevant solutions to optimize the prompts, achieving satisfying results. However, existing a…

Cited by 3SourcePDFScholar
2024

StraGo: Harnessing Strategic Guidance for Prompt Optimization

EMNLP 2024finding

Prompt engineering is pivotal for harnessing the capabilities of large language models (LLMs) across diverse applications. While existing prompt optimization methods improve prompt effectiveness, they often lead to prompt drifting, wherein newly generated prompts canadversely impact previously succe…

2022

Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks

NAACL 2022industry

Multi-task learning (MTL) aims to solve multiple tasks jointly by sharing a base representation among them. This can lead to more efficient learning and better generalization, as compared to learning each task individually. However, one issue that often arises in MTL is the convergence speed between…

Cited by 4SourcePDFScholar
2022

DynaMaR: Dynamic Prompt with Mask Token Representation

EMNLP 2022industry

Recent research has shown that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. Typically when adapting these language models to downstream tasks, like a classification or regression task, we employ a fine-tuning…

Cited by 1SourcePDFScholar