EMNLP 2024finding1 citations

Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistants

Rafael Ferreira, David Semedo, Joao Magalhaes

Abstract

Conversational systems must be robust to user interactions that naturally exhibit diverse conversational traits. Capturing and simulating these diverse traits coherently and efficiently presents a complex challenge. This paper introduces Multi-Trait Adaptive Decoding (mTAD), a method that generates diverse user profiles at decoding-time by sampling from various trait-specific Language Models (LMs). mTAD provides an adaptive and scalable approach to user simulation, enabling the creation of multiple user profiles without the need for additional fine-tuning. By analyzing real-world dialogues from the Conversational Task Assistant (CTA) domain, we identify key conversational traits and developed a framework to generate profile-aware dialogues that enhance conversational diversity. Experimental results validate the effectiveness of our approach in modeling single-traits using specialized LMs, which can capture less common patterns, even in out-of-domain tasks. Furthermore, the results demonstrate that mTAD is a robust and flexible framework for combining diverse user simulators.

BibTeX
@inproceedings{ferreira-etal-2024-multi,
    title = "Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistants",
    author = "Ferreira, Rafael  and
      Semedo, David  and
      Magalhaes, Joao",
    editor = "Al-Onaizan, Yaser  and
      Bansal, Mohit  and
      Chen, Yun-Nung",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2024",
    month = nov,
    year = "2024",
    address = "Miami, Florida, USA",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.findings-emnlp.945/",
    doi = "10.18653/v1/2024.findings-emnlp.945",
    pages = "16105--16130"
}
Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistants · EMNLP 2024