← Search

Patrick Lehnen

3 accepted papers

2022

Towards Need-Based Spoken Language Understanding Model Updates: What Have We Learned?

EMNLP 2022industry

In productionized machine learning systems, online model performance is known to deteriorate over time when there is a distributional drift between offline training and online application data. As a remedy, models are typically retrained at fixed time intervals, implying high computational and manua…

Cited by 0SourcePDFScholar
2021

Feedback Attribution for Counterfactual Bandit Learning in Multi-Domain Spoken Language Understanding

EMNLP 2021main

With counterfactual bandit learning, models can be trained based on positive and negative feedback received for historical predictions, with no labeled data needed. Such feedback is often available in real-world dialog systems, however, the modularized architecture commonly used in large-scale syste…

Cited by 6SourcePDFScholar
2020

Leveraging User Paraphrasing Behavior In Dialog Systems To Automatically Collect Annotations For Long-Tail Utterances

COLING 2020industry

In large-scale commercial dialog systems, users express the same request in a wide variety of alternative ways with a long tail of less frequent alternatives. Handling the full range of this distribution is challenging, in particular when relying on manual annotations. However, the same users also p…