← Search

Ricardo Usbeck

6 accepted papers

2023

The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

ACL 2023findings

In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query lang…

2022

DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation

NAACL 2022findings

Task-oriented dialogue generation is challenging since the underlying knowledge is often dynamic and effectively incorporating knowledge into the learning process is hard. It is particularly challenging to generate both human-like and informative responses in this setting. Recent research primarily…

2022

RoMe: A Robust Metric for Evaluating Natural Language Generation

ACL 2022long

Evaluating Natural Language Generation (NLG) systems is a challenging task. Firstly, the metric should ensure that the generated hypothesis reflects the reference’s semantics. Secondly, it should consider the grammatical quality of the generated sentence. Thirdly, it should be robust enough to handl…

2021

Proxy Indicators for the Quality of Open-domain Dialogues

EMNLP 2021main

The automatic evaluation of open-domain dialogues remains a largely unsolved challenge. Despite the abundance of work done in the field, human judges have to evaluate dialogues’ quality. As a consequence, performing such evaluations at scale is usually expensive. This work investigates using a deep-…

2020

Language Model Transformers as Evaluators for Open-domain Dialogues

COLING 2020main

Computer-based systems for communication with humans are a cornerstone of AI research since the 1950s. So far, the most effective way to assess the quality of the dialogues produced by these systems is to use resource-intensive manual labor instead of automated means. In this work, we investigate wh…