← Search

Mareike Hartmann

7 accepted papers

2025

Evaluating Spatiotemporal Consistency in Automatically Generated Sewing Instructions

EMNLP 2025

In this paper, we propose a novel, automatic tree-based evaluation metric for LLM-generated step-by-step assembly instructions, that more accurately reflects spatiotemporal aspects of construction than traditional metrics such as BLEU and BERT similarity scores. We apply our proposed metric to the d

Cited by 0SourcePDFScholar
2024

ADaPT: As-Needed Decomposition and Planning with Language Models

NAACL 2024findings

Large Language Models (LLMs) are increasingly being used for interactive decision-making tasks requiring planning and adapting to the environment. Recent works employ LLMs-as-agents in broadly two ways: iteratively determining the next action (iterative executors) or generating plans and executing s…

Cited by 92SourcePDFScholar
2024

AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

ACL 2024long

Autonomous agents that address day-to-day digital tasks (e.g., ordering groceries for a household), must not only operate multiple apps (e.g., notes, messaging, shopping app) via APIs, but also generate rich code with complex control flow in an iterative manner based on their interaction with the en…

2021

Analogy Training Multilingual Encoders

AAAI 2021technical

Language encoders encode words and phrases in ways that capture their local semantic relatedness, but are known to be globally inconsistent. Global inconsistency can seemingly be corrected for, in part, by leveraging signals from knowledge bases, but previous results are partial and limited to monol…

2021

mDAPT: Multilingual Domain Adaptive Pretraining in a Single Model

EMNLP 2021finding

Domain adaptive pretraining, i.e. the continued unsupervised pretraining of a language model on domain-specific text, improves the modelling of text for downstream tasks within the domain. Numerous real-world applications are based on domain-specific text, e.g. working with financial or biomedical d…

2019

Comparing Unsupervised Word Translation Methods Step by Step

NeurIPS 2019poster

Cross-lingual word vector space alignment is the task of mapping the vocabularies of two languages into a shared semantic space, which can be used for dictionary induction, unsupervised machine translation, and transfer learning. In the unsupervised regime, an initial seed dictionary is learned in t…