← Search

Fred Morstatter

12 accepted papers

2024

Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks

NAACL 2024long

Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreement among raters. Annotations have commonly been aggregated by employing methods like majority voting to determine a sing…

2024

Contextualizing Argument Quality Assessment with Relevant Knowledge

NAACL 2024short

Automatic assessment of the quality of arguments has been recognized as a challenging task with significant implications for misinformation and targeted speech. While real-world arguments are tightly anchored in context, existing computational methods analyze their quality in isolation, which affect…

2024

Policy Learning for Localized Interventions from Observational Data

AISTATS 2024poster

A largely unaddressed problem in causal inference is that of learning reliable policies in continuous, high-dimensional treatment variables from observational data. Especially in the presence of strong confounding, it can be infeasible to learn the entire heterogeneous response surface from treatmen…

Cited by 2SourcePDFScholar
2024

The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performance

ACL 2024findings

Large Language Models (LLMs) are regularly being used to label data across many domains and for myriad tasks. By simply asking the LLM for an answer, or “prompting,” practitioners are able to use LLMs to quickly get a response for an arbitrary task. This prompting is done through a series of decisio…

2023

Modeling Cross-Cultural Pragmatic Inference with Codenames Duet

ACL 2023findings

Pragmatic reference enables efficient interpersonal communication. Prior work uses simple reference games to test models of pragmatic reasoning, often with unidentified speakers and listeners. In practice, however, speakers’ sociocultural background shapes their pragmatic assumptions. For example, r…

2023

Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning

EMNLP 2023long main

Temporal knowledge graph (TKG) forecasting benchmarks challenge models to predict future facts using knowledge of past facts. In this paper, we develop an approach to use in-context learning (ICL) with large language models (LLMs) for TKG forecasting. Our extensive evaluation compares diverse baseli…

Cited by 0SourcecodeScholar
2022

Robust Conversational Agents against Imperceptible Toxicity Triggers

NAACL 2022long

Warning: this paper contains content that maybe offensive or upsetting. Recent research in Natural Language Processing (NLP) has advanced the development of various toxicity detection models with the intention of identifying and mitigating toxic language from existing systems. Despite the abundance…

2021

Exacerbating Algorithmic Bias through Fairness Attacks

AAAI 2021technical

Algorithmic fairness has attracted significant attention in recent years, with many quantitative measures suggested for characterizing the fairness of different machine learning algorithms. Despite this interest, the robustness of those fairness measures with respect to an intentional adversarial at…

2021

ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data

ACL 2021long

Event forecasting is a challenging, yet important task, as humans seek to constantly plan for the future. Existing automated forecasting studies rely mostly on structured data, such as time-series or event-based knowledge graphs, to help predict future events. In this work, we aim to formulate a tas…

Cited by 48SourcePDFScholar
2021

Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources

EMNLP 2021main

Warning: this paper contains content that may be offensive or upsetting. Commonsense knowledge bases (CSKB) are increasingly used for various natural language processing tasks. Since CSKBs are mostly human-generated and may reflect societal biases, it is important to ensure that such biases are not…

Cited by 43SourcePDFScholar