← Search

Carolina Scarton

14 accepted papers

2025

It’s All About In-Context Learning! Teaching Extremely Low-Resource Languages to LLMs

EMNLP 2025

Extremely low-resource languages, especially those written in rare scripts, remain largely unsupported by large language models (LLMs). This is due in part to compounding factors such as the lack of training data. This paper delivers the first comprehensive analysis of whether LLMs can acquire such

2025

Label Set Optimization via Activation Distribution Kurtosis for Zero-Shot Classification with Generative Models

EMNLP 2025

In-context learning (ICL) performance is highly sensitive to prompt design, yet the impact of class label options (e.g. lexicon or order) in zero-shot classification remains underexplored. This study proposes LOADS (Label set Optimization via Activation Distribution kurtosiS), a post-hoc method for

Cited by 0SourcePDFScholar
2024

ATLAS: Improving Lay Summarisation with Attribute-based Control

ACL 2024short

Lay summarisation aims to produce summaries of scientific articles that are comprehensible to non-expert audiences. However, previous work assumes a one-size-fits-all approach, where the content and style of the produced summary are entirely dependent on the data used to train the model. In practice…

Cited by 1SourcePDFScholar
2024

Can We Identify Stance without Target Arguments? A Study for Rumour Stance Classification

COLING 2024main

Considering a conversation thread, rumour stance classification aims to identify the opinion (e.g. agree or disagree) of replies towards a target (rumour story). Although the target is expected to be an essential component in traditional stance classification, we show that rumour stance classificati…

2024

Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Loss

ACL 2024findings

Accurately modeling idiomatic or non-compositional language has been a longstanding challenge in Natural Language Processing (NLP). This is partly because these expressions do not derive their meanings solely from their constituent words, but also due to the scarcity of relevant data resources, and…

2024

Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Science

COLING 2024main

Instruction-tuned Large Language Models (LLMs) have exhibited impressive language understanding and the capacity to generate responses that follow specific prompts. However, due to the computational demands associated with training these models, their applications often adopt a zero-shot setting. In…

Cited by 29SourcePDFScholar
2024

Reference-less Analysis of Context Specificity in Translation with Personalised Language Models

COLING 2024main

Sensitising language models (LMs) to external context helps them to more effectively capture the speaking patterns of individuals with specific characteristics or in particular environments. This work investigates to what extent detailed character and film annotations can be leveraged to personalise…

2023

Analysing State-Backed Propaganda Websites: a New Dataset and Linguistic Study

EMNLP 2023short main

This paper analyses two hitherto unstudied sites sharing state-backed disinformation, Reliable Recent News (rrn.world) and WarOnFakes (waronfakes.com), which publish content in Arabic, Chinese, English, French, German, and Spanish. We describe our content acquisition methodology and perform cross-si…

Cited by 0SourcecodeScholar
2023

Don't waste a single annotation: improving single-label classifiers through soft labels

EMNLP 2023short findings

In this paper, we address the limitations of the common data annotation and training methods for objective single-label classification tasks. Typically, when annotating such tasks annotators are only asked to provide a single label for each sample and annotator disagreement is discarded when a final…

Cited by 0SourceScholar
2023

Enhancing Biomedical Lay Summarisation with External Knowledge Graphs

EMNLP 2023long main

Previous approaches for automatic lay summarisation are exclusively reliant on the source article that, given it is written for a technical audience (e.g., researchers), is unlikely to explicitly define all technical concepts or state all of the background information that is relevant for a lay audi…

Cited by 0SourcecodeScholar
2023

MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation

ACL 2023findings

Efficient utilisation of both intra- and extra-textual context remains one of the critical gaps between machine and human translation. Existing research has primarily focused on providing individual, well-defined types of context in translation, such as the surrounding text or discrete external vari…

2022

Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature

EMNLP 2022main

Lay summarisation aims to jointly summarise and simplify a given text, thus making its content more comprehensible to non-experts.Automatic approaches for lay summarisation can provide significant value in broadening access to scientific literature, enabling a greater degree of both interdisciplinar…

2021

AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Models

EMNLP 2021finding

Despite their success in a variety of NLP tasks, pre-trained language models, due to their heavy reliance on compositionality, fail in effectively capturing the meanings of multiword expressions (MWEs), especially idioms. Therefore, datasets and methods to improve the representation of MWEs are urge…

2021

Assessing the Representations of Idiomaticity in Vector Models with a Noun Compound Dataset Labeled at Type and Token Levels

ACL 2021long

Accurate assessment of the ability of embedding models to capture idiomaticity may require evaluation at token rather than type level, to account for degrees of idiomaticity and possible ambiguity between literal and idiomatic usages. However, most existing resources with annotation of idiomaticity…