← Search

Francesco Barbieri

11 accepted papers

2026

Training AI Co-Scientists Using Rubric Rewards

ICML 2026poster

AI co-scientists are emerging as a useful tool for human researchers, with a crucial ability being proposing a research plan for a given research goal. In this work, we study how to train language models that generate better research plans by leveraging the vast corpus of existing research papers. T…

Cited by 0SourceScholar
2024

Evaluating Very Long-Term Conversational Memory of LLM Agents

ACL 2024long

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented generation (RAG) techniques, their efficacy in very long-term dial…

Cited by 57SourcePDFScholar
2024

Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster

ACL 2024short

Content moderators play a key role in keeping the conversation on social media healthy. While the high volume of content they need to judge represents a bottleneck to the moderation pipeline, no studies have explored how models could support them to make faster decisions. There is, by now, a vast bo…

2024

Multilingual Topic Classification in X: Dataset and Analysis

EMNLP 2024main

In the dynamic realm of social media, diverse topics are discussed daily, transcending linguistic boundaries. However, the complexities of understanding and categorising this content across various languages remain an important challenge with traditional techniques like topic modelling often struggl…

Cited by 0SourcePDFScholar
2024

PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning

ACL 2024long

Instruction tuning has remarkably advanced large language models (LLMs) in understanding and responding to diverse human instructions. Despite the success in high-resource languages, its application in lower-resource ones faces challenges due to the imbalanced foundational abilities of LLMs across d…

2023

SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Research

EMNLP 2023long findings

Despite its relevance, the maturity of NLP for social media pales in comparison with general-purpose models, metrics and benchmarks. This fragmented landscape makes it hard for the community to know, for instance, given a task, which is the best performing model and how it compares with others. To a…

Cited by 0SourceScholar
2022

Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning

CVPR 2022poster

Most methods for conditional video synthesis use a single modality as the condition. This comes with major limitations. For example, it is problematic for a model conditioned on an image to generate a specific motion trajectory desired by the user since there is no means to provide motion informatio…

Cited by 57PDFcodeScholar
2022

TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media

COLING 2022main

Language evolves over time, and word meaning changes accordingly. This is especially true in social media, since its dynamic nature leads to faster semantic shifts, making it challenging for NLP models to deal with new content and trends. However, the number of datasets and models that specifically…

2022

Twitter Topic Classification

COLING 2022main

Social media platforms host discussions about a wide variety of topics that arise everyday. Making sense of all the content and organising it into categories is an arduous task. A common way to deal with this issue is relying on topic modeling, but topics discovered using this technique are difficul…

Cited by 72SourcePDFScholar
2021

On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning

NAACL 2021long

Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, reducing bias in data representations, and using auxiliary training objectives to…

2020

The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks

COLING 2020main

Contextual embeddings derived from transformer-based neural language models have shown state-of-the-art performance for various tasks such as question answering, sentiment analysis, and textual similarity in recent years. Extensive work shows how accurately such models can represent abstract, semant…