← Search

Osama Mohammed Afzal

4 accepted papers

2025

Exploring the Limitations of Detecting Machine-Generated Text

COLING 2025main

Recent improvements in the quality of the generations by large language models have spurred research into identifying machine-generated text. Such work often presents high-performing detectors. However, humans and machines can produce text in different styles and domains, yet the the performance imp…

Cited by 2SourcePDFScholar
2024

Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers

EMNLP 2024finding

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present Factcheck-Bench, a holistic end-to-end framework for annotating and evaluating the factuality of LLM-generated…

2024

LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection

EMNLP 2024system demonstrations

The ease of access to large language models (LLMs) has enabled a widespread of machine-generated texts, and now it is often hard to tell whether a piece of text was human-written or machine-generated. This raises concerns about potential misuse, particularly within educational and academic domains.…

2024

M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detection

ACL 2024long

The advent of Large Language Models (LLMs) has brought an unprecedented surge in machine-generated text (MGT) across diverse channels. This raises legitimate concerns about its potential misuse and societal implications. The need to identify and differentiate such content from genuine human-generate…