EMNLP 2024finding1 citations

Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling

Daehoon Gwak, Junwoo Park, Minho Park, ChaeHun Park, Hyunchan Lee, Edward Choi, Jaegul Choo

Abstract

Predicting future international events from textual information, such as news articles, has tremendous potential for applications in global policy, strategic decision-making, and geopolitics. However, existing datasets available for this task are often limited in quality, hindering the progress of related research. In this paper, we introduce a novel dataset designed to address these limitations by leveraging the advanced reasoning capabilities of large-language models (LLMs). Our dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. We showcase the quality and utility of our dataset for real-world event prediction tasks, demonstrating its effectiveness through extensive experiments and analysis. Furthermore, we publicly release our dataset along with the full automation source code for data collection, labeling, and benchmarking, aiming to support and advance research in text-based event prediction.

BibTeX
@inproceedings{gwak-etal-2024-forecasting,
    title = "Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling",
    author = "Gwak, Daehoon  and
      Park, Junwoo  and
      Park, Minho  and
      Park, ChaeHun  and
      Lee, Hyunchan  and
      Choi, Edward  and
      Choo, Jaegul",
    editor = "Al-Onaizan, Yaser  and
      Bansal, Mohit  and
      Chen, Yun-Nung",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2024",
    month = nov,
    year = "2024",
    address = "Miami, Florida, USA",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.findings-emnlp.526/",
    doi = "10.18653/v1/2024.findings-emnlp.526",
    pages = "9000--9023"
}
Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling · EMNLP 2024