Monitoring geometrical properties of word embeddings for detecting the emergence of new topics.
Clément Christophe, Julien Velcin, Jairo Cugliari, Manel Boumghar, Philippe Suignard
Abstract
Slow emerging topic detection is a task between event detection, where we aggregate behaviors of different words on short period of time, and language evolution, where we monitor their long term evolution. In this work, we tackle the problem of early detection of slowly emerging new topics. To this end, we gather evidence of weak signals at the word level. We propose to monitor the behavior of words representation in an embedding space and use one of its geometrical properties to characterize the emergence of topics. As evaluation is typically hard for this kind of task, we present a framework for quantitative evaluation and show positive results that outperform state-of-the-art methods. Our method is evaluated on two public datasets of press and scientific articles.
BibTeX
@inproceedings{christophe-etal-2021-monitoring,
title = "Monitoring geometrical properties of word embeddings for detecting the emergence of new topics.",
author = "Christophe, Cl{\'e}ment and
Velcin, Julien and
Cugliari, Jairo and
Boumghar, Manel and
Suignard, Philippe",
editor = "Moens, Marie-Francine and
Huang, Xuanjing and
Specia, Lucia and
Yih, Scott Wen-tau",
booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing",
month = nov,
year = "2021",
address = "Online and Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.emnlp-main.76/",
doi = "10.18653/v1/2021.emnlp-main.76",
pages = "994--1003"
}