Itamar Trainin

T5Score: A Methodology for Automatically Assessing the Quality of LLM Generated Multi-Document Topic Sets

Using LLMs for Multi-Document Topic Extraction has recently gained popularity due to their apparent high-quality outputs, expressiveness, and ease of use. However, most existing evaluation practices are not designed for LLM-generated topics and result in low inter-annotator agreement scores, hinderi…