ICXML: An In-Context Learning Framework for Zero-Shot Extreme Multi-Label Classification

Yaxin Zhu; Hamed Zamani

NAACL 2024findings11 citations

ICXML: An In-Context Learning Framework for Zero-Shot Extreme Multi-Label Classification

Abstract

This paper focuses on the task of Extreme Multi-Label Classification (XMC) whose goal is to predict multiple labels for each instance from an extremely large label space. While existing research has primarily focused on fully supervised XMC, real-world scenarios often lack supervision signals, highlighting the importance of zero-shot settings. Given the large label space, utilizing in-context learning approaches is not trivial. We address this issue by introducing In-Context Extreme Multi-label Learning (ICXML), a two-stage framework that cuts down the search space by generating a set of candidate labels through in-context learning and then reranks them. Extensive experiments suggest that ICXML advances the state of the art on two diverse public benchmarks.

BibTeX

@inproceedings{zhu-zamani-2024-icxml,
    title = "{ICXML}: An In-Context Learning Framework for Zero-Shot Extreme Multi-Label Classification",
    author = "Zhu, Yaxin  and
      Zamani, Hamed",
    editor = "Duh, Kevin  and
      Gomez, Helena  and
      Bethard, Steven",
    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2024",
    month = jun,
    year = "2024",
    address = "Mexico City, Mexico",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.findings-naacl.134/",
    doi = "10.18653/v1/2024.findings-naacl.134",
    pages = "2086--2098"
}