ACL 2022short4 citations

Pixie: Preference in Implicit and Explicit Comparisons

Amanul Haque, Vaibhav Garg, Hui Guo, Munindar Singh

Abstract

We present Pixie, a manually annotated dataset for preference classification comprising 8,890 sentences drawn from app reviews. Unlike previous studies on preference classification, Pixie contains implicit (omitting an entity being compared) and indirect (lacking comparative linguistic cues) comparisons. We find that transformer-based pretrained models, finetuned on Pixie, achieve a weighted average F1 score of 83.34% and outperform the existing state-of-the-art preference classification model (73.99%).

BibTeX
@inproceedings{haque-etal-2022-pixie,
    title = "Pixie: Preference in Implicit and Explicit Comparisons",
    author = "Haque, Amanul  and
      Garg, Vaibhav  and
      Guo, Hui  and
      Singh, Munindar",
    editor = "Muresan, Smaranda  and
      Nakov, Preslav  and
      Villavicencio, Aline",
    booktitle = "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)",
    month = may,
    year = "2022",
    address = "Dublin, Ireland",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.acl-short.13/",
    doi = "10.18653/v1/2022.acl-short.13",
    pages = "106--112"
}
Pixie: Preference in Implicit and Explicit Comparisons · ACL 2022