Frederic Hopp

Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks

Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreement among raters. Annotations have commonly been aggregated by employing methods like majority voting to determine a sing…