Simon Hegelich

From BERT‘s Point of View: Revealing the Prevailing Contextual Differences

Though successfully applied in research and industry large pretrained language models of the BERT family are not yet fully understood. While much research in the field of BERTology has tested whether specific knowledge can be extracted from layer activations, we invert the popular probing design to…