Cindy Aloui

SLICE: Supersense-based Lightweight Interpretable Contextual Embeddings

Contextualised embeddings such as BERT have become de facto state-of-the-art references in many NLP applications, thanks to their impressive performances. However, their opaqueness makes it hard to interpret their behaviour. SLICE is a hybrid model that combines supersense labels with contextual emb…