Munawara Saiyara Munia

BERT Has More to Offer: BERT Layers Combination Yields Better Sentence Embeddings

Obtaining sentence representations from BERT-based models as feature extractors is invaluable as it takes much less time to pre-compute a one-time representation of the data and then use it for the downstream tasks, rather than fine-tune the whole BERT. Most previous works acquire a sentence's repre…