Abhishek Purushothama

Getting The Most Out of Your Training Data: Exploring Unsupervised Tasks for Morphological Inflection

Pre-trained transformers such as BERT have been shown to be effective in many natural language tasks. However, they are under-explored for character-level sequence to sequence tasks. In this work, we investigate pre-training transformers for the character-level task of morphological inflection in se…