← Search

Sunny Rajagopalan

2 accepted papers

2022

Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks

NAACL 2022industry

Multi-task learning (MTL) aims to solve multiple tasks jointly by sharing a base representation among them. This can lead to more efficient learning and better generalization, as compared to learning each task individually. However, one issue that often arises in MTL is the convergence speed between…

Cited by 4SourcePDFScholar
2022

DynaMaR: Dynamic Prompt with Mask Token Representation

EMNLP 2022industry

Recent research has shown that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. Typically when adapting these language models to downstream tasks, like a classification or regression task, we employ a fine-tuning…

Cited by 1SourcePDFScholar