Adaptively Weighted Multi-task Learning Using Inverse Validation Loss

Abstract

Multi-task learning aims to enhance the performance of a model by inductive transfer of information among tasks. However, joint optimization of multiple tasks is challenging due to unbalanced data ranges and variations in task difficulties which can cause the model to converge only for a single task which has large values. To address these problems, we propose a novel weighting scheme based on validation loss. The proposed weighted scheme is evaluated on three datasets, including publicly available Comma.ai and Udacity benchmark dataset and GTA-V dataset. Our experiments demonstrate the superior performance of the proposed approach compared to the current state-of-the-art methods.