Continual Cell Instance Segmentation of Microscopy Images

Abstract

A continual cell instance segmenter aims to continually learn to segment new objects while preserving the ability to localize and distinguish old objects without access to previous data. Besides catastrophic forgetting, background shift, where the background class could contain objects in the old and unseen future classes, could occur. In addition, as acquiring annotations is label-intensive, cell images can be partially labeled. In this paper, we present iMRCNN, which extends Mask R-CNN with knowledge distillation and pseudo labeling, to address these challenges. To preserve the learned skills, the current student distills knowledge from the former teacher at output and feature levels. Furthermore, we employ a pseudo labeling scheme, where the teacher is utilized to identify objects with no labels provided, to deal with background shift and partially labeled data. Experiments on two microscopy image sets demonstrate the effectiveness of iMRCNN over other alternatives in various incremental learning scenarios.