Andrii Krutsylo

The Inter-batch Diversity of Samples in Experience Replay for Continual Learning

In a Continual Learning setting, models are trained on data with occasional distribution shifts, resulting in forgetting the information learned before each shift. Experience Replay (ER) addresses this challenge by retaining part of the old training samples and replaying them alongside current data,…