← Search

Mark Kong

2 accepted papers

2025

Are Greedy Task Orderings Better Than Random in Continual Linear Regression?

NeurIPS 2025poster

We analyze task orderings in continual learning for linear regression, assuming joint realizability of training data. We focus on orderings that greedily maximize dissimilarity between consecutive tasks, a concept briefly explored in prior work but still surrounded by open questions. Using tools fro…

Cited by 0SourceScholar
2023

Nearly Optimal Bounds for Cyclic Forgetting

NeurIPS 2023poster

We provide theoretical bounds on the forgetting quantity in the continual learning setting for linear tasks, where each round of learning corresponds to projecting onto a linear subspace. For a cyclic task ordering on $T$ tasks repeated $m$ times each, we prove the best known upper bound of $O(T^2/m…

Cited by 6SourcePDFScholar