Hrithik Ravi

The Implicit Bias of Gradient Descent on Separable Multiclass Data

Implicit bias describes the phenomenon where optimization-based training algorithms, without explicit regularization, show a preference for simple estimators even when more complex estimators have equal objective values. Multiple works have developed the theory of implicit bias for binary classifica…