2023
Trinet: Stabilizing Self-Supervised Learning From Complete or Slow Collapse
ICASSP 2023accepted
Self-supervised learning (SSL) models confront challenges of abrupt informational collapse or slow dimensional collapse. We propose TriNet, which introduces a novel triple-branch architecture for preventing collapse and stabilizing the pretraining. TriNet learns the SSL latent embedding space and in…