← Search

Jaidev Gill

3 accepted papers

2024

Engineering the Neural Collapse Geometry of Supervised-Contrastive Loss

ICASSP 2024accepted

Supervised-contrastive loss (SCL) is an alternative to cross-entropy (CE) for classification tasks that makes use of similarities in the embedding space to allow for richer representations. In this work, we propose methods to engineer the geometry of these learnt feature embeddings by modifying the…

Cited by 0SourceScholar
2024

Engineering the Neural Collapse Geometry of Supervised-Contrastive Loss (Student Abstract)

AAAI 2024technical

Supervised-contrastive loss (SCL) is an alternative to cross-entropy (CE) for classification tasks that makes use of similarities in the embedding space to allow for richer representations. Previous works have used trainable prototypes to help improve test accuracy of SCL when training under imbalan…

Cited by 0SourcePDFScholar
2024

Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching

ICLR 2024poster

Supervised contrastive loss (SCL) is a competitive and often superior alternative to the cross-entropy loss for classification. While prior studies have demonstrated that both losses yield symmetric training representations under balanced data, this symmetry breaks under class imbalances. This paper…

Cited by 1SourcePDFScholar