← Search

Aditya Sinha

4 accepted papers

2024

Learning Structured Representations with Hyperbolic Embeddings

NeurIPS 2024poster

Most real-world datasets consist of a natural hierarchy between classes or an inherent label structure that is either already available or can be constructed cheaply. However, most existing representation learning methods ignore this hierarchy, treating labels as permutation invariant. Recent work […

2022

IGLU: Efficient GCN Training via Lazy Updates

ICLR 2022poster

Training multi-layer Graph Convolution Networks (GCN) using standard SGD techniques scales poorly as each descent step ends up updating node embeddings for a large portion of the graph. Recent attempts to remedy this sub-sample the graph that reduces compute but introduce additional variance and may…

2022

Matryoshka Representation Learning

NeurIPS 2022accept

Learned representations are a central component in modern ML systems, serving a multitude of downstream tasks. When training such representations, it is often the case that computational and statistical constraints for each downstream task are unknown. In this context rigid, fixed capacity represent…