← Search

Jingyun Xiao

4 accepted papers

2024

Your contrastive learning problem is secretly a distribution alignment problem

NeurIPS 2024poster

Despite the success of contrastive learning (CL) in vision and language, its theoretical foundations and mechanisms for building representations remain poorly understood. In this work, we build connections between noise contrastive estimation losses widely used in CL and distribution alignment with…

2022

MTNeuro: A Benchmark for Evaluating Representations of Brain Structure Across Multiple Levels of Abstraction

NeurIPS 2022accept

There are multiple scales of abstraction from which we can describe the same image, depending on whether we are focusing on fine-grained details or a more global attribute of the image. In brain mapping, learning to automatically parse images to build representations of both small-scale features (e.…

2022

Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformers

NeurIPS 2022accept

Complex time-varying systems are often studied by abstracting away from the dynamics of individual components to build a model of the population-level dynamics from the start. However, when building a population-level description, it can be easy to lose sight of each individual and how they contribu…