← Search

Rongjie Lai

4 accepted papers

2026

Understanding In-Context Learning on Structured Manifolds: Bridging Attention to Kernel Methods

ICLR 2026poster

While in-context learning (ICL) has achieved remarkable success in natural language and vision domains, its theoretical understanding—particularly in the context of structured geometric data—remains unexplored. This paper initiates a theoretical study of ICL for regression of H\"older functions on m…

Cited by 0SourceScholar
2020

Optimizing Mode Connectivity via Neuron Alignment

NeurIPS 2020poster

The loss landscapes of deep neural networks are not well understood due to their high nonconvexity. Empirically, the local minima of these loss functions can be connected by a learned curve in model space, along which the loss remains nearly constant; a feature known as mode connectivity. Yet, curre…