← Search

Jeffery Kline

2 accepted papers

2023

Efficient Discrete Multi Marginal Optimal Transport Regularization

ICLR 2023top-25%

Optimal transport has emerged as a powerful tool for a variety of problems in machine learning, and it is frequently used to enforce distributional constraints. In this context, existing methods often use either a Wasserstein metric, or else they apply concurrent barycenter approaches when more than…

Cited by 6SourcePDFScholar
2022

Multi Resolution Analysis (MRA) for Approximate Self-Attention

ICML 2022spotlight

Transformers have emerged as a preferred model for many tasks in natural langugage processing and vision. Recent efforts on training and deploying Transformers more efficiently have identified many strategies to approximate the self-attention matrix, a key module in a Transformer architecture. Effec…