← Search

Brian Axelrod

6 accepted papers

2025

LieRE: Lie Rotational Positional Encodings

ICML 2025poster

Transformer architectures depend on explicit position encodings to capture token positional information. Rotary Position Encoding (RoPE) has emerged as a popular choice in language models due to its efficient encoding of relative position information through key-query rotations. However, RoPE faces…

2020

Sample Amplification: Increasing Dataset Size even when Learning is Impossible

ICML 2020poster

Given data drawn from an unknown distribution, D, to what extent is it possible to “amplify” this dataset and faithfully output an even larger set of samples that appear to have been drawn from D? We formalize this question as follows: an (n,m) amplification procedure takes as input n independent dr…

Cited by 17SourcePDFScholar
2019

A Polynomial Time Algorithm for Log-Concave Maximum Likelihood via Locally Exponential Families

NeurIPS 2019poster

We consider the problem of computing the maximum likelihood multivariate log-concave distribution for a set of points. Specifically, we present an algorithm which, given $n$ points in $\mathbb{R}^d$ and an accuracy parameter $\eps>0$, runs in time $\poly(n,d,1/\eps),$ and returns a log-concave dist…

Cited by 12SourcePDFScholar