Peter Racioppo

Robust Filter Attention: Self-Attention as a Parallel State Estimator

We introduce Robust Filter Attention (RFA), an attention mechanism that reformulates self-attention as parallel robust filtering under a latent stochastic differential equation (SDE) prior, where analytically propagated uncertainty defines a time-dependent precision prior over attention weights. Thi…