Long Minh Bui

Revisiting Kernel Attention with Correlated Gaussian Process Representation

Transformers have increasingly become the de facto method to model sequential data with state-of-the-art performance. Due to its widespread use, being able to estimate and calibrate its modeling uncertainty is important to understand and design robust transformer models. To achieve this, previous wo…