Carson Hu

Glassoformer: A Query-Sparse Transformer for Post-Fault Power Grid Voltage Prediction

We propose GLassoformer, a novel and efficient transformer architecture leveraging group Lasso regularization to reduce the number of queries of the standard self-attention mechanism. Due to the sparsified queries, GLassoformer is more computationally efficient than the standard transformers. On the…