2023
Tighter Bounds on the Expressivity of Transformer Encoders
ICML 2023poster
Characterizing neural networks in terms of better-understood formal systems has the potential to yield new insights into the power and limitations of these networks. Doing so for transformers remains an active area of research. Bhattamishra and others have shown that transformer encoders are at leas…