2022
Transformers are Meta-Reinforcement Learners
ICML 2022spotlight
The transformer architecture and variants presented a remarkable success across many machine learning tasks in recent years. This success is intrinsically related to the capability of handling long sequences and the presence of context-dependent weights from the attention mechanism. We argue that th…