Shiyou Wu

Understanding The Robustness of Self-supervised Learning Through Topic Modeling

Self-supervised learning has significantly improved the performance of many NLP tasks. However, how can self-supervised learning discover useful features, and why is it better than traditional approaches such as probabilistic models are still largely unknown. In this paper, we focus on the context o…