Francesca-Zhoufan Li

Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models

Large pretrained protein language models (PLMs) have improved protein property and structure prediction from sequences via transfer learning, in which weights and representations from PLMs are repurposed for downstream tasks. Although PLMs have shown great promise, currently there is little understa…