← Search

Roshan Rao

3 accepted papers

2021

Language models enable zero-shot prediction of the effects of mutations on protein function

NeurIPS 2021poster

Modeling the effect of sequence variation on function is a fundamental problem for understanding and designing proteins. Since evolution encodes information about function into patterns in protein sequences, unsupervised models of variant effects can be learned from sequence data. The approach to da…

2021

Transformer protein language models are unsupervised structure learners

ICLR 2021poster

Unsupervised contact prediction is central to uncovering physical, structural, and functional constraints for protein structure determination and design. For decades, the predominant approach has been to infer evolutionary constraints from a set of related sequences. In the past year, protein langua…

Cited by 380SourcePDFScholar
2019

Evaluating Protein Transfer Learning with TAPE

NeurIPS 2019spotlight

Protein modeling is an increasingly popular area of machine learning research. Semi-supervised learning has emerged as an important paradigm in protein modeling due to the high cost of acquiring supervised protein labels, but the current literature is fragmented when it comes to datasets and standar…