Protein design using sequence-based models does not benefit from scale

Summary

Protein design using sequence-based models does not benefit from scale (1). Increasing the size of the model used for design from 38M to 650M parameters did not lead to higher pLDDT or self-consistency perplexity of designs.

Figures

Ref (1)

See also

• Protein property prediction using PLMs does not benefit from scale except when predicting inferring features of either structural or sparsely populated sequence families

1.

Alamdari S, Thakkar N, van den Berg R, Tenenholtz N, Strome R, Moses AM, et al. Protein generation with evolutionary diffusion: sequence is all you need. openRxiv; 2023. Available from: https://doi.org/10.1101/2023.09.11.556673