Summary
ESM-IF, but not other inverse folding models, has learned some evolutionary constraints from sequence databases (1). This is evidenced by a dependence on the availability of training data that is comparable to that of protein language models and Potts models.
Figures

Ref (1)
See also
1.
Li F-Z, Yang J, Johnston KE, Gürsoy E, Yue Y, Arnold FH. Evaluation of machine learning-assisted directed evolution across diverse combinatorial landscapes. Cell Systems. 2025;16(9):101387. Available from: https://doi.org/10.1016/j.cels.2025.101387