{"id":601887,"date":"2023-01-27T14:49:23","date_gmt":"2023-01-27T20:49:23","guid":{"rendered":"https:\/\/news.sellorbuyhomefast.com\/index.php\/2023\/01\/27\/large-language-models-generate-functional-protein-sequences-across-diverse-families\/"},"modified":"2023-01-27T14:49:23","modified_gmt":"2023-01-27T20:49:23","slug":"large-language-models-generate-functional-protein-sequences-across-diverse-families","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2023\/01\/27\/large-language-models-generate-functional-protein-sequences-across-diverse-families\/","title":{"rendered":"Large language models generate functional protein sequences across diverse families"},"content":{"rendered":"
\n
  • \n

    Koga, N. et al. Principles for designing ideal protein structures. Nature<\/i> 491<\/b>, 222\u2013227 (2012).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Lin, Y.-R. et al. Control over overall shape and size in de novo designed proteins. Proc. Natl Acad. Sci. USA<\/i> 112<\/b>, E5478\u2013E5485 (2015).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Huang, P.-S., Boyken, S. E. & Baker, D. The coming of age of de novo protein design. Nature<\/i> 537<\/b>, 320\u2013327 (2016).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Huang, P.-S. et al. De novo design of a four-fold symmetric TIM-barrel protein with atomic-level accuracy. Nat. Chem. Biol.<\/i> 12<\/b>, 29\u201334 (2016).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Boyken, S. E. et al. De novo design of protein homo-oligomers with modular hydrogen-bond network\u2013mediated specificity. Science<\/i> 352<\/b>, 680\u2013687 (2016).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Lapedes, A. S., Bertrand, G. G., LonChang, L. & Stormo, G. D. Correlated mutations in models of protein sequences: Phylogenetic and structural effects. Lect. Notes Monogr. Ser.<\/i> 33<\/b>, 236\u2013256 (1999).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Russ, W. P. et al. An evolution-based model for designing chorismate mutase enzymes. Science<\/i> 369<\/b>, 440\u2013445 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Hopf, T. A. et al. The EVcouplings Python framework for coevolutionary sequence analysis. Bioinformatics<\/i> 35<\/b>, 1582\u20131584 (2019).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Morcos, F. et al. Direct-coupling analysis of residue coevolution captures native contacts across many protein families. Proc. Natl Acad. Sci. USA<\/i> 108<\/b>, E1293\u2013E1301 (2011).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ovchinnikov, S., Kamisetty, H. & Baker, D. Robust and accurate prediction of residue-residue interactions across protein interfaces using evolutionary information. eLife<\/i> 3<\/b>, e02030 (2014).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M. & Church, G. M. Unified rational protein engineering with sequence-based deep representation learning. Nat. Methods<\/i> 16<\/b>, 1315\u20131322 (2019).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wu, Z. et al. Signal peptides generated by attention-based neural networks. ACS Synth. Biol.<\/i> 9<\/b>, 2154\u20132161 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Shin, J.-E. et al. Protein design and variant prediction using autoregressive generative models. Nat. Commun.<\/i> 12<\/b>, 2403 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Jumper, J. et al. Highly accurate protein structure prediction with AlphaFold. Nature<\/i> 596<\/b>, 583\u2013589 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bryant, D. H. et al. Deep diversification of an AAV capsid protein by machine learning. Nat. Biotechnol.<\/i> 39<\/b>, 691\u2013696 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Das, P. et al. Accelerated antimicrobial discovery via deep generative models and molecular dynamics simulations. Nat. Biomed. Eng.<\/i> 5<\/b>, 613\u2013623 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Anishchenko, I. et al. De novo protein design by deep network hallucination. Nature<\/i> 600<\/b>, 547\u2013552 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Moffat, L., Kandathil, S. M. & Jones, D. T. Design in the DARK: Learning deep generative models for De Novo Protein Design. Preprint at bioRxiv https:\/\/doi.org\/10.1101\/2022.01.27.478087<\/a> (2022).<\/p>\n<\/li>\n

  • \n

    Ferruz, N., Schmidt, S. & H\u00f6cker, B. ProtGPT2 is a deep unsupervised language model for protein design. Nat. Commun.<\/i> 13<\/b>, 4348 (2022).<\/p>\n<\/li>\n

  • \n

    Huang, B. et al. A backbone-centred energy function of neural networks for protein design. Nature<\/i> 602<\/b>, 523\u2013528 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Leinonen, R. et al. UniProt archive. Bioinformatics<\/i> 20<\/b>, 3236\u20133237 (2004).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bairoch, A. et al. The Universal Protein Resource (UniProt). Nucleic Acids Res.<\/i> 33<\/b>, D154\u2013D159 (2005).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Finn, R. D. et al. Pfam: the protein families database. Nucleic Acids Res.<\/i> 42<\/b>, D222\u2013D230 (2014).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Vaswani, A. et al. Attention is all you need. In 31st Conference on Neural Information Processing Systems<\/i> (NIPS, 2017).<\/p>\n<\/li>\n

  • \n

    Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of North American Chapter of the Association for Computational Linguistics: Human Language Technologies<\/i> (NAACL-HLT, 2019).<\/p>\n<\/li>\n

  • \n

    Brown, T. B. et al. Language models are few-shot learners. In 34th Conference on Neural Information Processing Systems<\/i> (NeurIPS, 2020).<\/p>\n<\/li>\n

  • \n

    Zellers, R. et al. Defending against neural fake news. In 33rd Conference on Neural Information Processing Systems<\/i> (NeurIPS, 2019).<\/p>\n<\/li>\n

  • \n

    Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C. & Socher, R. CTRL: a conditional transformer language model for controllable generation. Preprint at arXiv<\/i> https:\/\/doi.org\/10.48550\/arXiv.1909.05858<\/a> (2019).<\/p>\n<\/li>\n

  • \n

    AlQuraishi, M. The future of protein science will not be supervised. Some Thoughts on a Mysterious Universe<\/i> https:\/\/moalquraishi.wordpress.com\/2019\/04\/01\/the-future-of-protein-science-will-not-be-supervised\/<\/a> (2019).<\/p>\n<\/li>\n

  • \n

    Rives, A. et al. Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc. Natl Acad. Sci. USA<\/i> 118<\/b>, e2016239118 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Elnaggar, A. et al. ProtTrans: towards cracking the language of lifes code through self-supervised deep learning and high performance computing. IEEE Trans. Pattern Anal. Mach. Intell.<\/i> 44<\/b>, 7112\u20137127 (2021).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Peters, M. E. et al. Deep contextualized word representations. In Proceedings of North American Chapter of the Association for Computational Linguistics: Human Language Technologies<\/i> (NAACL-HLT, 2018).<\/p>\n<\/li>\n

  • \n

    Howard, J. & Ruder, S. Universal language model fine-tuning for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics<\/i> (ACL, 2018).<\/p>\n<\/li>\n

  • \n

    Radford, A., Narasimhan, K., Salimans, T. & Sutskever, I. Improving language understanding by generative pre-training. Preprint at https:\/\/s3-us-west-2.amazonaws.com\/openai-assets\/research-covers\/language-unsupervised\/language_understanding_paper.pdf<\/a> (2018).<\/p>\n<\/li>\n

  • \n

    Biswas, S., Khimulya, G., Alley, E. C., Esvelt, K. M. & Church, G. M. Low-N protein engineering with data-efficient deep learning. Nat. Methods<\/i> 18<\/b>, 389\u2013396 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Pfaff, C. W. Constraints on language mixing: Intrasentential code-switching and borrowing in Spanish\/English. Language<\/i> 55<\/b>, 291\u2013318 (1979).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Poplack, S. Sometimes I\u2019ll start a sentence in Spanish Y TERMINO EN ESPA\u00d1OL: toward a typology of code-switching. Linguistics<\/i> 18<\/b>, 581\u2013618 (1980).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Dathathri, S. et al. Plug and play language models: a simple approach to controlled text generation. In 8th International Conference on Learning Representations<\/i> (ICLR, 2020).<\/p>\n<\/li>\n

  • \n

    Matthews, B. W. Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim. Biophys. Acta<\/i> 405<\/b>, 442\u2013451 (1975).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Broendum, S. S., Buckle, A. M. & McGowan, S. Catalytic diversity and cell wall binding repeats in the phage-encoded endolysins. Mol. Microbiol.<\/i> 110<\/b>, 879\u2013896 (2018).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Love, M. J., Abeysekera, G. S., Muscroft-Taylor, A. C., Billington, C. & Dobson, R. C. J. On the catalytic mechanism of bacteriophage endolysins: opportunities for engineering. Biochim. Biophys. Acta. Proteins Proteom.<\/i> 1868<\/b>, 140302 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Martin, P. P. Potts Models And Related Problems In Statistical Mechanics<\/i> (World Scientific, 1991).<\/p>\n<\/li>\n

  • \n

    Thomas, J., Ramakrishnan, N. & Bailey-Kellogg, C. Graphical models of residue coupling in protein families. IEEE\/ACM Trans. Comput. Biol. Bioinform.<\/i> 5<\/b>, 183\u2013197 (2008).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Weigt, M., White, R. A., Szurmant, H., Hoch, J. A. & Hwa, T. Identification of direct residue contacts in protein\u2013protein interaction by message passing. Proc. Natl Acad. Sci. USA<\/i> 106<\/b>, 67\u201372 (2009).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Balakrishnan, S., Kamisetty, H., Carbonell, J. G., Lee, S.-I. & Langmead, C. J. Learning generative models for protein fold families. Proteins<\/i> 79<\/b>, 1061\u20131078 (2011).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Stein, R. R., Marks, D. S. & Sander, C. Inferring pairwise interactions from biological data using maximum-entropy probability models. PLoS Comput. Biol.<\/i> 11<\/b>, e1004182 (2015).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Mirdita, M., Steinegger, M., Breitwieser, F., S\u00f6ding, J. & Levy Karin, E. Fast and sensitive taxonomic assignment to metagenomic contigs. Binformatics<\/i> 37<\/b>, 3029\u20133031 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Mooers, B. H. M., Tronrud, D. E. & Matthews, B. W. Evaluation at atomic resolution of the role of strain in destabilizing the temperature-sensitive T4 lysozyme mutant Arg 96 \u2192 His. Protein Sci.<\/i> 18<\/b>, 863\u2013870 (2009).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Baase, W. A., Liu, L., Tronrud, D. E. & Matthews, B. W. Lessons from the lysozyme of phage T4. Protein Sci.<\/i> 19<\/b>, 631\u2013641 (2010).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kuroki, R., Weaver, L. H. & Matthews, B. W. A covalent enzyme\u2013substrate intermediate with saccharide distortion in a mutant T4 lysozyme. Science<\/i> 262<\/b>, 2030\u20132033 (1993).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Mchaourab, H. S., Oh, K. J., Fang, C. J. & Hubbell, W. L. Conformation of T4 lysozyme in solution. Hinge-bending motion and the substrate-induced conformational transition studied by site-directed spin labeling. Biochemistry<\/i> 36<\/b>, 307\u2013316 (1997).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kim, J.-K. et al. BetaCavityWeb: a webserver for molecular voids and channels. Nucleic Acids Res.<\/i> 43<\/b>, W413\u2013W418 (2015).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Rost, B. Twilight zone of protein sequence alignments. Protein Eng.<\/i> 12<\/b>, 85\u201394 (1999).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Pearson, W. R. An introduction to sequence similarity (\u2018homology\u2019) searching. Curr. Protoc. Bioinforma.<\/i> 3<\/b>, 3.1 (2013). ChapterUnit.<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Repecka, D. et al. Expanding functional protein sequence spaces using generative adversarial networks. Nat. Mach. Intell.<\/i> 3<\/b>, 324\u2013333 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ruder, S., Peters, M. E., Swayamdipta, S. & Wolf, T. Transfer learning in natural language processing. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics<\/i> (eds Jill Burstein, J., Doran, C. & Solorio T.) (Association for Computational Linguistics, 2019).<\/p>\n<\/li>\n

  • \n

    Huh, M., Agrawal, P. & Efros, A. A. What makes ImageNet good for transfer learning? Preprint at arXiv<\/i> https:\/\/doi.org\/10.48550\/arXiv.1608.08614<\/a> (2016).<\/p>\n<\/li>\n

  • \n

    LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature<\/i> 521<\/b>, 436\u2013444 (2015).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Norn, C. et al. Protein sequence design by conformational landscape optimization. Proc. Natl Acad. Sci. USA<\/i> 118<\/b>, e2017228118 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Anand, N. et al. Protein sequence design with a learned potential. Nat. Commun.<\/i> 13<\/b>, 746 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Federhen, S. The NCBI Taxonomy database. Nucleic Acids Res.<\/i> 40<\/b>, D136\u2013D143 (2012).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Pettit, L. D. The IUPAC stability constants database. Chem. Int.<\/i> 28<\/b>, 14\u201315 (2006).<\/p>\n

    CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ashburner, M. et al. Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat. Genet.<\/i> 25<\/b>, 25\u201329 (2000).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. J. Mach. Learn. Res.<\/i> 3<\/b>, 1137\u20131155 (2003).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Madani, A. et al. ProGen: language modeling for protein generation. Preprint at arXiv https:\/\/doi.org\/10.1101\/2020.03.07.982272<\/a> (2020).<\/p>\n<\/li>\n

  • \n

    Vig, J. et al. BERTology meets biology: Interpreting attention in protein language models. In International Conference on Learning Representations (ICLR, 2020).<\/p>\n<\/li>\n

  • \n

    Goyal, K., Dyer, C. & Berg-Kirkpatrick, T. Exposing the implicit energy networks behind masked language models via metropolis\u2013hastings. In 10th International Conference on Learning Representations<\/i> (ICLR, 2022).<\/p>\n<\/li>\n

  • \n

    Bhattacharya, N. et al. Single layers of attention suffice to predict protein contacts. Preprint at bioRxiv<\/i> https:\/\/doi.org\/10.1101\/2020.12.21.423882<\/a> (2020).<\/p>\n<\/li>\n

  • \n

    Ramsauer, H. et al. Hopfield Networks is All You Need. Preprint at arXiv<\/i> https:\/\/doi.org\/10.48550\/arXiv.2008.02217<\/a> (2020).<\/p>\n<\/li>\n

  • \n

    Alley, E., Khimulya, G., Biswas, S., AlQuraishi, M. & Church, G. M. Unified rational protein engineering with sequence-based deep representation learning. Nat. Methods<\/i> 16<\/b>, 1315\u20131322 (2019).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Rao, R. et al. Evaluating protein transfer learning with TAPE. Adv. Neural Inf. Process. Syst.<\/i> 32<\/b>, 9689\u20139701 (2019).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kingma, D. P. & Ba, J. Adam: a method for stochastic optimization. Preprint arXiv<\/i> https:\/\/doi.org\/10.48550\/arXiv.1412.6980<\/a> (2014).<\/p>\n<\/li>\n

  • \n

    Pascanu, R., Mikolov, T. & Bengio, Y. On the difficulty of training recurrent neural networks. In Proc. 30th International Conference on Machine Learning<\/i> (eds. Dasgupta, S. & McAllester, D.) 1310\u20131318 (PMLR, 2013).<\/p>\n<\/li>\n

  • \n

    Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res.<\/i> 15<\/b>, 1929\u20131958 (2014).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Holtzman, A., Buys, J., Du, L., Forbes, M. & Choi, Y. The curious case of neural text degeneration. In 8th International Conference on Learning Representations<\/i> (ICLR, 2020).<\/p>\n<\/li>\n

  • \n

    Goodfellow, I. J. et al. Generative adversarial networks. In 28th Conference on Neural Information Processing Systems<\/i> (NIPS, 2014).<\/p>\n<\/li>\n

  • \n

    Koehn, P. Pharaoh: a beam search decoder for phrase-based statistical machine translation models. in Machine Translation: From Real Users to Research<\/i> 115\u2013124 (Springer, 2004).<\/p>\n<\/li>\n

  • \n

    Sun, Z. Z. et al. Protocols for implementing an Escherichia coli<\/i> based TX-TL cell-free expression system for synthetic biology. J. Vis. Exp.<\/i> 16<\/b>, e50762 (2013).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kabsch, W. XDS. Acta Crystallogr. D Biol. Crystallogr.<\/i> 66<\/b>, 125\u2013132 (2010).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    McCoy, A. J. et al. Phaser crystallographic software. J. Appl. Crystallogr.<\/i> 40<\/b>, 658\u2013674 (2007).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kovalevskiy, O., Nicholls, R. A., Long, F., Carlon, A. & Murshudov, G. N. Overview of refinement procedures within REFMAC5: utilizing data from different sources. Acta Crystallogr D Struct. Biol.<\/i> 74<\/b>, 215\u2013227 (2018).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Terwilliger, T. C. et al. Iterative model building, structure refinement and density modification with the PHENIX AutoBuild wizard. Acta Crystallogr. D Biol. Crystallogr.<\/i> 64<\/b>, 61\u201369 (2008).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Hoh, S. W., Burnley, T. & Cowtan, K. Current approaches for automated model building into cryo-EM maps using Buccaneer with CCP-EM. Acta Crystallogr D Struct. Biol.<\/i> 76<\/b>, 531\u2013541 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Emsley, P., Lohkamp, B., Scott, W. G. & Cowtan, K. Features and development of Coot. Acta Crystallogr. D Biol. Crystallogr.<\/i> 66<\/b>, 486\u2013501 (2010).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Afonine, P. V. et al. Towards automated crystallographic structure refinement with phenix.refine. Acta Crystallogr. D Biol. Crystallogr.<\/i> 68<\/b>, 352\u2013367 (2012).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Raffel, C. et al. Exploring the limits of transfer learning with a unified text-to-text transformer. Preprint at arXiv<\/i> https:\/\/doi.org\/10.48550\/arXiv.1910.10683<\/a> (2019).<\/p>\n<\/li>\n

  • \n

    Studier, F. W. Protein production by auto-induction in high density shaking cultures. Protein Expr. Purif.<\/i> 41<\/b>, 207\u2013234 (2005).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Mirdita, M. et al. ColabFold: making protein folding accessible to all. Nat. Methods<\/i> 19<\/b>, 679\u2013682 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n     CAS<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n<\/div>\n

    Read More<\/a>
    \n Ali Madani<\/p>\n","protected":false},"excerpt":{"rendered":"

    Koga, N. et al. Principles for designing ideal protein structures. Nature 491, 222\u2013227 (2012).Article\u00a0 CAS\u00a0 Google Scholar\u00a0 Lin, Y.-R. et al. Control over overall shape and size in de novo designed proteins. Proc. Natl Acad. Sci. USA 112, E5478\u2013E5485 (2015).Article\u00a0 CAS\u00a0 Google Scholar\u00a0 Huang, P.-S., Boyken, S. E. & Baker, D. The coming of age<\/p>\n","protected":false},"author":1,"featured_media":601888,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4105,23997,536],"tags":[],"class_list":{"0":"post-601887","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-language","8":"category-large","9":"category-science-nature"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/601887","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=601887"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/601887\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/601888"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=601887"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=601887"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=601887"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}