TagTag: A Novel Framework for Service Tags Recommendation and Missing Tag Prediction

Chen, Wentao; Liu, Mingyi; Tu, Zhiying; Wang, Zhongjie

doi:10.1007/978-3-031-20984-0_24

Cited by 2 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Nonetheless, several deep learning frameworks for stability predictions have been published and they can be broadly categorized by their input type: sequence or structure. The current structure frameworks include DeepDDG [29], ThermoNet [28], ProSGNN [30] , and AC-DNN [27] and sequence frameworks include Prostata [26] and HotProteins [73]. While both structure and sequence frameworks are competitive with current state-of-the-art methods, the two types have their own benefits and limitations.…”

Section: Overview Of Deep Learning For Stability Predictionmentioning

confidence: 99%

Stability Oracle: A Structure-Based Graph-Transformer for Identifying Stabilizing Mutations

Diaz

Gong

Ouyang-Zhang

et al. 2023

Preprint

View full text Add to dashboard Cite

Stabilizing proteins is a fundamental challenge in protein engineering and is almost always a prerequisite for the development of industrial and pharmaceutical biotechnologies. Here we present Stability Oracle: a structure-based graph-transformer framework that achieves state of the art performance on predicting the effect of a point mutation on a protein's thermodynamic stability ∆∆G). A strength of our model is its ability to identify stabilizing mutations, which often make up a small fraction of a protein's mutational landscape. Our framework introduces several data and machine learning innovations to overcome well-known challenges in data scarcity and bias, generalization, and computation time. Stability Oracle is first pre-trained on over 2M masked microenvironments and then fine-tuned using a novel data augmentation technique, Thermodynamic Permutations (TP), applied to an ~120K curated subset of the mega-scale cDNA display proteolysis dataset. This technique increases the original 120K mutations to over 2M thermodynamically valid ∆∆G measurements to generate the first structure training set that samples and balances all 380 mutation types. By using the masked microenvironment paradigm, Stability Oracle does not require a second mutant structure and instead uses amino acid structural embeddings to represent a mutation. This architectural design accelerates training and inference times: we can both train on 2M instances with just 119 structures and generate deep mutational scan (DMS) predictions from only the wildtype structure. We benchmark Stability Oracle with both experimental and alphafold structures of all proteins on T2837, a test set that aggregates the common test sets (SSym, S669, p53, and Myoglobin) with all additional experimental data from proteins with over a 30% sequence similarity overlap. We used TP augmented T2837 to evaluate performance for protein engineering: Stability-Oracle correctly identifies 48% of stabilizing mutations (∆∆G < -0.5 kcal/mol) and 74% of its stabilizing predictions are indeed stabilizing (18% and 8% of predictions were neutral and destabilizing, respectively). For a fair comparison between sequence and structure-based fine-tuned deep learning models, we build on the Prostata framework and fine-tune the sequence embeddings of ESM2 on our training set (Prostata-IFML). A head-to-head comparison demonstrates that Stability-Oracle outperforms Prostata-IFML on regression and classification even though the model is 548 times smaller and is pretrained with 4000 times fewer proteins, highlighting the advantages of learning from structures.

show abstract