Leveraging transformers‐based language models in proteome bioinformatics

Abstract

In recent years, the rapid growth of biological data has increased interest in using bioinformatics to analyze and interpret this data. Proteomics, which studies the structure, function, and interactions of proteins, is a crucial area of bioinformatics. Using natural language processing (NLP) techniques in proteomics is an emerging field that combines machine learning and text mining to analyze biological data. Recently, transformer‐based NLP models have gained significant attention for their ability to process variable‐length input sequences in parallel, using self‐attention mechanisms to capture long‐range dependencies. In this review paper, we discuss the recent advancements in transformer‐based NLP models in proteome bioinformatics and examine their advantages, limitations, and potential applications to improve the accuracy and efficiency of various tasks. Additionally, we highlight the challenges and future directions of using these models in proteome bioinformatics research. Overall, this review provides valuable insights into the potential of transformer‐based NLP models to revolutionize proteome bioinformatics.

Expectation management in AI: A framework for understanding stakeholder trust and acceptance of artificial intelligence systems

“…Using a framework such as this has the potential to obviate unnecessary large investments in systems that will be poorly received. Instead of point-of-care systems, artificial intelligence has greater potential to help the field of medicine with analyzing large datasets in research settings [ [105] , [106] , [107] ].…”

Deep Learning and Neural Networks: Decision-Making Implications

“…Another recent development in deep learning is the construction of GPT, a large neural network that can generate natural language writings on a variety of topics and assignments. GPT, or Generative Pretrained Transformer, is based on the transformer architecture, which discovers the relationships between words and sentences through attention processes [111]. GPT can provide diverse and pertinent information and recommendations to decisionmakers, which has a substantial impact on decision making.…”

Bioinfo-Bench: A Simple Benchmark Framework for LLM Bioinformatics Skills Evaluation

“…[27,6,19] Numerous studies have explored various aspects not only from the perspective of computer science like medical text analysis [16, ? ], public health data mining [25] and GNN benchmarking [14] but also biological and medical like KVPLM [26], DNA-Pretrain [18], proteome analysis [15,20,11], and peptide property prediction [10] within the realm of bioinformatics. Nevertheless, the perspective of LLMs has predominantly focused on handling medical texts, making it challenging for generative artificial intelligence to find suitable entry points and engage effectively.…”