Semi-supervised learning of Hidden Markov Models for biological sequence analysis

Abstract

Motivation Hidden Markov Models (HMMs) are probabilistic models widely used in applications in computational sequence analysis. HMMs are basically unsupervised models. However, in the most important applications, they are trained in a supervised manner. Training examples accompanied by labels corresponding to different classes are given as input and the set of parameters that maximize the joint probability of sequences and labels is estimated. A main problem with this approach is that, in the majority of the cases, labels are hard to find and thus the amount of training data is limited. On the other hand, there are plenty of unclassified (unlabeled) sequences deposited in the public databases that could potentially contribute to the training procedure. This approach is called semi-supervised learning and could be very helpful in many applications. Results We propose here, a method for semi-supervised learning of HMMs that can incorporate labeled, unlabeled and partially labeled data in a straightforward manner. The algorithm is based on a variant of the Expectation-Maximization (EM) algorithm, where the missing labels of the unlabeled or partially labeled data are considered as the missing data. We apply the algorithm to several biological problems, namely, for the prediction of transmembrane protein topology for alpha-helical and beta-barrel membrane proteins and for the prediction of archaeal signal peptides. The results are very promising, since the algorithms presented here can significantly improve the prediction performance of even the top-scoring classifiers. Supplementary information Supplementary data are available at Bioinformatics online.

JUCHMME: a Java Utility for Class Hidden Markov Models and Extensions for biological sequence analysis

“…Additionally, to overcome HMM limitations, a number of extensions have been developed such as Hidden Neural Networks (HNNs) (Krogh and Riis, 1999), models that condition on previous observations ( Tamposis et al, 2018) and a newly developed method for semi-supervised learning of HMMs that can incorporate labeled, unlabeled and partially labeled data (Tamposis et al, 2019).…”

Hidden Markov Models to Estimate the Probability of Having Autistic Children

“…These methods may involve, for example, techniques such as Bayesian Networks and Markovian Models. HMMs have been applied in different areas of AI, such as Computer Vision [27], Robotics [28], Speech and Face Recognition [29], [30], and Computational Biology [31].…”

StackPDB: Predicting DNA-binding proteins based on XGB-RFE feature optimization and stacked ensemble classifier

“…Appropriate classification algorithms can efficiently shorten the running time and learn the relationship between tags and categories. Some machine learning methods are commonly used, such as K Nearest Neighbor (KNN) [19], Neural Network [20], Naï ve Bayes [21], Hidden Markov Model [22], Gradient Boosting Decision Tree (GBDT) [23], Support Vector Machine (SVM) [24] and (RF) [25] and etc. Ali et al [26] proposed the DP-BINDER model.…”