Optimality Assessments of Classifiers on Single and Multi-labelled Obstetrics Outcome Classification Problems

Abstract

It is indisputable that clinicians cannot exactly state the outcome of pregnancies through conventional knowledge and methods even as the surge in human knowledge continues. Hence, several computational techniques have been adapted for precise pregnancy outcome (PO) prediction. Obstetric datasets for PO determination exist as single label learning (SLL), multi-label learning (MLL) and multi-target (MTP) problems. There is however no single classifier recommended to optimally satisfy the needs of all the classification types. This work therefore identifies six widely used PO classifiers and investigates their performances in all three classification categories; to find the best performing classifier. Obstetric dataset exposed to input rank analysis via Principal component Analysis, produced thirteen (13) significant features for the experiment. Accuracy, F1-measure and build/test time were used as evaluation metrics. Decision tree (DT) had an average accuracy and F1 score of 89.23% and 88.23% respectively, with 1.0 average rank. Under MLL configuration, average accuracy (91.71%) and F1 score (94.28%) were highest in the random forest (RF) which had a 1.0 average test time rank. Using MTP, DT had an average accuracy of 88.80% and average F1 score of 71.13%, the multi-layered perceptron (MLP) had the best time cost with an average rank value of 2.0. From the results, RF is most optimal in terms of accuracy and average rank value, while DT is the most efficient in terms of time cost. The comparative analysis of global averages of the six base classifiers shows that RF is the most optimal algorithm with an average accuracy of 87.3% given all three data setups in the study. MLP on the other hand had an unexpectedly high time cost, making it unsuitable for similar data classifications if time is the main criterion. It is recommended that the choice of the classifier should either be RF or DT depending on the application domain and whether or not time cost is a major consideration.

Homogenous Multiple Classifier System for Software Quality Assessment Based on Support Vector Machine

“…A statistical test for significant difference, at a 95% confidence level, between the mean performances of kernels across product metric levels, yielded (df=5, f=6.02, p=0.001) depicting a statistically significant difference while insignificantly different values are obtained from SVM datasets (df=4, f=2.49, p=0.076). Turkey's post hoc test (Inyang et al, 2021) confirms the Fine Gaussian kernel (mean=75.0%) as producing statistically significantly different performances. This means all kernels except Fine Gaussian produce performances that do not differ significantly and are candidates for better performances.…”