Ant Colony Optimization Algorithm for Interpretable Bayesian Classifiers Combination: Application to Medical Predictions

Abstract

Prediction and classification techniques have been well studied by machine learning researchers and developed for several real-word problems. However, the level of acceptance and success of prediction models are still below expectation due to some difficulties such as the low performance of prediction models when they are applied in different environments. Such a problem has been addressed by many researchers, mainly from the machine learning community. A second problem, principally raised by model users in different communities, such as managers, economists, engineers, biologists, and medical practitioners, etc., is the prediction models’ interpretability. The latter is the ability of a model to explain its predictions and exhibit the causality relationships between the inputs and the outputs. In the case of classification, a successful way to alleviate the low performance is to use ensemble classiers. It is an intuitive strategy to activate collaboration between different classifiers towards a better performance than individual classier. Unfortunately, ensemble classifiers method do not take into account the interpretability of the final classification outcome. It even worsens the original interpretability of the individual classifiers. In this paper we propose a novel implementation of classifiers combination approach that does not only promote the overall performance but also preserves the interpretability of the resulting model. We propose a solution based on Ant Colony Optimization and tailored for the case of Bayesian classifiers. We validate our proposed solution with case studies from medical domain namely, heart disease and Cardiotography-based predictions, problems where interpretability is critical to make appropriate clinical decisions.AvailabilityThe datasets, Prediction Models and software tool together with supplementary materials are available at http://faculty.uaeu.ac.ae/salahb/ACO4BC.htm.

A Novel Model for Classification of Parkinson’s Disease: Accurately Identifying Patients for Surgical Therapy

“…• Classification: Classification involves identifying profiles of classes in terms of their attributes and determines which of the predefined classes a new item belongs. For example, given particular classes of patients with different medical treatment responses, the classification is used to identify the form of treatment to which a new patient is most likely to respond [13,14].…”

ICU Patient Deterioration Prediction : A Data-Mining Approach

“…Classification is a pattern-recognition task that has applications in a broad range of fields. It requires the construction of a model that approximates the relationship between input features and output categories [8]. Some of the most popular techniques are discussed here in brief, all of which are used in our work.…”

Examining The Effect of Feature Selection on Improving Patient Deterioration Prediction

“…Data mining is the analysis step of knowledge discovery. It is about the 'extraction of interesting (non-trivial, implicit, previously unknown, and potentially useful) patterns or knowledge from huge amount of data [10]'. When mining massive datasets, two of the most common, important and immediate problems are sampling and feature selection.…”

“…Classification is a pattern-recognition task that has applications in a broad range of fields. It requires the construction of a model that approximates the relationship between input features and output categories [10]. Some of the most popular techniques are discussed here in brief, all of which are used in our work.…”