Performance Assessment of Supervised Classifiers for Designing Intrusion Detection Systems: A Comprehensive Review and Recommendations for Future Research

Abstract

Supervised learning and pattern recognition is a crucial area of research in information retrieval, knowledge engineering, image processing, medical imaging, and intrusion detection. Numerous algorithms have been designed to address such complex application domains. Despite an enormous array of supervised classifiers, researchers are yet to recognize a robust classification mechanism that accurately and quickly classifies the target dataset, especially in the field of intrusion detection systems (IDSs). Most of the existing literature considers the accuracy and false-positive rate for assessing the performance of classification algorithms. The absence of other performance measures, such as model build time, misclassification rate, and precision, should be considered the main limitation for classifier performance evaluation. This paper’s main contribution is to analyze the current literature status in the field of network intrusion detection, highlighting the number of classifiers used, dataset size, performance outputs, inferences, and research gaps. Therefore, fifty-four state-of-the-art classifiers of various different groups, i.e., Bayes, functions, lazy, rule-based, and decision tree, have been analyzed and explored in detail, considering the sixteen most popular performance measures. This research work aims to recognize a robust classifier, which is suitable for consideration as the base learner, while designing a host-based or network-based intrusion detection system. The NSLKDD, ISCXIDS2012, and CICIDS2017 datasets have been used for training and testing purposes. Furthermore, a widespread decision-making algorithm, referred to as Techniques for Order Preference by Similarity to the Ideal Solution (TOPSIS), allocated ranks to the classifiers based on observed performance reading on the concern datasets. The J48Consolidated provided the highest accuracy of 99.868%, a misclassification rate of 0.1319%, and a Kappa value of 0.998. Therefore, this classifier has been proposed as the ideal classifier for designing IDSs.

Blockchain Technology for Secured Healthcare Data Communication among the Non-Terminal Nodes in IoT Architecture in 5G Network

“…Various approaches are mechanized in the secured communication of the healthcare-related data among the devices, Virtual (private VPN), that shields the data transferred over the channels by anonymizing the metadata associated with the information exchanged among the nodes through anonymous tunneling. Many standardized approaches are using the symmetric key and asymmetric vital cryptosystems, and a majority of those algorithms would replace the plain text into ciphertext data that is not understandable that is done by performing substitution and arithmetic operations over the plain text, and different mechanisms are used in identifying such anomalous activities [26,27].…”

Performance Evaluation of Regression Models for the Prediction of the COVID-19 Reproduction Rate

“…The authors used the generation interval, defined as the time needed for an infected person to infect another person and for reproduction rate estimation. The works by Zhang et al ( 35 ) and by Srinivasu et al ( 36 ), Panigrahi et al ( 37 , 38 ), Tamang ( 39 ), Chowdhary et al ( 40 ), and Gaur et al ( 41 ) demonstrated the efficacy of machine learning algorithms in various fields.…”

Explainable Artificial Intelligence Based Framework for Non-Communicable Diseases Prediction

“…However, decisionmaking responses suffer from various problems. To deal with these problems, advanced data-driven and machine learning approaches have been regularly developed in recent researches [7][8][9][10][11][12][13]. Furthermore, many systems cannot handle high dimensional datasets and select significant features to compute a general weight for them based on their significance due to the lack of a smart framework [7][8][9].…”

“…Therefore, most of the existing literature considered the accuracy and false-positive rate for assessing the performance of classification algorithms. The absence of other performance measures, such as model build time, misclassification rate, and precision, should be considered the major limitation for classifier performance evaluation [10].…”