Interpretable Machine Learning Models for Malicious Domains Detection Using Explainable Artificial Intelligence (XAI)

Abstract

With the expansion of the internet, a major threat has emerged involving the spread of malicious domains intended by attackers to perform illegal activities aiming to target governments, violating privacy of organizations, and even manipulating everyday users. Therefore, detecting these harmful domains is necessary to combat the growing network attacks. Machine Learning (ML) models have shown significant outcomes towards the detection of malicious domains. However, the “black box” nature of the complex ML models obstructs their wide-ranging acceptance in some of the fields. The emergence of Explainable Artificial Intelligence (XAI) has successfully incorporated the interpretability and explicability in the complex models. Furthermore, the post hoc XAI model has enabled the interpretability without affecting the performance of the models. This study aimed to propose an Explainable Artificial Intelligence (XAI) model to detect malicious domains on a recent dataset containing 45,000 samples of malicious and non-malicious domains. In the current study, initially several interpretable ML models, such as Decision Tree (DT) and Naïve Bayes (NB), and black box ensemble models, such as Random Forest (RF), Extreme Gradient Boosting (XGB), AdaBoost (AB), and Cat Boost (CB) algorithms, were implemented and found that XGB outperformed the other classifiers. Furthermore, the post hoc XAI global surrogate model (Shapley additive explanations) and local surrogate LIME were used to generate the explanation of the XGB prediction. Two sets of experiments were performed; initially the model was executed using a preprocessed dataset and later with selected features using the Sequential Forward Feature selection algorithm. The results demonstrate that ML algorithms were able to distinguish benign and malicious domains with overall accuracy ranging from 0.8479 to 0.9856. The ensemble classifier XGB achieved the highest result, with an AUC and accuracy of 0.9991 and 0.9856, respectively, before the feature selection algorithm, while there was an AUC of 0.999 and accuracy of 0.9818 after the feature selection algorithm. The proposed model outperformed the benchmark study.

A Proactive Attack Detection for Heating, Ventilation, and Air Conditioning (HVAC) System Using Explainable Extreme Gradient Boosting Model (XGBoost)

“…Recently, XAI has been used in various real-world applications such as healthcare, business, engineering and cybersecurity etc. [ 6 , 7 ]. However, to the authors knowledge, XAI has not been used in the HVAC system attack detection.…”

Explainable artificial intelligence envisioned security mechanism for cyber threat hunting

“…A thorough quantitative and qualitative analysis of various simulation of such schemes were provided. Aslam et al 4 again used XAI in the domain of security by working up on black box ensemble models and ML models like decision trees, which was further interpreted using explainable. Then through a feature selection algorithm, the accuracy of the model was improved.…”

“…Therefore, we need some cyber security mechanisms to detect and mitigate potential cyber threats and attacks. The techniques under cyber threat hunting perform searching over the networks, connected devices, and servers to hunt the malicious and risky activities, which have evaded the detection process 3,4 …”

“…The techniques under cyber threat hunting perform searching over the networks, connected devices, and servers to hunt the malicious and risky activities, which have evaded the detection process. 3,4 There is a discrepancy between the effectiveness of current security measures and their capacity to identify new threats (ie, zero-day attacks). Threats can be discovered and mitigated using antivirus software and other forms of endpoint detection and response (EDR).…”

Explainable Deep-Learning-Based Depression Modeling of Elderly Community after COVID-19 Pandemic

“…Artificial intelligence (AI) algorithms are frequently viewed as mysterious black boxes that make illogical choices. The idea that a machine-learning model and its output can be explained in a way that "makes sense" to a human being at an acceptable level is known as explainability (also called "interpretability") [10]. While they may be less effective, some classes of algorithms, such as more conventional machine-learning algorithms, tend to be easier to understand.…”