An Optimal Big Data Analytics with Concept Drift Detection on High-Dimensional Streaming Data

Abstract

Big data streams started becoming ubiquitous in recent years, thanks to rapid generation of massive volumes of data by different applications. It is challenging to apply existing data mining tools and techniques directly in these big data streams. At the same time, streaming data from several applications results in two major problems such as class imbalance and concept drift. The current research paper presents a new Multi-Objective Metaheuristic Optimization-based Big Data Analytics with Concept Drift Detection (MOMBD-CDD) method on High-Dimensional Streaming Data. The presented MOMBD-CDD model has different operational stages such as pre-processing, CDD, and classification. MOMBD-CDD model overcomes class imbalance problem by Synthetic Minority Over-sampling Technique (SMOTE).In order to determine the oversampling rates and neighboring point values of SMOTE, Glowworm Swarm Optimization (GSO) algorithm is employed. Besides, Statistical Test of Equal Proportions (STEPD), a CDD technique is also utilized. Finally, Bidirectional Long Short-Term Memory (Bi-LSTM) model is applied for classification. In order to improve classification performance and to compute the optimum parameters for Bi-LSTM model, GSO-based hyperparameter tuning process is carried out. The performance of the presented model was evaluated using high dimensional benchmark streaming datasets namely intrusion detection (NSL KDDCup) dataset and ECUE spam dataset. An extensive experimental validation process confirmed the effective outcome of MOMBD-CDD model. The proposed model attained high accuracy of 97.45% and 94.23% on the applied KDDCup99 Dataset and ECUE Spam datasets respectively.

Disaster Monitoring of Satellite Image Processing Using Progressive Image Classification

“…Though, since these satellites are over a few minutes late, they mayn't have enough time to send all of their observations to a Low Earth Orbit (LEO) satellite's ground station [20]. Many recent approaches have presented feature extraction processes based on deep learning, which are used in this paper [21][22][23][24][25][26][27][28][29][30][31][32][33][34]. Two thin covers detect the coarse resolution of images acquired at different times with land changes, and the excellent spatial and temporal resolution of the image resolution change identifies new super-resolution methods [35].…”

Empirical Study on Classifiers for Earlier Prediction of COVID-19 Infection Cure and Death Rate in the Indian States

“…The techniques like deep reinforcement learning are employed in areas like anomaly detection that combine reinforcement learning and deep learning, which enables artificial agents to learn knowledge and experience actual data directly [ 55 ]. Further, big data analytical techniques are becoming ubiquitous for achieving optimized results and improving classification performances [ 56 ]. The works and techniques followed by the different authors in the related works are summarized in Table 1 .…”

Comprehensive Analysis of IoT Malware Evasion Techniques

“…Malware evasion methods were analyzed, while classifications for automated and manual analysis were presented. The summarized advantages and limitations can be used by researchers to improve the efficiency of IoT malware detection systems [54][55][56][57]. The evasion attempts can be categorized as detection independent and detection dependent.…”