Heterogeneous Ensemble Deep Learning Model for Enhanced Arabic Sentiment Analysis

Abstract

Sentiment analysis was nominated as a hot research topic a decade ago for its increasing importance in analyzing the people’s opinions extracted from social media platforms. Although the Arabic language has a significant share of the content shared across social media platforms, its content’s sentiment analysis is still limited due to its complex morphological structures and the varieties of dialects. Traditional machine learning and deep neural algorithms have been used in a variety of studies to predict sentiment analysis. Therefore, a need of changing current mechanisms is required to increase the accuracy of sentiment analysis prediction. This paper proposed an optimized heterogeneous stacking ensemble model for enhancing the performance of Arabic sentiment analysis. The proposed model combines three different of pre-trained Deep Learning (DL) models: Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU) in conjunction with three meta-learners Logistic Regression (LR), Random Forest (RF), and Support Vector Machine (SVM) in order to enhance model’s performance for predicting Arabic sentiment analysis. The performance of the proposed model with RNN, LSTM, GRU, and the five regular ML techniques: Decision Tree (DT), LR, K-Nearest Neighbor (KNN), RF, and Naive Bayes (NB) are compared using three benchmarks Arabic dataset. Parameters of Machine Learning (ML) and DL are optimized using Grid search and KerasTuner, respectively. Accuracy, precision, recall, and f1-score were applied to evaluate the performance of the models and validate the results. The results show that the proposed ensemble model has achieved the best performance for each dataset compared with other models.

Polycystic Ovary Syndrome Detection Machine Learning Model Based on Optimized Feature Selection and Explainable Artificial Intelligence

“…The ensemble model builds on combining decisions from several models to improve the model’s overall performance. This approach enhances performance over a single model [ 46 , 47 ]. Bagging, boosting, and staking are the most popular ensemble techniques.…”

Arabic Sentiment Analysis of Eateries’ Reviews Using Deep Learning

“…Saleh et al [18] developed an ensemble approach for Arabic sentiment analysis using three DL models, LSTM, RNN, and Gated Recurrent Units (GRU), along with three traditional ML algorithms (RF, LR, and SVM). Among various DL models, LSTM got the best accuracy of 0.919 on the Arabic Sentiment Twitter Corpus (ASTC), consisting of 56,795 Arabic tweets collected in April 2019.…”

A Novel Hybrid Sentiment Analysis Classification Approach for Mobile Applications Arabic Slang Reviews

“…a) Fifth phase: Hybrid supervised classification approach phase: This phase performs two subsections: the first issue is applying ML approach which performs five selected ML classifiers which utilized extensively for ASA: Logistic Regression (LR) [25] [26] [27] [28], Naïve Bayes (NB) [29] [30] [31] [32], K-Nearest Neighbors (KNN) [33] [34] [31] [35], Random Forest (RF) [36] [37] [38] and SVM [33] [39] [40] in addition applying DL approach which performs DL classifier Multi-Layer Perceptron Neural Network (MLP-NN) which applied in [36] [37] for ASA.…”