A Novel Hybrid Deep Learning Model for Sentiment Classification

Abstract

A massive use of social media platforms such as Twitter and Facebook by omnifarious organizations has increased the critical individual feedback on the situation, events, products, and services. However, sentiment classification plays an important role in the user's feedback evaluation. At present, deep learning such as long short-term memory (LSTM), gated recurrent unit (GRU), bidirectionally long short-term memory (BiLSTM) or convolutional neural network (CNN) are prevalently preferred in sentiment classification. Moreover, word embedding such as Word2Vec and FastText is closely examined in text for mapping closely related to the vectors of real numbers. However, both deep learning and word embedding methods have strengths and weaknesses. Combining the strengths of the deep learning models with that of word embedding is the key to high-performance sentiment classification in the field of natural language processing (NLP). In the present study, we propose a novel hybrid deep learning model that strategically combines different word embedding (Word2Vec, FastText, character-level embedding) with different deep learning methods (LSTM, GRU, BiLSTM, CNN). The proposed model extracts features of different deep learning methods of word embedding, combines these features and classifies texts in terms of sentiment. To verify the performance of the proposed model, several deep learning models called basic models were created to perform series of experiments. By comparing, the performance of the proposed model with that of past studies, the proposed model offers better sentiment classification performance. INDEX TERMS Sentiment classification, Turkish tweets analysis, hybrid model, word embedding, deep learning, LSTM, CNN.

Hybrid Feature Fusion Learning Towards Chinese Chemical Literature Word Segmentation

“…In addition to Salur,M.U. [30] combining the advantages of deep learning models with the advantages of word embedding, AU Rehman et al [31] also proposed the Hybrid CNN-LSTM model to be applied to sentiment classification, which is significant in accuracy, recall rate and f-score. These methods rely heavily on the extraction of word embedding features, Xuezhe Ma et al [32] proposed the BiLSTM-CNN-CRF model, which uses CNN to model each letter of each word itself.…”

Understanding the Applications of Natural Language Processing on COVID-19 Data

“…Algorithms like Convolutional Neural Network (CNN), Gated recurrent units (GRU), Long Short-Term Memory (LSTM), and Bi-Directional LSTM (Bi-LSTM) have been used for text recognition or other such tasks. Some models use features of different deep learning implementations in conjunction with word embedding to classify texts in terms of sentiment [7]. Classification through sentiment analysis is a relatively new area of approach, where NLP has been used for recognition of similar sentiments.…”

“…Ref. [7], [9], [11] illustrate how to use NLP and classification techniques on languages other than English.…”

Sentiment Analysis Method of Network Text Based on Improved AT-BiGRU Model

“…e third method is based on deep learning [8][9][10][11]. is type of deep neural network-based model has achieved better results than traditional classifiers in the field of sentiment analysis.…”