Research on Parallelization of Microblog Emotional Analysis Algorithms Using Deep Learning and Attention Model Based on Spark Platform

Abstract

Emotional analysis of microblog can discover that the public's attitude towards hot events can grasp the network public opinion, so it has become a hot research topic in text mining. In view of the current situation that most of the existing affective analysis methods separate the deep learning model from the emotional symbols, this paper proposes a microblog affective analysis method based on dual attention model. This method uses Word2Vec tool to express microblog platform and build emotional dictionary; uses deep belief network and attention model to construct microblog emotional classification model; and trains the emotional classification model based on the constructed semantic representation. By combining attention model with emotional symbols, this method effectively enhances the ability of capturing emotional semantics of microblog text and improves the performance of microblog emotional classification. Based on Spark cluster, the deep confidence neural network is processed in parallel. The experimental results show that the model achieves the best results in three indicators. The recall and precision of the model are more than 0.04 higher than the traditional shallow learning method. INDEX TERMS Emotional analysis algorithms, deep learning, deep belief network (DBN), spark parallelization, text mining.

Sentiment Analysis in Social Media Data for Depression Detection Using Artificial Intelligence: A Review

“…Deep Belief Network: A generative graphical model [40,45] of deep neural network, composed of multiple layers of latent variables [51] with connections between the layers but not between units within each layer. They are used to recognize, cluster and generate images, video sequences and motion-capture data.…”

Microblog User Emotion Analysis Method Based on Improved Hierarchical Attention Mechanism and BiLSTM

“…However, this method has a small scope of application, has certain limitations, and does not give a general emotion analysis method. Reference [ 18 ] used the Word2Vec tool to construct an emotion dictionary. On this basis, through a Deep Belief Network and attention model, it constructed and trained the Sina Microblog emotion classification model and proposed a Sina Microblog emotion analysis method based on the dual attention model.…”

A General Framework to Understand Vulnerabilities in Information Systems

“…In an empirical analysis of social media and news articles, Yang et al [29] proposed a language model-based topic clustering framework to analyze news articles. Shi [30] studied emotional analysis using a deep confidence neural network and a dual attentional model. The experimental results showed that the proposed model achieved the best results among the considered alternatives.…”

“…Features are extracted from three dimensions: TD-IDF with bigrams, key topics, and record-level statistics, as discussed in detail in Section IV. We conduct experiments for different topic numbers (10,20,30,40, and 50) in this research. We present the classification and prediction results when the topic number is 30 for the following reasons: (1) The classification and prediction performance are similar for different topic numbers.…”