Clustering-Based Emotion Recognition Micro-Service Cloud Framework for Mobile Computing

Abstract

In a situation where life becomes more stressful and challenging, people feel compelled to be more concerned about their mental situation. Different emotional statuses are external reactions to different mental states. Therefore, researchers always identify people's mental situation by monitoring their real-time emotions. At the same time, due to the availability of built-in sensors in a smartphone, applications that can identify real-time emotions of mobile users are constantly emerging. However, compared to most emotion recognition algorithms, computing resources and battery life in mobile phones are always limited. This makes accuracy and latency of these applications are unsatisfactory. In this paper, we propose a micro-service platform for mobile emotion recognition application developers (MSPMERAD) which can supply high performance. First, a classifier fusion emotion recognition algorithm is proposed by using a dynamic adaptive fusion strategy. Second, this new algorithm is encapsulated into a micro-service. With other affiliated microservices such as data uploading, preprocessing, etc., developers can ignore the implementation of the emotion recognition algorithm and just focus on how to collect sensor data and interact with users. The accuracy and latency of one application based on the MSPMERAD are compared with another application that is implemented using a locale emotion recognition algorithm. Experiments based on the daily behavior data of 50 student volunteers show that the application based on our platform has higher recognition accuracy with a more reasonable time.

A Management Specification for Data Sharing Security in the System Construction of Smart Mine

“…However, the problem of transferring huge amounts of data created by end devices has become an important issue that must be addressed. Edge computing is currently a very representative solution for reducing the Internet of Tings data transmission delay [5][6][7][8]. In the studies of [9,10], techniques for work assignment in edge computing systems are proposed.…”

Affective State Prediction from Smartphone Touch and Sensor Data in the Wild

“…They predicted two levels of valence and arousal during browsing activities and chatting. Wang et al [68] predicted five levels of valence and arousal. They fused neural network and decision tree classifiers and based their models on data from the accelerometer, gyroscope, GPS (i.e., entropy), light sensor (i.e., indoor vs. outdoor), and network speed.…”

A Review of Emotion Recognition Methods Based on Data Acquired via Smartphone Sensors

“…The amounts of training data together with the computational complexity of model training algorithms make the training on a phone infeasible [78]. Therefore, the models are usually trained on a server and then sent back to the phone, where they may be used for prediction [60][61][62]66,67,72,77,79,80]. In [58], not only the training but also the inference is performed on the server and only the daily mood is sent back to the user.…”

“…In experiments presented in [68], some statistics were calculated on the basis of raw values and also changes in aggregated rotation were taken into account. In [80,112], rotation time and average angular velocity were extracted.…”