An Accurate Algorithm for Generating a Music Playlist based on Facial Expressions

Abstract

Manual segregation of a playlist and annotation of songs, in accordance with the current emotional state of a user, is labor intensive and time consuming. Numerous algorithms have been proposed to automate this process. However the existing algorithms are slow, increase the overall cost of the system by using additional hardware (e.g. EEG systems and sensors) and have less accuracy. This paper presents an algorithm that automates the process of generating an audio playlist, based on the facial expressions of a user, for rendering salvage of time and labor, invested in performing the process manually. The algorithm proposed in this paper aspires to reduce the overall computational time and the cost of the designed system. It also aims at increasing the accuracy of the designed system. The facial expression recognition module of the proposed algorithm is validated by testing the system against user dependent and user independent dataset. Experimental results indicate that the user dependent results give 100% accuracy, while user independent results for joy and surprise are 100 %, but for sad, anger and fear are 84.3 %, 80 % and is 66% respectively. The overall accuracy of the emotion recognition algorithm, for user independent dataset is 86%. In audio, 100 % recognition rates are obtained for sad, sad-anger and joy-anger but for joy and anger, recognition rates obtained are 95.4% and 90 % respectively. The overall accuracy of the audio emotion recognition algorithm is 98%. Implementation and testing of the proposed algorithm is carried out using an inbuilt camera. Hence, the proposed algorithm reduces the overall cost of the system successfully. Also, on average, the proposed algorithm takes 1.10 sec to generate a playlist based on facial expression. Thus, it yields better performance, in terms of computational time, as compared to the algorithms in the existing literature.

Music, Computing, and Health: A Roadmap for the Current and Future Roles of Music Technology for Health Care and Well-Being

“…For instance, Hirve et al (2016)’s system, which was trained on a large database of digital recordings for biomedical research, recommends music based on the emotion predicted through a face detection model. A similar system by Dureha (2014) creates both mood-uplifting as well as mood-stabilizing playlists. Music recommendation for therapeutic purposes can extend beyond mood mediation, however.…”

Cascade Regression-Based Face Frontalization for Dynamic Facial Expression Analysis

“…Facial expression recognition (FER) has a wide range of applications including human-computer interaction (HCI) [38,6], animation [1,36,21] and security [24]. Healthcare is one of the most important applications of FER.…”

A Review on Facial Emotion Recognition and Classification Analysis with Deep Learning

“…However, FER (Fasel & Luettin, 2003)is still a challenging research area in various applications related to computer vision. but undoubtedly the application includes FER 154 for security (butalia, et al, 2012), FER for mindset identification (Mandal, et al, 1998), FER for psychology aid, crime detection (polikovsky, et al, 2009), Intelligent Tutoring System (Kumari, et al, 2015), Driver Fatigue Detection (Zhang & Zhang, 2006), Music based on Mood analysis (Dureha, 2014). Emotion refers to the internal feelings of human, through which they communicate their emotional states and intentions.…”