Long Short-Term Memory-Based Music Analysis System for Music Therapy

Abstract

Music can express people’s thoughts and emotions. Music therapy is to stimulate and hypnotize the human brain by using various forms of music activities, such as listening, singing, playing and rhythm. With the empowerment of artificial intelligence, music therapy technology has made innovative development in the whole process of “diagnosis, treatment and evaluation.” It is necessary to make use of the advantages of artificial intelligence technology to innovate music therapy methods, ensure the accuracy of treatment schemes, and provide more paths for the development of the medical field. This paper proposes an long short-term memory (LSTM)-based generation and classification algorithm for multi-voice music data. A Multi-Voice Music Generation system called MVMG based on the algorithm is developed. MVMG contains two main steps. At first, the music data are modeled to the MDPI and text sequence data by using an autoencoder model, including music features extraction and music clip representation. And then an LSTM-based music generation and classification model is developed for generating and analyzing music in specific treatment scenario. MVMG is evaluated based on the datasets collected by us: the single-melody MIDI files and the Chinese classical music dataset. The experiment shows that the highest accuracy of the autoencoder-based feature extractor can achieve 95.3%. And the average F1-score of LSTM is 95.68%, which is much higher than the DNN-based classification model.

Multimodal Co-Ranking of Music Sentiment Analysis with the Deep Learning Model

“…Researchers have explored various methodologies, including convolutional neural networks (CNNs) and recurrent neural networks (RNNs), to capture both the temporal dynamics and spectral characteristics of piano music [13]. By training these algorithms on large datasets of annotated piano performances spanning a wide range of emotions, researchers aim to teach the models to accurately classify and predict the sentiment conveyed in the music [14]. Additionally, some studies have integrated multimodal approaches, incorporating both audio and visual features extracted from video recordings of piano performances to enhance the accuracy of sentiment analysis.…”

“…offering insights into innovative pedagogical approaches Li et al (2022). developed a long short-term memorybased music analysis system for music therapy, highlighting the potential of deep learning in therapeutic applications of music Modran et al (2023).…”