Automatic Assessment of Aphasic Speech Sensed by Audio Sensors for Classification into Aphasia Severity Levels to Recommend Speech Therapies

Abstract

Aphasia is a type of speech disorder that can cause speech defects in a person. Identifying the severity level of the aphasia patient is critical for the rehabilitation process. In this research, we identify ten aphasia severity levels motivated by specific speech therapies based on the presence or absence of identified characteristics in aphasic speech in order to give more specific treatment to the patient. In the aphasia severity level classification process, we experiment on different speech feature extraction techniques, lengths of input audio samples, and machine learning classifiers toward classification performance. Aphasic speech is required to be sensed by an audio sensor and then recorded and divided into audio frames and passed through an audio feature extractor before feeding into the machine learning classifier. According to the results, the mel frequency cepstral coefficient (MFCC) is the most suitable audio feature extraction method for the aphasic speech level classification process, as it outperformed the classification performance of all mel-spectrogram, chroma, and zero crossing rates by a large margin. Furthermore, the classification performance is higher when 20 s audio samples are used compared with 10 s chunks, even though the performance gap is narrow. Finally, the deep neural network approach resulted in the best classification performance, which was slightly better than both K-nearest neighbor (KNN) and random forest classifiers, and it was significantly better than decision tree algorithms. Therefore, the study shows that aphasia level classification can be completed with accuracy, precision, recall, and F1-score values of 0.99 using MFCC for 20 s audio samples using the deep neural network approach in order to recommend corresponding speech therapy for the identified level. A web application was developed for English-speaking aphasia patients to self-diagnose the severity level and engage in speech therapies.

A Comprehensive Survey on Knowledge-Defined Networking

“…Supervised Learning Approaches for Generating Knowledge Deep Neural Networks (DNN) An Artificial Neural Network (ANN) is a collection of node layers, comprising an input layer, an output layer, and optional one or more hidden layers in which each node (neuron) is associated with a weight and a threshold value [98]. A Deep Neural Network (DNN) is an ANN that necessarily consists of one or more hidden layers between the input layer and the output layer of the ANN [99].…”

A Review on Deploying Blockchain Technology for Network Mobility Management

“…Even though task, computation, and traffic offloading tasks are primarily realized using optimization and artificial intelligence techniques, blockchain can facilitate these processes in numerous ways [106]. First, blockchain transaction states can be assisted in reaching offloading decisions.…”

A Systematic Review of Using Deep Learning in Aphasia: Challenges and Future Directions

“…These abnormalities pose challenges for automatic speech recognition systems, as they must be able to accurately recognize and interpret these linguistic features to assess speech performance effectively [20]. Incorporating algorithms capable of handling such linguistic complexity is essential for improving recognition accuracy [18,[20][21][22].…”

“…Obtaining large-scale, accurately annotated datasets of aphasic speech is challenging due to the time-consuming nature of manual annotation and the limited availability of such data [15,16,19,24,25]. Without sufficient data for training, deep learning models may struggle to generalize effectively across different types and severities of aphasia, leading to reduced performance and reliability in real-world applications [22,26]. Improving access to annotated datasets and developing techniques for efficient data annotation are essential for advancing research in this area [15,16,[27][28][29][30][31][32][33][34].…”

“…Deploying deep learning solutions effectively into clinical workflows presents challenges, including ensuring user-friendly interfaces and actionable insights for clinicians without extensive technical expertise [22]. Additionally, the latency in real-time deployment and the need for seamless integration with existing clinical practices pose further challenges [22].…”