Physiological signals, such as electroencephalogram (EEG), are used to observe a driver’s brain activities. A portable EEG system provides several advantages, including ease of operation, cost-effectiveness, portability, and few physical restrictions. However, it can be challenging to analyse EEG signals as they often contain various artefacts, including muscle activities, eye blinking, and unwanted noises. This study utilised an independent component analysis (ICA) approach to eliminate such unwanted signals from the unprocessed EEG data of 12 young, physically fit male participants between the ages of 19 and 24 who took part in a driving simulation. Furthermore, driver fatigue state detection was carried out using multichannel EEG signals obtained from O1, O2, Fp1, Fp2, P3, P4, F3, and F4. An enhanced modified z-score was utilised with features extracted from a time-frequency domain continuous wavelet transform (CWT) to elevate the reliability of driver fatigue classification. The proposed methodology offers several advantages. First, multichannel EEG analysis improves the accuracy of sleep stage detection, which is vital for accurate driver fatigue detection. Second, an enhanced modified z-score in feature extraction is more robust than conventional z-score techniques, making it more effective for removing outlier values and improving classification accuracy. Third, the proposed approach for detecting driver fatigue employs multiple machine learning classifiers, such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Artificial Neural Networks (ANNs) that utilise Long Short-Term Memory (LSTM), and also machine learning techniques like Support Vector Machines (SVM). The evaluation of five classifiers was performed through 5-fold cross-validation. The outcomes indicate that the suggested framework attains exceptional precision in identifying driver fatigue, with an average accuracy rate of 96.07%. Among the classifiers, the ANN classifier achieved the most significant precision of 99.65%, and the SVM classifier ranked second with an accuracy of 97.89%. Based on the results of the receiver operating characteristic (ROC) and area under the curve (AUC) analysis, it was observed that all the classifiers had an outstanding performance, with an average AUC value of 0.95. This study’s contribution lies in presenting a comprehensive and effective framework that can accurately detect driver fatigue from EEG signals. ABSTRAK: Isyarat fisiologi, seperti elektroencefalogram (EEG), digunakan bagi memerhati aktiviti otak pemandu. Sistem EEG mudah alih menyediakan beberapa kelebihan, termasuk kemudahan operasi, keberkesanan kos, mudah alih dan sedikit sekatan fizikal. Namun, isyarat EEG mungkin sukar dianalisis kerana ia sering mengandungi pelbagai artifak, termasuk aktiviti otot, mata berkedip dan bunyi yang tidak diingini. Kajian ini menggunakan pendekatan analisis komponen bebas (ICA) bagi membuang isyarat tidak diperlukan daripada data EEG yang belum diproses daripada 12 peserta lelaki muda, cergas fizikal berumur 19 hingga 24 tahun yang mengambil bahagian dalam simulasi pemanduan. Tambahan, pengesanan keadaan lesu pemandu telah dijalankan menggunakan isyarat EEG berbilang saluran yang diperoleh dari O1, O2, Fp1, Fp2, P3, P4, F3, dan F4. Penambah baik skor z digunakan dengan ciri diekstrak daripada transformasi wavelet berterusan (CWT) domain frekuensi masa bagi meningkatkan kebolehpercayaan klasifikasi keletihan pemandu. Metodologi yang dicadangkan menawarkan beberapa kelebihan. Pertama, analisis EEG berbilang saluran meningkatkan ketepatan pengesanan peringkat tidur, penting bagi pengesanan keletihan pemandu secara tepat. Kedua, penambah baik skor z dalam pengekstrak ciri adalah lebih teguh daripada teknik skor z konvensional, menjadikannya lebih berkesan bagi membuang unsur luaran dan meningkatkan ketepatan pengelasan. Ketiga, pendekatan yang dicadangkan bagi mengesan keletihan pemandu menggunakan pelbagai pengelas pembelajaran mesin, seperti Rangkaian Neural Konvolusi (CNN), Rangkaian Neural Berulang (RNN), Rangkaian Neural Buatan (ANN) yang menggunakan Memori Jangka Pendek Panjang (LSTM), dan juga teknik pembelajaran mesin seperti Mesin Vektor Sokongan (SVM). Penilaian lima pengelas dilakukan melalui pengesahan silang 5 kali ganda. Dapatan kajian menunjukkan cadangan rangka kerja ini mencapai ketepatan yang luar biasa dalam mengenal pasti keletihan pemandu, dengan kadar ketepatan purata 96.07%. Antara kesemua pengelas, pengelas ANN mencapai ketepatan paling ketara sebanyak 99.65%, dan pengelas SVM menduduki tempat kedua dengan ketepatan 97.89%. Berdasarkan keputusan analisis ciri operasi penerima (ROC) dan kawasan di bawah lengkung (AUC), didapati semua pengelas mempunyai prestasi cemerlang, dengan purata nilai AUC 0.95. Sumbangan kajian ini adalah terletak pada rangka kerja yang komprehensif dan berkesan mengesan keletihan pemandu secara tepat melalui isyarat EEG.
Blinding of modality has been influenced decision of multimodal in several circumstances. Sometimes, certain electroencephalogram (EEG) signal is omitted to achieve the highest accuracy of performance. Therefore, the aim for this paper is to enhance the multimodal parameters of EEG signals based on music applications. The structure of multimodal is evaluated with performance measure to ensure the implementation of parameter value is valid to apply in the multimodal equation. The modalities’ parameters proposed in this multimodal are weighted stress condition, signal features extraction, and music class. The weighted stress condition was obtained from stress classes. The EEG signal produces signal features extracted from the frequency domain and time-frequency domain via techniques such as power spectrum density (PSD), short-time Fourier transform (STFT), and continuous wavelet transform (CWT). Power value is evaluated in PSD. The energy distribution is derived from STFT and CWT techniques. Two types of music were used in this experiment. The multimodal fusion is tested using a six-performance measurement method. The purposed multimodal parameter shows the highest accuracy is 97.68%. The sensitivity of this study presents over 95% and the high value for specificity is 89.5%. The area under the curve (AUC) value is 1 and the F1 score is 0.986. The informedness values range from 0.793 to 0.812 found in this paper.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.