Sensor Fusion for Identification of Freezing of Gait Episodes Using Wi-Fi and Radar Imaging

Abstract

Parkinson's disease (PD) is a progressive and neurodegenerative condition causing motor impairments. One of the major motor related impairments that present biggest challenge is freezing of gait (FOG) in Parkinson's patients. In FOG episode, the patient is unable to initiate, control or sustain a gait that consequently affects the Activities of Daily Livings (ADLs) and increases the occurrence of critical events such as falls. This paper presents continuous monitoring ADLs and classification freezing of gait episodes using Wi-Fi and radar imaging. The idea is to exploit the multiresolution scalograms generated by channel state information (CSI) imprint and micro-Doppler signatures produced by reflected radar signal. A total of 120 volunteers took part in experimental campaign and were asked to perform different activities including walking fast, walking slow, voluntary stop, sitting down & stand up and freezing of gait. Two neural networks namely Autoencoder and a proposed enhanced Autoencoder were used classify ADLs and FOG episodes using data fusion process by combining the images acquired from both sensing techniques. The Autoencoder provided overall classification accuracy of ∼87% for combined datasets. The proposed algorithm provided significantly better results by presenting an overall accuracy of ∼98% using data fusion.

Deep Learning-Based Multimodal Abnormal Gait Classification Using a 3D Skeleton and Plantar Foot Pressure

“…In this study, individual deep CNNs were used for each sensor dataset to extract features, and the concatenated features were fed to a DNN-based classifier. Data fusion of the scalograms and spectrograms obtained by using Wi-Fi sensing and radar sensors, respectively, was used to classify gait freezing episodes with an accuracy of 98.1% by applying a CNN-based autoencoder in [33].…”

A Review of the State of the Art in Non-Contact Sensing for COVID-19

“…Radar technology can be used to monitor the respiratory system within a home environment and provide a quick response if abnormalities are found, which suggests COVID-19 being present. Radar systems use frequency-modulated continuous wave (FMCW) to observe the Doppler effect when a person moves [ 67 , 68 , 69 , 70 ]. This can be used to monitor the fine movements associated with breathing.…”

A Review and Comparison of the State-of-the-Art Techniques for Atrial Fibrillation Detection and Skin Hydration

“…In general, the machine learning and deep learning approaches extract useful knowledge from historical training data to make decisions in real-time applications. Furthermore, different types of sensors have been developed that can be used for the identification of cardiovascular, gait, and other activities of daily life (Shah et al, 2020). The presence of these computing devices, intelligent algorithms, and sophisticated sensors provide opportunities to develop systems that can reduce health hazards and improve quality of life, such as detecting AF in the early stage.…”