Video-based beat-by-beat blood pressure monitoring via transfer deep-learning

Abstract

Currently, learning physiological vital signs such as blood pressure (BP), hemoglobin levels, and oxygen saturation, from Photoplethysmography (PPG) signal, is receiving more attention. Despite successive progress that has been made so far, continuously revealing new aspects characterizes that field as a rich research topic. It includes a diverse number of critical points represented in signal denoising, data cleaning, employed features, feature format, feature selection, feature domain, model structure, problem formulation (regression or classification), and model combinations. It is worth noting that extensive research efforts are devoted to utilizing different variants of machine learning and deep learning models while transfer learning is not fully explored yet. So, in this paper, we are introducing a per-beat rPPG-to-BP mapping scheme based on transfer learning. An interesting representation of a 1-D PPG signal as a 2-D image is proposed for enabling powerful off-the-shelf image-based models through transfer learning. It resolves limitations about training data size due to strict data cleaning. Also, it enhances model generalization by exploiting underlying excellent feature extraction. Moreover, non-uniform data distribution (data skewness) is partially resolved by introducing logarithmic transformation. Furthermore, double cleaning is applied for training contact PPG data and testing rPPG beats as well. The quality of the segmented beats is tested by checking some of the related quality metrics. Hence, the prediction reliability is enhanced by excluding deformed beats. Varying rPPG quality is relaxed by selecting beats during intervals of the highest signal strength. Based on the experimental results, the proposed system outperforms the state-of-the-art systems in the sense of mean absolute error (MAE) and standard deviation (STD). STD for the test data is decreased to 5.4782 and 3.8539 for SBP and DBP, respectively. Also, MAE decreased to 2.3453 and 1.6854 for SBP and DBP, respectively. Moreover, the results for BP estimation from real video reveal that the STD reaches 8.027882 and 6.013052 for SBP and DBP, respectively. Also, MAE for the estimated BP from real videos reaches 7.052803 and 5.616028 for SBP and DBP, respectively. Graphical abstract Proposed camera-based blood pressure monitoring system

Heart rate and oxygen level estimation from facial videos using a hybrid deep learning model

“…Hsu et al 20 proposed to estimate HR from facial videos, where 2D Time-Frequency Representation extracted from facial frames (over short time intervals) were the input image (feature map) of a CNN model. Omer et al 21 presented a beatto-beat BP estimation system from facial videos, where Transfer learning was applied based on the well-trained image deep learning networks. The 1D beat was mapped to a 2D image.…”