Robust respiration detection from remote photoplethysmography

Gastel, Mark van; Stuijk, Sander; Haan, G Gerard de

doi:10.1364/boe.7.004941

Cited by 102 publications

(87 citation statements)

References 29 publications

(48 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…5 healthy adults (2 female) (aged 29-38 years, M=31.4, SD=3.78) were recruited from the university subject pool. Following the protocol used in [5], participants were asked to maintain a stable posture and breath according to a set of breathing patterns presented to them on a screen. Figure 5 shows the design for this experiment.…”

Section: Dataset 1: Controlled Respiration In Environments With Non-cmentioning

confidence: 99%

“…Despite its importance, it has been largely disregarded in real world healthcare technology applications [3]. One possible reason is the inconvenience of conventional respiration measurement systems, such as chest-belts or oronasal probes, which demand direct physical contact [4][5][6]. These systems are often uncomfortable to wear and prone to motion artifacts which might cause incorrect sensor readings.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Cho¹,

Julier²,

Marquardt³

et al. 2017

Biomed. Opt. Express

110

114

View full text Add to dashboard Cite

Abstract:The ability to monitor the respiratory rate, one of the vital signs, is extremely important for the medical treatment, healthcare and fitness sectors. In many situations, mobile methods, which allow users to undertake everyday activities, are required. However, current monitoring systems can be obtrusive, requiring users to wear respiration belts or nasal probes. Alternatively, contactless digital image sensor based remote-photoplethysmography (PPG) can be used. However, remote PPG requires an ambient source of light, and does not work properly in dark places or under varying lighting conditions. Recent advances in thermographic systems have shrunk their size, weight and cost, to the point where it is possible to create smart-phone based respiration rate monitoring devices that are not affected by lighting conditions. However, mobile thermal imaging is challenged in scenes with high thermal dynamic ranges (e.g. due to the different environmental temperature distributions indoors and outdoors). This challenge is further amplified by general problems such as motion artifacts and low spatial resolution, leading to unreliable breathing signals. In this paper, we propose a novel and robust approach for respiration tracking which compensates for the negative effects of variations in the ambient temperature and motion artifacts and can accurately extract breathing rates in highly dynamic thermal scenes. The approach is based on tracking the nostril of the user and using local temperature variations to infer inhalation and exhalation cycles. It has three main contributions. The first is a novel Optimal Quantization technique which adaptively constructs a color mapping of absolute temperature to improve segmentation, classification and tracking. The second is the Thermal Gradient Flow method that computes thermal gradient magnitude maps to enhance the accuracy of the nostril region tracking. Finally, we introduce the Thermal Voxel method to increase the reliability of the captured respiration signals compared to the traditional averaging method. We demonstrate the extreme robustness of our system to track the nostril-region and measure the respiratory rate by evaluating it during controlled respiration exercises in high thermal dynamic scenes (e.g. strong correlation (r = 0.9987) with the ground truth from the respiration-belt sensor). We also demonstrate how our algorithm outperformed standard algorithms in settings with different amounts of environmental thermal changes and human motion. We open the tracked ROI sequences of the datasets collected for these studies (i.e. under both controlled and unconstrained real-world settings) to the community to foster work in this area.

show abstract

Section: Dataset 1: Controlled Respiration In Environments With Non-cmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Cho¹,

Julier²,

Marquardt³

et al. 2017

Biomed. Opt. Express

110

114

View full text Add to dashboard Cite

show abstract

“…This picture is complicated somewhat by respiratory activity as, first, intra-thoracic pressure variations cause an exchange of blood between the pulmonary and the systemic circulation which results in a variation of perfusion baseline which adds an offset to the heart rate signal. In addition, a decrease in cardiac output due to reduced ventricular filling causes pulse amplitude variations that provide a respiratory induced amplitude modulation (AM) to the heart rate signal [20]. Here the former is removed by filtering and the latter by standard demodulation methods.…”

Section: The Cppg Signal C(t)mentioning

confidence: 99%

Assessing blood vessel perfusion and vital signs through retinal imaging photoplethysmography

Hassan

Jaidka

Dwyer

et al. 2018

Biomed. Opt. Express

View full text Add to dashboard Cite

Abstract:One solution to the global challenge of increasing ocular disease is a cost-effective technique for rapid screening and assessment. Current ophthalmic imaging techniques, e.g. scanning and ocular blood flow systems, are expensive, complex to operate and utilize invasive contrast agents during assessment. The work presented here demonstrates a simple retinal imaging photoplethysmography (iPPG) system with the potential to provide screening, diagnosis, monitoring and assessment that is non-invasive, painless and radiationless. Time series of individual retinal blood vessel images, captured with an eye fundus camera, are processed using standard filtering, amplitude demodulation and principle component analysis (PCA) methods to determine the values of the heart rate (HR) and respiration rate (RR), which are in compliance with simultaneously obtained measurements using commercial pulse oximetry. It also seems possible that some information on the dynamic changes in oxygen saturation levels (SpO 2 ) in a retinal blood vessel may also be obtained. As a consequence, the retinal iPPG modality system demonstrates a potential avenue for rapid ophthalmic screening, and even early diagnosis, against ocular disease without the need for fluorescent or contrast agents.

show abstract

“…However, none of these previous methods directly estimated and evaluated physiological metrics from NIR frames. One exception is the works of van Gastel et al, which considered NIR face videos to estimate HR and BR [11,12]. In their study, they observed that the relative photoplethysmographic amplitude was significantly reduced in NIR compared to visible light and, therefore, they needed to use three NIR wavelengths (hence three NIR cameras with different optical filters) to appropriately separate pulse-induced intensity variations from motion artifact.…”

Section: Previous Workmentioning

confidence: 99%

Estimating carotid pulse and breathing rate from near-infrared video of the neck

2018

View full text Add to dashboard Cite

Objective: Non-contact physiological measurement is a growing research area that allows capturing vital signs such as heart rate (HR) and breathing rate (BR) comfortably and unobtrusively with remote devices. However, most of the approaches work only in bright environments in which subtle photoplethysmographic and ballistocardiographic signals can be easily analyzed and/or require expensive and custom hardware to perform the measurements.Approach: This work introduces a low-cost method to measure subtle motions associated with the carotid pulse and breathing movement from the neck using near-infrared (NIR) video imaging. A skin reflection model of the neck was established to provide a theoretical foundation for the method. In particular, the method relies on template matching for neck detection, Principal Component Analysis for feature extraction, and Hidden Markov Models for data smoothing.Main Results: We compared the estimated HR and BR measures with ones provided by an FDA-cleared device in a 12-participant laboratory study: the estimates achieved a mean absolute error of 0.36 beats per minute and 0.24 breaths per minute under both bright and dark lighting.Significance: This work advances the possibilities of non-contact physiological measurement in real-life conditions in which environmental illumination is limited and in which the face of the person is not readily available or needs to be protected. Due to the increasing availability of NIR imaging devices, the described methods are readily scalable.

show abstract

Robust respiration detection from remote photoplethysmography

Cited by 102 publications

References 29 publications

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging

Assessing blood vessel perfusion and vital signs through retinal imaging photoplethysmography

Estimating carotid pulse and breathing rate from near-infrared video of the neck

Contact Info

Product

Resources

About