Noncontact Monitoring of Vital Signs with RGB and Infrared Camera and Its Application to Screening of Potential Infection

Abstract

In recent years, much attention is being paid to research and development of technology that provides noncontact measurement of vital signs, i.e., heart rate, respiration, and body temperature, which are important for understanding the state of a person's health. As technology for sensing biological information has progressed, new biological measurement sensors have been developed successively. There have also been reports regarding methods for measuring respiration or heart rate using pressure sensors, microwave radar, air mattresses, or high-polymer piezoelectric film. The methods have wide-ranging applications, including systems for monitoring of elderly people, identification of sleep apnea, detection of patients suspected to have an infectious disease, and noncontact measurement of stress levels. In this chapter, the principles behind noncontact measurement of respiration and heartbeat using infrared/RGB facial-image analysis are discussed, along with the applications for such measurement in the detection of patients suspected to be suffering from infectious diseases.

A Deep Learning-Based Camera Approach for Vital Sign Monitoring Using Thermography Images for ICU Patients

“…In 2015, Pereira et al presented an advanced approach to estimate RR from the nostrils using a high definition thermography camera [ 14 ]. Sun et al measured RR and HR simultaneously from the face/nose region with a dual RGB/IRT camera system [ 15 ]. Elphick et al conducted a larger study with more than 70 participants using a technique for facial analysis to track the nose region [ 16 ].…”

An Inclusive Survey of Contactless Wireless Sensing: A Technology Used for Remotely Monitoring Vital Signs Has the Potential to Combating COVID-19

“…According to the authors, the model investigates two design properties, first is the the electromagnetic wave propagation property through wall, and second is the pulse fidelity. 4) Authors in [70,71] discussed the principal behind non-contact measuring of respiration and heartbeat using infrared/RGB facial-image. Moreover, potential applications such as the detection and observation of a person with infectious diseases were also discussed.…”

“…FMCW-based sensing technique discussed in details in the previous sections, is a method where a continues frequency modulated wave and its reflections' characteristics are stud-FIGURE 57: Infectious decease screening system using infrared and RGB imaging [70].…”

“…[46] RR CSI 2.4 WIDETECT [47] Motion CSI 5.805 WifiU [48] Gait CSI 5 WIFID [49] Identification CSI Not specified WiSee [56] Gesture Recognition CSI 5 [53] Human activity CSI 5.8 [54] Gesture Recognition CSI 5 [55] Heart beat CSI 24GHz 1D-CNN [50] Paraparesis CSI 5.32 [51] Human activity (sitting standing) CSI 3. [63] Heart rate, Temperature Camera 10GHz [69] See through wall Camera 10GHz [70,71] Respiration and heartbeat Camera Not specified [72] Heart rate, per-fusion index and oxygen saturation Camera Not specified [26] Not specified [27] Not specified EQ-Radio [43] SVM EZ-Sleep [28] CNN Emirald [39] Not specified Vital-Radio [29] Not specified Marko [30] NN Witrack [44] Not specified WiTrack2.0 [45] Not specified Aryokee [31] SVM, NN [32] NN WiGait [33] Not specified [40] Not specified [46] HMM WIDETECT [47] Not specified WifiU [48] SVM WIFID [49] SVM WiSee [56] Not specified [53] KNN 1D-CNN [50] CNN Sleep Minder [57] Not specified [60] Not specified doctors, and other people and hence preventing the spread of highly contagious diseases such as Covid-19. However, the spread and persistence of Covid-19 pandemic in the year 2020 clearly showed that contactless sensors have not been developed and deployed enough.…”

A Review of Heartbeat Detection Systems for Automotive Applications

“…Okada et al attempted to separate the facial image into melanin pigment, hemoglobin pigment, and shading intensity components by independent component analysis (ICA) and estimated the pulse wave based on the changes in these components over time [79]. Kwon [80] appears to have performed a similar exercise to the case of Okada et al There are some reports of heartbeat detection based on thermographic information; however, thermography seems to be mainly used for detecting breathing information [81]. Rizmill [82] features the ability to detect video pulse waves using a general-purpose web camera, which enables health management at home as well as infant monitoring.…”