Adaptive Multi-Trace Carving for Robust Frequency Tracking in Forensic Applications

Zhu, Qiang; Chen, Mingliang; Wong, Chau-Wai; Wu, Min

doi:10.1109/tifs.2020.3030182

Cited by 37 publications

(21 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The pulse signal, referred to as remote photoplethysmogram (rPPG), can be obtained from applying the plane-orthogonal-to-skin (POS) algorithm [29], which defines a plane orthogonal to the skin tone in the RGB space for robust rPPG extraction. The HR is then tracked from the rPPG signal via a state-ofthe-art adaptive multi-trace carving (AMTC) [34] algorithm that tracks the HR from the spectrogram of rPPG by dynamic programming and adaptive trace compensation.…”

Section: B Rppg Extraction and Hr Estimationmentioning

confidence: 99%

A Multi-Channel Ratio-of-Ratios Method for Noncontact Hand Video Based SpO2 Monitoring Using Smartphone Cameras

Tian¹,

Wong²,

Wu³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

Blood oxygen saturation (SpO2) is an important indicator for pulmonary and respiratory functionalities. Clinical findings on COVID-19 show that many patients had dangerously low blood oxygen levels not long before conditions worsened. It is therefore recommended, especially for the vulnerable population, to regularly monitor the blood oxygen level for precaution. Recent works have investigated how ubiquitous smartphone cameras can be used to infer SpO2. Most of these works are contact-based, requiring users to cover a phone's camera and its nearby light source with a finger to capture reemitted light from the illuminated tissue. Contact-based methods may lead to skin irritation and sanitary concerns, especially during a pandemic. In this paper, we propose a noncontact method for SpO2 monitoring using hand videos acquired by smartphones. Considering the optical broadband nature of the red (R), green (G), and blue (B) color channels of the smartphone cameras, we exploit all three channels of RGB sensing to distill the SpO2 information beyond the traditional ratio-of-ratios (RoR) method that uses only two wavelengths. To further facilitate an accurate SpO2 prediction, we design adaptive narrow bandpass filters based on accurately estimated heart rate to obtain the most cardiac-related AC component for each color channel. Experimental results show that our proposed blood oxygen estimation method can reach a mean absolute error of 1.26% when a pulse oximeter is used as a reference, outperforming the traditional RoR method by 25%.

show abstract

Section: B Rppg Extraction and Hr Estimationmentioning

confidence: 99%

A Multi-Channel Ratio-of-Ratios Method for Noncontact Hand Video Based SpO2 Monitoring Using Smartphone Cameras

Tian¹,

Wong²,

Wu³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…For instance, remote photoplethysmography (rPPG) technology has attracted a growing amount of interests in capturing the subtle color changes of the skin caused by heartbeats in facial videos under ambient light. We can further infer heart rate (HR) [5]- [10], respiration rate (RR) [11], [12], and heart rate variability Mingliang Chen was with the Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742 USA when he performed the work, and now he is with Meta Platform Inc., Menlo Park, CA 94025 USA (e-mail: mchen126@terpmail.umd.edu).…”

Section: Introductionmentioning

confidence: 99%

PulseEdit: Editing Physiological Signals in Facial Videos for Privacy Protection

Chen

Liao

2022

IEEE Trans.Inform.Forensic Secur.

Self Cite

View full text Add to dashboard Cite

“…Second, graph-based harmonic selection was elaborated. In [17], a unified approach was proposed to detect multiple weak frequency components under low SNR conditions. Iterative dynamic programming and adaptive trace compensation were employed to identify the frequency components.…”

Section: Introductionmentioning

confidence: 99%

An Automated Approach for Electric Network Frequency Estimation in Static and Non-Static Digital Video Recordings

Karantaidis

Kotropoulos

2021

J. Imaging

View full text Add to dashboard Cite

Electric Network Frequency (ENF) is embedded in multimedia recordings if the recordings are captured with a device connected to power mains or placed near the power mains. It is exploited as a tool for multimedia authentication. ENF fluctuates stochastically around its nominal frequency at 50/60 Hz. In indoor environments, luminance variations captured by video recordings can also be exploited for ENF estimation. However, the various textures and different levels of shadow and luminance hinder ENF estimation in static and non-static video, making it a non-trivial problem. To address this problem, a novel automated approach is proposed for ENF estimation in static and non-static digital video recordings. The proposed approach is based on the exploitation of areas with similar characteristics in each video frame. These areas, called superpixels, have a mean intensity that exceeds a specific threshold. The performance of the proposed approach is tested on various videos of real-life scenarios that resemble surveillance from security cameras. These videos are of escalating difficulty and span recordings from static ones to recordings, which exhibit continuous motion. The maximum correlation coefficient is employed to measure the accuracy of ENF estimation against the ground truth signal. Experimental results show that the proposed approach improves ENF estimation against the state-of-the-art, yielding statistically significant accuracy improvements.

show abstract

Adaptive Multi-Trace Carving for Robust Frequency Tracking in Forensic Applications

Cited by 37 publications

References 28 publications

A Multi-Channel Ratio-of-Ratios Method for Noncontact Hand Video Based SpO2 Monitoring Using Smartphone Cameras

A Multi-Channel Ratio-of-Ratios Method for Noncontact Hand Video Based SpO2 Monitoring Using Smartphone Cameras

PulseEdit: Editing Physiological Signals in Facial Videos for Privacy Protection

An Automated Approach for Electric Network Frequency Estimation in Static and Non-Static Digital Video Recordings

Contact Info

Product

Resources

About