Exploring Body Texture From mmW Images for Person Recognition

Abstract

Imaging using millimeter waves (mmWs) has many advantages including the ability to penetrate obscurants such as clothes and polymers. After having explored shape information retrieved from mmW images for person recognition, in this work we aim to gain some insight about the potential of using mmW texture information for the same task, considering not only the mmW face, but also mmW torso and mmW wholebody. We report experimental results using the mmW TNO database consisting of 50 individuals based on both hand-crafted and learned features from Alexnet and VGG-face pretrained Convolutional Neural Networks (CNN) models. First, we analyze the individual performance of three mmW body parts, concluding that: i) mmW torso region is more discriminative than mmW face and the whole body, ii) CNN features produce better results compared to hand-crafted features on mmW faces and the entire body, and iii) hand-crafted features slightly outperform CNN features on mmW torso. In the second part of this work, we analyze different multi-algorithmic and multi-modal techniques, including a novel CNN-based fusion technique, improving verification results to 2% EER and identification rank-1 results up to 99% . Comparative analyses with mmW body shape information and face recognition in the visible and NIR spectral bands are also reported.

Active and passive mixed millimeter wave imaging target recognition method based on multi‐feature fusion

“…In passive millimeter wave imaging system, millimeter waves from dangerous goods target, human body, and background radiation are processed by radiometer array. 13,14 The target and the background have different temperatures, that is, their radiation spectrum brightness is different. Therefore, the brightness temperature resolution of the system is less than the temperature difference between the target and the background, so the position of the target and the background can be distinguished.…”

“…This phenomenon is related to temperature and called thermal radiation. In passive millimeter wave imaging system, millimeter waves from dangerous goods target, human body, and background radiation are processed by radiometer array 13,14 . The target and the background have different temperatures, that is, their radiation spectrum brightness is different.…”