Multimodal and Multiview Wound Monitoring with Mobile Devices

Abstract

Along with geometric and color indicators, thermography is another valuable source of information for wound monitoring. The interaction of geometry with thermography can provide predictive indicators of wound evolution; however, existing processes are focused on the use of high-cost devices with a static configuration, which restricts the scanning of large surfaces. In this study, we propose the use of commercial devices, such as mobile devices and portable thermography, to integrate information from different wavelengths onto the surface of a 3D model. A handheld acquisition is proposed in which color images are used to create a 3D model by using Structure from Motion (SfM), and thermography is incorporated into the 3D surface through a pose estimation refinement based on optimizing the temperature correlation between multiple views. Thermal and color 3D models were successfully created for six patients with multiple views from a low-cost commercial device. The results show the successful application of the proposed methodology where thermal mapping on 3D models is not limited in the scanning area and can provide consistent information between multiple thermal camera views. Further work will focus on studying the quantitative metrics obtained by the multi-view 3D models created with the proposed methodology.

Registration of thermal 3D models over time using low cost and portable devices

“…The thermal 3D modeling is based on a previous algorithm. 6 This section presents an overview of the acquisition and camera calibration steps and the procedure for creating the thermal 3D model. In addition, this section explains how the temperature difference map is created and analyzed by registration of the thermal 3D models over time.…”

“…Our previous research has introduced thermal 3D models using practical acquisition methods and low-cost handheld devices. 6 Therefore, in this study, we offer a framework to create visualization tool and quantitative analysis of temperature changes using thermal 3D models generated at different moments.…”