Time-Of-Flight Camera, Optical Tracker and Computed Tomography in Pairwise Data Registration

Abstract

PurposeA growing number of medical applications, including minimal invasive surgery, depends on multi-modal or multi-sensors data processing. Fast and accurate 3D scene analysis, comprising data registration, seems to be crucial for the development of computer aided diagnosis and therapy. The advancement of surface tracking system based on optical trackers already plays an important role in surgical procedures planning. However, new modalities, like the time-of-flight (ToF) sensors, widely explored in non-medical fields are powerful and have the potential to become a part of computer aided surgery set-up. Connection of different acquisition systems promises to provide a valuable support for operating room procedures. Therefore, the detailed analysis of the accuracy of such multi-sensors positioning systems is needed.MethodsWe present the system combining pre-operative CT series with intra-operative ToF-sensor and optical tracker point clouds. The methodology contains: optical sensor set-up and the ToF-camera calibration procedures, data pre-processing algorithms, and registration technique. The data pre-processing yields a surface, in case of CT, and point clouds for ToF-sensor and marker-driven optical tracker representation of an object of interest. An applied registration technique is based on Iterative Closest Point algorithm.ResultsThe experiments validate the registration of each pair of modalities/sensors involving phantoms of four various human organs in terms of Hausdorff distance and mean absolute distance metrics. The best surface alignment was obtained for CT and optical tracker combination, whereas the worst for experiments involving ToF-camera.ConclusionThe obtained accuracies encourage to further develop the multi-sensors systems. The presented substantive discussion concerning the system limitations and possible improvements mainly related to the depth information produced by the ToF-sensor is useful for computer aided surgery developers.

Recent advances in Surface Guided Radiation Therapy

“…A reference surface relative to the treatment isocenter position is used to calculate the necessary correction of the patient position in translational and rotational directions. There are four main optical surface scanning technologies used in radiotherapy, laser scanners [1], time-of-flight systems [2,3], stereovision systems [4] and structured light systems [5,6]. Optical surface scanners, with their high spatial and temporal resolution, have proven to be an important addition to the radiation therapy process regarding patient positioning and monitoring [1,7,8].…”

Innovative Non-Irradiating and Non-Invasive Per Fraction Control System in Radiotherapy: Surface-Guided Radiation Therapy Experience of Casablanca Cancer Center

“…Positioning variability was compared between conventional imaging and infrared skin surface monitoring (OSMS ® ). Conventional imaging was in the form of either standard radiography (KV) performed during the treatment session or three-dimensional imaging by a CBCT [4].…”

DepTSol: An Improved Deep-Learning- and Time-of-Flight-Based Real-Time Social Distance Monitoring Approach under Various Low-Light Conditions

“…In contrast to laser scanners, ToF cameras can measure up to 100 fps in one shot, which is much faster than laser technology. ToF technology has a variety of applications, including pathplanning for manipulators [39,40], obstacle avoidance [41,42], wheelchair assistance [42], medical respiratory motion detection [43], semantic scene analysis [43], simultaneous localization and mapping (SLAM) [44], and human-machine interaction [45][46][47][48].…”