Remote 3D medical consultation

Abstract

Abstract-Two-dimensional (2D) video-based telemedical consultation has been explored widely in the past 15-20 years. Two issues that seem to arise in most relevant case studies are the difficulty associated with obtaining the desired 2D camera views, and poor depth perception. To address these problems we are exploring the use of a small array of cameras to reconstruct a real-time, on-line 3D computer model of the real environment and events. We call this 3D medical consultation (3DMC). The idea is to give remote users what amounts to an infinite set of stereoscopic viewpoints, simultaneously addressing the visibility and depth perception problems associated with 2D video. Here we describe our current prototype system, some of the methods we use, and some early experimental results.

The potential impact of 3d telepresence technology on task performance in emergency trauma care

“…As shown in Figure 1 in the current vision for 3D telepresence technology users would be provided a seamless view of a remote scene, and the ability to virtually point to objects at the remote location [41]. This view would, ideally, dynamically change as the user moves her or his head or walks around.…”

“…Only an early prototype system demonstrating components of 3D telepresence technology exists today [41]. However, today funding agencies wish to understand the potential of the technology.…”

“…A digital laser pointer could be used and tracked locally, and projected at the remote scene to allow the user to virtually point at but not touch objects and areas in the remote location. Today, these capabilities are being explored using an array of cameras to capture the remote scene and computer algorithms to blend those camera views and present the result to remote users in real time [41]. Ideally there will be no need for navigating tools that require user input or manipulation such as zoom or change the angles of the cameras.…”

“…If so, it could provide trauma victims and other patients in rural, naturaland human-made catastrophic areas with better medical care although physicians or medical experts are not physically present. Today, research is underway to develop components of 3D telepresence technology; a lab prototype is under development but not yet completed [41]. Millions of dollars are still required to develop and implement the 3D technology.…”

Towards Multi-Site Collaboration in 3D Tele-Immersive Environments

“…Over the last few years, 3DTI has shown great potentials in a wide range of applications such as video-conferencing, distance learning of physical activities, collaborative art performance, firefighter training, and medical consultation [2,12,17,24,28].…”