Comparison Between Video-mediated and Asymmetric 3D Teleconsultation During a Preclinical Scenario

Strak, Robin; Yu, Kevin; Pankratz, Frieder; Lazarovici, Marc; Sandmeyer, Benedikt; Reichling, Julia; Weidert, Simon; Kraetsch, Clemens; Roegele, Barbara; Navab, Nassir; Eck, Ulrich; Roth, Daniel

doi:10.1145/3473856.3473883

Cited by 9 publications

(7 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Yu et al [44] presented a co-located AR collaboration system using real-time 3D reconstruction. Strak et al [39] found that their teleconsultation system improved performance during electrode placement compared to video-conferencing. Roth et al [32] designed their MR system for collaboration in the ICU during the Covid-19 pandemic.…”

Section: Augmented Reality In Health Carementioning

confidence: 99%

Evaluating Augmented Reality Communication: How Can We Teach Procedural Skill in AR?

Rebol,

Pietroszek,

Sikka

et al. 2023

29th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

Figure 1: Augmented Reality (AR) System for Remote Collaboration. A remotely located expert (right) teaches a local trainee (left) a medical procedure, the placement of a central venous catheter (CVC). Both parties communicate in AR using headmounted displays. The expert receives a volumetric view of the local scene and guides the trainee using gestures, augmented objects, and verbal communication.

show abstract

Section: Augmented Reality In Health Carementioning

confidence: 99%

Evaluating Augmented Reality Communication: How Can We Teach Procedural Skill in AR?

Rebol,

Pietroszek,

Sikka

et al. 2023

29th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

show abstract

“…In this way, both HMDs show the same image in which the hands of a remote specialist are overlaid on the actual scene to guide the local clinician. In [ 6 ], the authors described a 3D teleconsultation system intended for preclinical emergency scenarios. A depth camera captures the patient environment, and from this information, 3D reconstruction is performed on the remote expert side.…”

Section: Related Workmentioning

confidence: 99%

Extended Reality Telemedicine Collaboration System Using Patient Avatar Based on 3D Body Pose Estimation

Šarić,

Russo,

Kraljević

et al. 2023

Sensors

View full text Add to dashboard Cite

Recent advances in extended reality (XR) technology have opened the possibility of significantly improving telemedicine systems. This is primarily achieved by transferring 3D information about patient state, which is utilized to create more immersive experiences on VR/AR headsets. In this paper, we propose an XR-based telemedicine collaboration system in which the patient is represented as a 3D avatar in an XR space shared by local and remote clinicians. The proposed system consists of an AR client application running on Microsoft HoloLens 2 used by a local clinician, a VR client application running on the HTC vive Pro used by a remote clinician, and a backend part running on the server. The patient is captured by a camera on the AR side, and the 3D body pose estimation is performed on frames from this camera stream to form a 3D patient avatar. Additionally, the AR and VR sides can interact with the patient avatar via virtual hands, and annotations can be performed on a 3D model. The main contribution of our work is the use of 3D body pose estimation for the creation of a 3D patient avatar. In this way, 3D body reconstruction using depth cameras is avoided, which reduces system complexity and hardware and network resources. Another contribution is the novel architecture of the proposed system, where audio and video streaming are realized using WebRTC protocol. The performance evaluation showed that the proposed system ensures high frame rates for both AR and VR client applications, while the processing latency remains at an acceptable level.

show abstract

“…As a medical use case, we identified the need for 3D teleconsultation during the first response for accidents and emergencies. E.g., in the case of massive casualties [ 38 ] or rare conditions, on-site medical staff often wish to consult with experts to apply the proper treatment. In addition, with telepresence, remote experts are no longer required to travel to local sites; therefore, they are more efficient in switching between cases and avoid unnecessary patient contact [ 39 ].…”

Section: Exemplary Applications Of the Medical Augmented Reality Fram...mentioning

confidence: 99%

“…Evaluation should therefore cover the fundamental acceptance of every component in the system and their usability. The evaluation covers the acceptance of teleconsultation versus conventional video calls [ 38 ], user representations [ 41 ], and advanced interaction techniques [ 42 , 43 ] - all with clinical use cases in mind.…”

Section: Exemplary Applications Of the Medical Augmented Reality Fram...mentioning

confidence: 99%

Medical Augmented Reality: Definition, Principle Components, Domain Modeling, and Design-Development-Validation Process

et al. 2022

Self Cite

View full text Add to dashboard Cite

Three decades after the first set of work on Medical Augmented Reality (MAR) was presented to the international community, and ten years after the deployment of the first MAR solutions into operating rooms, its exact definition, basic components, systematic design, and validation still lack a detailed discussion. This paper defines the basic components of any Augmented Reality (AR) solution and extends them to exemplary Medical Augmented Reality Systems (MARS). We use some of the original MARS applications developed at the Chair for Computer Aided Medical Procedures and deployed into medical schools for teaching anatomy and into operating rooms for telemedicine and surgical guidance throughout the last decades to identify the corresponding basic components. In this regard, the paper is not discussing all past or existing solutions but only aims at defining the principle components and discussing the particular domain modeling for MAR and its design-development-validation process, and providing exemplary cases through the past in-house developments of such solutions.

show abstract

Comparison Between Video-mediated and Asymmetric 3D Teleconsultation During a Preclinical Scenario

Cited by 9 publications

References 21 publications

Evaluating Augmented Reality Communication: How Can We Teach Procedural Skill in AR?

Evaluating Augmented Reality Communication: How Can We Teach Procedural Skill in AR?

Extended Reality Telemedicine Collaboration System Using Patient Avatar Based on 3D Body Pose Estimation

Medical Augmented Reality: Definition, Principle Components, Domain Modeling, and Design-Development-Validation Process

Contact Info

Product

Resources

About