ARTEMIS: Mixed-Reality Environment for Immersive Surgical Telementoring

Weibel, Nadir; Gasques, Danilo; Johnson, Janet; Sharkey, Thomas J.; Xu, Zhuoqun Robin; Zhang, Xinming; Zavala, Enrique; Yip, Michael C.; Davis, Konrad

doi:10.1145/3334480.3383169

Cited by 27 publications

(19 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our system extends previous work [2][3][4] and includes three modules: i) A reconstruction module acquires a real-time point-cloud of the local ICU to be visualized to the remote experts as reconstructed, textured geometries; ii) A local expert module enables local staff to interact with remote experts, who participate virtually; iii) A remote expert module enables remote collaborators to virtually join the physical space of the ICU, to access relevant (real-time) patient information, to communicate through avatars and speech, as well as to collaborate using shared annotations (see Fig. 1, Fig.…”

Section: Methodssupporting

confidence: 77%

See 1 more Smart Citation

Real-time Mixed Reality Teleconsultation for Intensive Care Units in Pandemic Situations

Roth

Yu²,

Pankratz

et al. 2021

2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

View full text Add to dashboard Cite

Intensive care units (ICUs) that host patients infected by the SARS-CoV-2 Coronavirus are separated from other care units. In regular ICU ward rounds, a number of experts from different medical areas and expertise are present to discuss the situation and care of the patient. However, this procedure is contrasting COVID-19 measures such as reduced contact and personnel traffic. In this project, we demonstrate a system for mixed reality (MR) teleconsultation to support ICU wards (ARTEKMED). Through ARTEKMED, remote experts can join a local 3D reconstructed ICU visit in virtual reality (VR) and support local experts that are equipped with an augmented reality (AR) system. Our goal is to reduce personnel traffic and in turn the risk of an infection spread.

show abstract

Section: Methodssupporting

confidence: 77%

“…Telepresence systems (e.g. [1,2,4]) could provide solutions for challenges that arise from pandemics. The goal of the herewith presented teleconsultation system ARTEKMED (see Fig.…”

Section: Introductionmentioning

confidence: 99%

Real-time Mixed Reality Teleconsultation for Intensive Care Units in Pandemic Situations

Roth

Yu²,

Pankratz

et al. 2021

2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

View full text Add to dashboard Cite

show abstract

“…Since 2015, researchers at Purdue and the Indiana University School of Medicine have been developing AR-based technology, termed System for Telementoring with Augmented Reality (STAR), in which a field medic can receive guidance from surgeons through an AR headset and eye-in-the-sky drone views (56) (Figure 2). The ARTEMIS (Augmented Reality Technology to Enable ReMote Integrated Surgery) system (57), which includes both AR and VR through an immersive environment (Figure 3 used to create an avatar representing the expert surgeon, and 3D annotations are projected onto the patient body by using AR.…”

Section: Eye-in-the-sky Viewpointmentioning

confidence: 99%

Procedural Telementoring in Rural, Underdeveloped, and Austere Settings: Origins, Present Challenges, and Future Perspectives

Wachs

Kirkpatrick

Tisherman

2021

Annu. Rev. Biomed. Eng.

View full text Add to dashboard Cite

Telemedicine is perhaps the most rapidly growing area in health care. Approximately 15 million Americans receive medical assistance remotely every year. Yet rural communities face significant challenges in securing subspecialist care. In the United States, 25% of the population resides in rural areas, where less than 15% of physicians work. Current surgery residency programs do not adequately prepare surgeons for rural practice. Telementoring, wherein a remote expert guides a less experienced caregiver, has been proposed to address this challenge. Nonetheless, existing mentoring technologies are not widely available to rural communities, due to a lack of infrastructure and mentor availability. For this reason, some clinicians prefer simpler and more reliable technologies. This article presents past and current telementoring systems, with a focus on rural settings, and proposes a set of requirements for such systems. We conclude with a perspective on the future telementoring systems and the integration of artificial intelligence within those systems. Expected final online publication date for the Annual Review of Biomedical Engineering, Volume 23 is June 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

show abstract

“…Such systems (e.g., [16,17,26,27]) present a realtime panoramic view of the local space, but often do not provide depth for virtual objects to interact with. Another approach is to recreate the local space as a pre-created 3D model (e.g., [25]) or realtime captured point cloud or 3D model (e.g., [8,28,31,32]). This method can add benefit by providing depth for the VR user to view the space from different angles.…”

Section: Background 21 Augmented Virtual Teleportation (Avt)mentioning

confidence: 99%

XRmas: Extended Reality Multi-Agency Spaces for a Magical Remote Christmas

Zhang

Jones

Rintel

et al. 2021

Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing

View full text Add to dashboard Cite

The COVID-19 pandemic has raised attention toward remote and hybrid communications. Currently, one highly-studied solution lets a remote user use virtual reality (VR) to enter an immersive view of a local space, and local users use augmented reality (AR) to see the remote user's representation and digital contents. Such systems give the remote user a sense of 'being there', but we identify two more challenges to address. First, current systems provide remote users with limited agency to control objects and influence the local space. It is necessary to further explore the relationship between users, virtual objects, and physical objects, and how they can play a role in providing richer agency. Second, current systems often try to replicate in-person experiences, but hardly surpass them. We propose XRmas: an AR/VR telepresence system that (1) provides a multi-agency space that allows a remote user to manipulate both virtual and physical objects in a local space, and (2) introduces three family activities in a Christmas context that adopt holographic animation effects to create a 'magical' experience that takes users beyond merely the feeling of 'being there'. We report on preliminary insights from the use of such a system in a remote family communication context.

show abstract

ARTEMIS: Mixed-Reality Environment for Immersive Surgical Telementoring

Cited by 27 publications

References 5 publications

Real-time Mixed Reality Teleconsultation for Intensive Care Units in Pandemic Situations

Real-time Mixed Reality Teleconsultation for Intensive Care Units in Pandemic Situations

Procedural Telementoring in Rural, Underdeveloped, and Austere Settings: Origins, Present Challenges, and Future Perspectives

XRmas: Extended Reality Multi-Agency Spaces for a Magical Remote Christmas

Contact Info

Product

Resources

About