From Déjà vu to Déjà vécu: Reliving Surgery in Post-Operative Debriefing

Maria, Sophie Di; Lambert, Solene; Avellino, Ignacio

doi:10.1109/vrw55335.2022.00102

Cited by 3 publications

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…AR-HMDs are a promising playground in this exploration, as they are a powerful computational media for providing complex and dynamic output visualizations. These future avenues of research can expand beyond telecollaboration (during surgery), for instance supporting visualization of past events in mixed reality during post-operative debriefng [28].…”

Section: Further Exploration Of Ar-hmds In Surgical Teleconsultingmentioning

confidence: 99%

Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted Displays

Maria

Mentis

Canlorbe

et al. 2023

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

Although Augmented Reality (AR) has been touted as the future of surgery, its contribution to distributed collaboration such as in surgical teleconsulting has not been articulated. We propose AR-Head Mounted Displays (AR-HMD) to tackle two previously-identifed challenges: operating surgeons needing to view and interact with imaging systems that reside away from the operative feld, and, their lack of gesturing tools to point and annotate on the shared images and physical environment. We report on a controlled lab experiment where 12 expert gynecology surgeons perform a tumor localisation task guided by a remote radiologist (confederate) via an AR-HMD. We fnd that bringing the shared images to the place of work reduces the need for clarifcations and provides opportunistic access to information when required, and, that pointing and annotating provides opportunities to further support verbal instruction in deictic communication. Our results inform the design of intraoperative AR-HMD systems for surgical telecollaboration.

show abstract

Section: Further Exploration Of Ar-hmds In Surgical Teleconsultingmentioning

confidence: 99%

Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted Displays

Maria

Mentis

Canlorbe

et al. 2023

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

show abstract

HoloMentor

Seo

Avellino

Rajasagi

et al. 2022

Proc. ACM Hum.-Comput. Interact.

View full text Add to dashboard Cite

The introduction of Augmented Reality (AR) Head Mounted Displays (HMDs) in collaboration between remote and local workers, introduces new challenges given that camera views are now mobile. We introduce HoloMentor, an AR HMD-based collaborative system designed for remote instruction over live mobile views during physical tasks. Through Actionport, we provide a world-stabilized area where remote helpers can dynamically place a pointer and annotations on the physical environment. Through Actionpad, we provide an indirect input mechanism with an absolute position to the Actionport. We show how these innovations worked for participants engaged in a remote instructional task and how they supported effective and efficient communication. Finally, we provide the next steps for addressing AR on mobile views for remote instruction.

show abstract

Learning With Pedagogical Models: Videos As Adjuncts to Apprenticeship for Surgical Training

Ferrier-Barbut¹,

Avellino

Canlorbe

et al. 2023

Proc. ACM Hum.-Comput. Interact.

View full text Add to dashboard Cite

Videos are a powerful media to learn activities through guided physical training such as surgery, especially when they are produced following human learning models and not as "how-to" videos. However, their success greatly depends on how they are integrated into the extensive curricula of domains where learning occurs through guided practice. In this work, we investigate the impact of integrating video as a learning tool into the learning curricula of surgery. We created a pedagogical video on surgical hysterectomy through a model based on the Conceptual Fields theory (Vergnaud) and performed two rounds of interviews with seven medical residents, who watched the video freely during their residency in gynecology-obstetrics as they trained with experts. We find that videos can complement guided physical training, as they can provide the rationale behind expert action, something that is difficult to explicit during guided training. Still, their linear and static nature limits their integration as true adjuncts. We discuss our vision of moving towards interactive videos created with an ontological approach, developed in a workshop with four expert surgeons, which involves the ability to navigate through levels of information and layers of representations, so that experts can represent information to learners according to pedagogical models that complement their complex and extensive learning curricula.

show abstract

From Déjà vu to Déjà vécu: Reliving Surgery in Post-Operative Debriefing

Cited by 3 publications

References 22 publications

Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted Displays

Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted Displays

HoloMentor

Learning With Pedagogical Models: Videos As Adjuncts to Apprenticeship for Surgical Training

Contact Info

Product

Resources

About