Looking Together ≠ Seeing the Same Thing: Understanding Surgeons' Visual Needs During Intra-operative Coordination and Instruction

Popov, Vitaliy; Chen, Xinyue; Wang, Jingying; Kemp, Michael; Sandhu, Gurjit; Kantor, Taylor; Mateju, Natalie; Wang, Xu

doi:10.1145/3613904.3641929

Search citation statements

Order By: Relevance

Paper Sections

Select...

Introduction1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Other1

Relationship

Self Cite1

Independent0

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 53 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Learning of surgery videos, specifically laparoscopic surgeries, is a highly visual experience [67]. Surgical trainees need to acquire skills including analyzing the patient's anatomical structures, making operation decisions based on the patient's anatomy, and placing and using surgical tools.…”

Section: Introductionmentioning

confidence: 99%

Surgment: Segmentation-enabled Semantic Search and Creation of Visual Question and Feedback to Support Video-Based Surgery Learning

Wang,

Tang,

Kantor

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

Figure 1: Overview of Surgment, a web-based system that helps expert surgeons create visual questions and feedback based on surgery videos to enhance video-based surgery learning. 1○ Surgment is powered by a surgery scene segmentation pipeline (SegGPT+SAM), which generates an accurate understanding of the surgery scene composition. Based on the scene segmentation result, Surgment has two key design features, namely 2 ○ A search-by-mask tool, which enables surgeons to quickly identify image frames by adjusting the position, size, and shape of the masks. 3 ○ A quiz-maker tool, which enables surgeons to create visual questions and feedback that target specific anatomical structures and surgical tools.

show abstract

Section: Introductionmentioning

confidence: 99%