Touchless interaction with software in interventional radiology and surgery: a systematic literature review

Mewes, André; Hensen, Bennet; Wacker, Frank; Hansen, Christian

doi:10.1007/s11548-016-1480-6

Cited by 91 publications

(56 citation statements)

References 68 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While different in scope and focus, several of the findings presented in this article are supported by the recent independently conducted review of touchless interaction in the OR and interventional radiology by Mewes et al 42 Major themes in their analysis echo the conclusions presented in this article regarding recent improvements in the feasibility of touchless control; the need for improved evaluations; the need to improve usability, including issues surrounding accuracy and unintended gestures; and the potential of multimodal interaction to address some of the practical difficulties in making these systems appropriate for deployment. With regard to best practice, these findings support careful consideration of usability in the design of touchless systems, using multimodal input to support clutching, using realistic tasks and conducting larger studies with representative HCWs.…”

Section: Best Practicesupporting

confidence: 67%

Touchless computer interfaces in hospitals: A review

Cronin¹,

Doherty

2018

Health Informatics J

View full text Add to dashboard Cite

The widespread use of technology in hospitals and the difficulty of sterilising computer controls has increased opportunities for the spread of pathogens. This leads to an interest in touchless user interfaces for computer systems. We present a review of touchless interaction with computer equipment in the hospital environment, based on a systematic search of the literature. Sterility provides an implied theme and motivation for the field as a whole, but other advantages, such as hands-busy settings, are also proposed. Overcoming hardware restrictions has been a major theme, but in recent research, technical difficulties have receded. Image navigation is the most frequently considered task and the operating room the most frequently considered environment. Gestures have been implemented for input, system and content control. Most of the studies found have small sample sizes and focus on feasibility, acceptability or gesture-recognition accuracy. We conclude this article with an agenda for future work.

show abstract

Section: Best Practicesupporting

confidence: 67%

Touchless computer interfaces in hospitals: A review

Cronin¹,

Doherty

2018

Health Informatics J

View full text Add to dashboard Cite

show abstract

“…3 Apart from covering input devices with sterile plastic sheeting, researchers and medical technology companies have explored several alternative input methods, summarized in the concept of a "Contactless Operating Room." 4,5 The use of hand gestures is an established way of interacting with software in a sterile environment 6 and their usage seems to be favorable compared to relaying verbal instructions to a nonsterile assistant. 7 In the past, different methods of gesture recognition have been proposed and tested, ranging from the use of specialized hardware, like time of light cameras, down to regular off-the-shelf computer hardware.…”

Section: Background and Significancementioning

confidence: 99%

Evaluating Usability of a Touchless Image Viewer in the Operating Room

Bockhacker

Syrek²,

Elster³

et al. 2020

Appl Clin Inform

View full text Add to dashboard Cite

Background Availability of patient-specific image data, gathered from preoperatively conducted studies, like computed tomography scans and magnetic resonance imaging studies, during a surgical procedure is a key factor for surgical success and patient safety. Several alternative input methods, including recognition of hand gestures, have been proposed for surgeons to interact with medical image viewers during an operation. Previous studies pointed out the need for usability evaluation of these systems. Objectives We describe the accuracy and usability of a novel software system, which integrates gesture recognition via machine learning into an established image viewer. Methods This pilot study is a prospective, observational trial, which asked surgeons to interact with software to perform two standardized tasks in a sterile environment, modeled closely to a real-life situation in an operating room. To assess usability, the validated “System Usability Scale” (SUS) was used. On a technical level, we also evaluated the accuracy of the underlying neural network. Results The neural network reached 98.94% accuracy while predicting the gestures during validation. Eight surgeons with an average of 6.5 years of experience participated in the usability study. The system was rated on average with 80.25 points on the SUS. Conclusion The system showed good overall usability; however, additional areas of potential improvement were identified and further usability studies are needed. Because the system uses standard PC hardware, it made for easy integration into the operating room.

show abstract

“…Using touchless interaction overcomes this usability disadvantage and hence is a broad research field. 7 For example, touchless interaction techniques have been evaluated to navigate and manipulate magnetic resonance images by capture and recognition of hand gestures 8 or using the Microsoft Kinect system. [9][10][11] Johnson et al explored the potential for touchless interaction in image-guided interventional radiology.…”

Section: Introductionmentioning

confidence: 99%