Touchless interaction in surgery

O’Hara, Kenton; González, Gerardo; Sellen, Abigail; Penney, Graeme P.; Varnavas, Andreas; Mentis, Helena M.; Criminisi, Antonio; Corish, Robert; Rouncefield, Mark; Dastur, Neville; Carrell, Tom

doi:10.1145/2541883.2541899

Cited by 119 publications

(76 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Touchless manipulation of medical images allows surgeons to maintain the sterile environment required in surgery, without the help of assistants [51]. Another example is driving; today there are many dashboard panels that allow users to control car elements from a distance [2,29].…”

Section: Touchless Systemsmentioning

confidence: 99%

“…For example, touchless interactions are being explored as part of medical surgery [51], to design games that benefit children with Autism Spectrum Disorder (ASD) [4], and touchless controllers for car dashboards [2](see Figure 1). There is a strong user appetite for such systems as they are intuitive and enable greater freedom of user-movements.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Agency in Mid-air Interfaces

Cornelio

Pirro

Thanh

et al. 2017

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Touchless interfaces allow users to view, control and manipulate digital content without physically touching an interface. They are being explored in a wide range of application scenarios from medical surgery to car dashboard controllers. One aspect of touchless interaction that has not been explored to date is the Sense of Agency (SoA). The SoA refers to the subjective experience of voluntary control over actions in the external world. In this paper, we investigated the SoA in touchless systems using the intentional binding paradigm. We first compare touchless systems with physical interactions and then augmented different types of haptic feedback to explore how different outcome modalities influence users' SoA.From our experiments, we demonstrated that an intentional binding effect is observed in both physical and touchless interactions with no statistical difference. Additionally, we found that haptic and auditory feedback help to increase SoA compared with visual feedback in touchless interfaces. We discuss these findings and identify design opportunities that take agency into consideration.

show abstract

Section: Touchless Systemsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Agency in Mid-air Interfaces

Cornelio

Pirro

Thanh

et al. 2017

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…The use of a physical barrier between the surgeon's gloves and the interaction device [7], or using the foot for manipulation, are not practical solutions either, because they do not allow fine interaction and carry risks of contamination [8]. Moreover, using a person to manipulate the images following verbal instructions from the surgeon has proven to be difficult and prone to generate misunderstandings when requesting visualization of specific areas of the image [9,10].…”

Section: Introductionmentioning

confidence: 99%

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Alvarez-Lopez¹,

Maina²,

Saigí-Rubió³

2018

Preprint

View full text Add to dashboard Cite

Background. The increasingly pervasive presence of technology in the operating room (OR) raises the need to study the interaction between the surgeon and the computer system. A new generation of tools known as commercial off-the-shelf (COTS) devices that enable non-contact gesture-based human-computer interaction (HCI) are currently being explored as a solution in surgical environments. The aim of this systematic review was to provide an account of the state-of-the-art of COTS devices in the detection of manual gestures in surgery, and to identify their use as a simulation tool for teaching motor skills in minimally invasive surgery (MIS). Methods. A systematic literature review was conducted in PubMed, Embase, ScienceDirect and IEEE for articles published between January 2000 and 2016 on the use of COTS devices for gesture detection in surgical environments, and in simulation for surgical skills learning in MIS. Results. A total of 2709 studies were identified, 76 of which met the search selection criteria. The Microsoft KinectTM and the Leap Motion ControllerTM were the most widely used COTS devices. The most common intervention was image manipulation in surgical and interventional radiology environments, followed by interaction with virtual reality environments for educational or interventional purposes; the possibility of using this technology to develop portable, low-cost simulators for skills learning in MIS was also examined. Given that the vast majority of articles found in this systematic review were proof-of-concept or prototype user and feasibility testing, we can conclude that this is a field that is still in the exploration phase in areas that require touchless manipulation in environments and settings that must adhere to asepsis and antisepsis protocols, such as angiography suites and operating rooms. Conclusions: COTS devices applied to hand and instrument GBIs in the field of simulation for skills learning and training in MIS could open up a promising field to achieve the ubiquitous training and pre-surgical warm-up.

show abstract

“…Invoked reality (IR) has been the focus of many studies on loading virtual world content into the real world using a variety of natural user interface (NUI) technologies [1,2,6,8,12,14]. The IR space enables users to interact based on diverse types of content.…”

Section: Introductionmentioning

confidence: 99%

Design and implementation of a same-user identification system in invoked reality space

Jung

Cho

et al. 2016

Multimed Tools Appl

View full text Add to dashboard Cite

The objective of this study is to solve the problem of user data not being precisely received from sensors because of sensing region limitations in invoked reality (IR) space, distortion of colors or patterns by lighting, and blocking or overlapping of a user by other users. The sensing scope range is thus expanded using multiple sensors in the IR space. Moreover, user feature data are accurately identified by user sensing. Specifically, multiple sensors are employed when not all of user data are sensed because they overlap with data of other users. In the proposed approach, all clients share the user feature data from multiple sensors. Accordingly, each client recognizes that the user is the same individual on the basis of the shared data. Furthermore, the identification accuracy is improved by identifying the user features based on colors and patterns that are less affected by lighting. Therefore, accurate identification of the user feature data is enabled, even under lighting changes. The proposed system was implemented based on system performance analysis standards. The practicality and system performance in identifying the same person using the proposed method were verified through an experiment.

show abstract

Touchless interaction in surgery

Abstract: Touchless interaction with medical images lets surgeons maintain sterility during surgical procedures.

Cited by 119 publications

References 14 publications

Agency in Mid-air Interfaces

Agency in Mid-air Interfaces

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Design and implementation of a same-user identification system in invoked reality space

Contact Info

Product

Resources

About