3D selection with freehand gesture

Ren, Gang; O’Neill, Eamonn

doi:10.1016/j.cag.2012.12.006

Cited by 88 publications

(71 citation statements)

References 54 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Only five (12%) of the 42 studies that evaluated the MK identified disadvantages related with a longer latency time, difficulty in recreating an image when compared with a keyboard or mouse [6], limited gesture recognition, interference between the movements of different people in environments with small areas [71,77,107], and the preference of users for the mouse in a comparative study [46]. Various studies have highlighted the inaccuracy of the MK in detecting finger movements [6,19,77,110], and the system also requires the use of large format screens [14,23,58,77,81].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Alvarez-Lopez¹,

Maina²,

Saigí-Rubió³

2018

Preprint

View full text Add to dashboard Cite

Background. The increasingly pervasive presence of technology in the operating room (OR) raises the need to study the interaction between the surgeon and the computer system. A new generation of tools known as commercial off-the-shelf (COTS) devices that enable non-contact gesture-based human-computer interaction (HCI) are currently being explored as a solution in surgical environments. The aim of this systematic review was to provide an account of the state-of-the-art of COTS devices in the detection of manual gestures in surgery, and to identify their use as a simulation tool for teaching motor skills in minimally invasive surgery (MIS). Methods. A systematic literature review was conducted in PubMed, Embase, ScienceDirect and IEEE for articles published between January 2000 and 2016 on the use of COTS devices for gesture detection in surgical environments, and in simulation for surgical skills learning in MIS. Results. A total of 2709 studies were identified, 76 of which met the search selection criteria. The Microsoft KinectTM and the Leap Motion ControllerTM were the most widely used COTS devices. The most common intervention was image manipulation in surgical and interventional radiology environments, followed by interaction with virtual reality environments for educational or interventional purposes; the possibility of using this technology to develop portable, low-cost simulators for skills learning in MIS was also examined. Given that the vast majority of articles found in this systematic review were proof-of-concept or prototype user and feasibility testing, we can conclude that this is a field that is still in the exploration phase in areas that require touchless manipulation in environments and settings that must adhere to asepsis and antisepsis protocols, such as angiography suites and operating rooms. Conclusions: COTS devices applied to hand and instrument GBIs in the field of simulation for skills learning and training in MIS could open up a promising field to achieve the ubiquitous training and pre-surgical warm-up.

show abstract

Section: Discussionmentioning

confidence: 99%

“…One variant is gesture-based interfaces (GBI) [15], which manipulated using the hands without contact and promised to be a viable solution in ORs and autopsy suites [10,[16][17][18][19]. However, they could not be used in sterile environments, since they required contact when gloves or position sensors were used [20][21][22][23][24].…”

Section: Introductionmentioning

confidence: 99%

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Alvarez-Lopez¹,

Maina²,

Saigí-Rubió³

2018

Preprint

View full text Add to dashboard Cite

show abstract

“…There is a great amount of previous research on object and option selection in both 2D and 3D interfaces. However, most previous research used hand-held tracked devices or fiducial markers to enable camera-based tracking [6].…”

Section: Related Workmentioning

confidence: 99%

“…Traditional desktop interaction approaches, typically based on devices such as keyboard and mouse and touch pad interfaces, are often designed for 2D interfaces and consequently are less effective and usable for 3D interaction [6]. In addition, many of the techniques that are used for 3D interaction require the user to wear or hold 3D tracking devices and also require several markers attached to the user's hand or body.…”

Section: Introductionmentioning

confidence: 99%

A hand gestural interaction system for handling a desktop haptic strip for shape rendering

Covarrubias

Bordegoni

Cugini

2015

Sensors and Actuators A: Physical

View full text Add to dashboard Cite

“…Therefore, hand-gesture-based methods stand out from other approaches by providing a natural way of interaction and communication [1]. Many studies evaluate gesture-based interaction techniques, their drawbacks, and propose ways to increase their effectiveness [2,3,4].…”

Section: Introductionmentioning

confidence: 99%

A hand gesture recognition technique for human–computer interaction

Kılıboz

Güdükbay

2015

Journal of Visual Communication and Image Representation

View full text Add to dashboard Cite

We propose an approach to recognize trajectory-based dynamic hand gestures in real time for human-computer interaction (HCI). We also introduce a fast learning mechanism that does not require extensive training data to teach gestures to the system. We use a six-degrees-of-freedom position tracker to collect trajectory data and represent gestures as an ordered sequence of directional movements in 2D. In the learning phase, sample gesture data is filtered and processed to create gesture recognizers, which are basically finitestate machine sequence recognizers. We achieve online gesture recognition by these recognizers without needing to specify gesture start and end positions. The results of the conducted user study show that the proposed method is very promising in terms of gesture detection and recognition performance (73 % accuracy) in a stream of motion. Additionally, the assessment of the user attitude survey denotes that the gestural interface is very useful and satisfactory. One of the novel parts of the proposed approach is that it gives users the freedom to create gesture commands according to their preferences for selected tasks. Thus, the presented gesture recognition approach makes the HCI process more intuitive and user specific.

show abstract

3D selection with freehand gesture

Cited by 88 publications

References 54 publications

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

Use of commercial off-the-shelf devices for detection of manual gestures in surgery. A Systematic Literature Review (Preprint)

A hand gestural interaction system for handling a desktop haptic strip for shape rendering

A hand gesture recognition technique for human–computer interaction

Contact Info

Product

Resources

About