Gaze, Posture and Gesture Recognition to Minimize Focus Shifts for Intelligent Operating Rooms in a Collaborative Support System

Abstract

This paper describes the design of intelligent, collaborative operating rooms based on highly intuitive, natural and multimodal interaction. Intelligent operating rooms minimize surgeon's focus shifts by minimizing both the focus spatial offset (distance moved by surgeon's head or gaze to the new target) and the movement spatial offset (distance surgeon covers physically). These spatio-temporal measures have an impact on the surgeon's performance in the operating room. I describe how machine vision techniques are used to extract spatio-temporal measures and to interact with the system, and how computer graphics techniques can be used to display visual medical information effectively and rapidly. Design considerations are discussed and examples showing the feasibility of the different approaches are presented.

Pattern Searching in a Social Network

“…Pattern recognition plays an important role in various application areas [16]. In this paper, we present a system that can be used to find patterns in a social network using geometric hashing.…”

Professional Natural Interfaces for Medicine Applications

“…There are very interesting published over the past two decades. The close problem statements are contained in [1,2,3,4,5]. In these papers a way to assess the quality of the medicine sterile interfaces is given.…”

Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field

“…These latter gestures are essential to ensure no commands are sent inadvertently while the team is operating -a requirement discussed by previous investigators. 6,20 Pilot clinical study…”