FAce MOUSe: a novel human-machine interface for controlling the position of a laparoscope

Nishikawa, Atsushi; Hosoi, Takahiro; Koara, Kengo; Negoro, Daiji; Hikita, A.; Asano, Shotaro; Kakutani, Haruhiko; Miyazaki, Fumio; Sekimoto, Mitsugu; Yasui, Masayoshi; Miyake, Yasuhiro; Takiguchi, Shuji; Monden, Morito

doi:10.1109/tra.2003.817093

Cited by 118 publications

(34 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…11,12 One group has reported moderate success tracking the surgeon's face to help control a laparoscope. 13 Solutions to a related but independent problem, using gestural interfaces to improve radiologists' ability to navigate imaging, have also been proposed using commercially available, nonsterilizable hardware, such as the 5DT DataGlove 14 and a controller for the Nintendo Wii. 15 We saw the possibility of another approach with the 2010 introduction of the Xbox Kinect by Microsoft.…”

Section: Discussionmentioning

confidence: 99%

Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field

Strickland

Tremaine²,

Brigley³

et al. 2013

Can J Surg

View full text Add to dashboard Cite

E1 RESEARCH • RECHERCHEUsing a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field Background: As surgical procedures become increasingly dependent on equipment and imaging, the need for sterile members of the surgical team to have unimpeded access to the nonsterile technology in their operating room (OR) is of growing import ance. To our knowledge, our team is the first to use an inexpensive infrared depthsensing camera (a component of the Microsoft Kinect) and software developed inhouse to give surgeons a touchless, gestural interface with which to navigate their picture archiving and communication systems intraoperatively. Methods:The system was designed and developed with feedback from surgeons and OR personnel and with consideration of the principles of aseptic technique and gestural controls in mind. Simulation was used for basic validation before trialing in a pilot series of 6 hepatobiliary-pancreatic surgeries. Results:The interface was used extensively in 2 laparoscopic and 4 open procedures. Surgeons primarily used the system for anatomic correlation, real-time comparison of intraoperative ultrasound with preoperative computed tomography and magnetic resonance imaging scans and for teaching residents and fellows.

show abstract

Section: Discussionmentioning

confidence: 99%

Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field

Strickland

Tremaine²,

Brigley³

et al. 2013

Can J Surg

View full text Add to dashboard Cite

show abstract

“…The "come as you are" requirement is addressed in FAce MOUSe [23], where a surgeon can control the motion of the laparoscope by simply making the appropriate face gesture, without hand or foot switches or voice input. Current research to incorporate hand gestures into doctor-computer interfaces has appeared in Graetzel et al [24].…”

Section: Hand Gesture Recognition In Healthcarementioning

confidence: 99%

Gaze, Posture and Gesture Recognition to Minimize Focus Shifts for Intelligent Operating Rooms in a Collaborative Support System

Wachs

2010

INT J COMPUT COMMUN

View full text Add to dashboard Cite

This paper describes the design of intelligent, collaborative operating rooms based on highly intuitive, natural and multimodal interaction. Intelligent operating rooms minimize surgeon's focus shifts by minimizing both the focus spatial offset (distance moved by surgeon's head or gaze to the new target) and the movement spatial offset (distance surgeon covers physically). These spatio-temporal measures have an impact on the surgeon's performance in the operating room. I describe how machine vision techniques are used to extract spatio-temporal measures and to interact with the system, and how computer graphics techniques can be used to display visual medical information effectively and rapidly. Design considerations are discussed and examples showing the feasibility of the different approaches are presented.

show abstract

“…The system configuration is shown in Figure 4. Our laparoscope positioning system consists primarily of an optical 3D measurement system (Polaris Accedo, NDI Corporation), an all-purpose PC (CPU: Intel R Core 2 Duo E6600 2.4GHz, Memory: 2GB, OS: Vine Linux 4.0), a robot manipulator with three degrees-of-freedom that holds the laparoscope (for details, see [8]), a scan converter (DSC06d-HR, Digital Arts Corporation) for superimposing graphics on the scope image, and a 21-inch TV monitor. Initially in this system, DISTANCE is set as the base distance d 0 , and the position of the laparoscope is controlled by the following algorithm (referred to as "Proposed") under the condition that DISTANCE is kept within [d min , d max ].…”

Section: Robot System Overviewmentioning

confidence: 99%

How Does the Camera Assistant Decide the Zooming Ratio of Laparoscopic Images? Analysis and Implementation

Nishikawa

Nakagoe

Taniguchi

et al. 2008

Medical Image Computing and Computer-Assisted Intervention – MICCAI 2008

View full text Add to dashboard Cite

Abstract. An important factor for defining a good image during laparoscopic surgery is the zooming ratio, which corresponds to the depth of insertion of the laparoscope along its longitudinal axis. However, it is not clear how surgeons (camera assistants) decide the zooming ratio of laparoscopic images during surgery. Conventional automatic camera positioning systems define the zooming ratio "uniformly" based on simple heuristics. However, because the most adequate zooming ratio varies widely during surgery, these conventional systems may not offer the specific view that the surgeon wants. Therefore, we first investigated how the camera assistant decides the zooming ratio of laparoscopic images by fully analyzing the positional relationship between the laparoscope and the surgical instrument during laparoscopic surgery. Then, we extracted the zooming behavior and implemented it in the robotic laparoscope positioner that we previously developed. As a result, the zooming behavior of our robotic system became very similar to that of the human camera assistant. It was found that the proposed zooming motion of our robotic system may be suitable for fast and compact operations during surgery.

show abstract

FAce MOUSe: a novel human-machine interface for controlling the position of a laparoscope

Cited by 118 publications

References 18 publications

Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field

Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field

Gaze, Posture and Gesture Recognition to Minimize Focus Shifts for Intelligent Operating Rooms in a Collaborative Support System

How Does the Camera Assistant Decide the Zooming Ratio of Laparoscopic Images? Analysis and Implementation

Contact Info

Product

Resources

About