Head-Mounted Display for a Personal Integrated Image Monitoring System: Ureteral Stent Placement

Yoshida, Soichiro; Kihara, Kazunori; Takeshita, Hideki; Nakanishi, Yasukazu; Kijima, Toshiki; Ishioka, Junichiro; Matsuoka, Yoh; Numao, Noboru; Saito, Kazutaka; Fujii, Yasuhisa

doi:10.1159/000356987

Cited by 21 publications

(15 citation statements)

References 10 publications

(11 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Multiple and shared vision can be provided by using a signal changer. The HMD can display multiple informations from several imaging sources, and this can also be delivered to many participants simultaneously (4). Navigation with composite images, such as fluoroscopic images and NBI images, make it easier for surgeons to perform various procedures.…”

Section: Commentsmentioning

confidence: 99%

New head-mounted display system applied to endoscopic management of upper urinary tract carcinomas

et al. 2014

Self Cite

View full text Add to dashboard Cite

ARTICLE INFO ______________________________________________________________ ______________________Purpose: We tested a new head-mounted display (HMD) system for surgery on the upper urinary tract. Surgical Technique: Four women and one man with abnormal findings in the renal pelvis on computed tomography and magnetic resonance imaging underwent surgery using this new system. A high definition HMD (Sony, Tokyo, Japan) is connected to a flexible ureteroscope (Olympus, Tokyo, Japan) and the images from the ureteroscope are delivered simultaneously to various participants wearing HMDs. Furthermore, various information in addition to that available through the endoscope, such as the narrow band image, the fluoroscope, input from a video camera mounted on the lead surgeon's HMD and the vital monitors can be viewed on each HMD. Results: Median operative duration and anesthesia time were 53 and 111 minutes, respectively. The ureteroscopic procedures were successfully performed in all cases. There were no notable negative outcomes or incidents (Clavien-Dindo grade ≥1). Conclusion:The HMD system offers simultaneous, high-quality magnified imagery in front of the eyes, regardless of head position, to those participating in the endoscopic procedures. This affordable display system also provides various forms of information related to examinations and operations while allowing direct vision and navigated vision.

show abstract

Section: Commentsmentioning

confidence: 99%

New head-mounted display system applied to endoscopic management of upper urinary tract carcinomas

et al. 2014

Self Cite

View full text Add to dashboard Cite

show abstract

“…The classification is summarized in Table 1. Based on the classification, the use cases of HMDs for mixed reality interventions mainly fall into four categories: VST-HMD with head-anchored 2D-display [10,16,20,24,33,41], OST-HMD with head-anchored 2D-display [2,3,25,29,40], VST-HMD with object-anchored 3D-object [1,4–6,8,21], and OST-HMD with object-anchored 3D-object [7,37]. …”

Section: Introductionmentioning

confidence: 99%

Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

et al. 2017

View full text Add to dashboard Cite

Purpose Optical see-through head-mounted displays (OST-HMD) feature an unhindered and instantaneous view of the surgery site and can enable a mixed reality experience for surgeons during procedures. In this paper, we present a systematic approach to identify the criteria for evaluation of OST-HMD technologies for specific clinical scenarios, which benefit from using an object-anchored 2D-display visualizing medical information. Methods Criteria for evaluating the performance of OST-HMDs for visualization of medical information and its usage are identified and proposed. These include text readability, contrast perception, task load, frame rate, and system lag. We choose to compare three commercially available OST-HMDs, which are representatives of currently available head-mounted display technologies. A multi-user study and an offline experiment are conducted to evaluate their performance. Results Statistical analysis demonstrates that Microsoft HoloLens performs best among the three tested OST-HMDs, in terms of contrast perception, task load, and frame rate, while ODG R-7 offers similar text readability. The integration of indoor localization and fiducial tracking on the HoloLens provides significantly less system lag in a relatively motionless scenario. Conclusions With ever more OST-HMDs appearing on the market, the proposed criteria could be used in the evaluation of their suitability for mixed reality surgical intervention. Currently, Microsoft HoloLens may be more suitable than ODG R-7 and Epson Moverio BT-200 for clinical usability in terms of the evaluated criteria. To the best of our knowledge, this is the first paper that presents a methodology and conducts experiments to evaluate and compare OST-HMDs for their use as object-anchored 2D-display during interventions.

show abstract

“…We have reported the clinical applications of our newly developed personal integrated image monitoring system using a multiplexer and an HMD to urological procedures as an image monitoring system for surgical navigation [2][3][4] . This novel imaging system allows wearers to simultaneously and seamlessly monitor multiple streams of imaging information through the HMD.…”

Section: Introductionmentioning

confidence: 99%

Multitask Imaging Monitor for Surgical Navigation: Combination of Touchless Interface and Head-Mounted Display

Yoshida

Ito²,

Tatokoro³

et al. 2015

Urol Int

Self Cite

View full text Add to dashboard Cite

As a result of the dramatic improvements in the resolution, wearability, and weight of head-mounted displays (HMDs), they have become increasingly applied in the medical field as personal imaging monitors. The combined use of a multiplexer with an HMD allows the wearer to simultaneously and seamlessly monitor multiple streams of imaging information through the HMD. We developed a multitask imaging monitor for surgical navigation by combining a touchless surgical imaging control system with an HMD. This system is composed of a standard color digital video camera mounted on the HMD and computer software that enables the identification of the number of pictured fingertips from the video camera image. The HMD wearer uses this information as a touchless interface for the operating multiplexer, which can control the arrays and types of imaging information displayed on the HMD. We used this system in an experimental demonstration during a single-port gasless partial nephrectomy. The use of this multitask imaging monitor using a touchless interface would refine the surgical workflow, especially during surgical navigation.

show abstract

Head-Mounted Display for a Personal Integrated Image Monitoring System: Ureteral Stent Placement

Cited by 21 publications

References 10 publications

New head-mounted display system applied to endoscopic management of upper urinary tract carcinomas

New head-mounted display system applied to endoscopic management of upper urinary tract carcinomas

Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

Multitask Imaging Monitor for Surgical Navigation: Combination of Touchless Interface and Head-Mounted Display

Contact Info

Product

Resources

About