An Augmented Reality Application for Patient Positioning and Monitoring in Radiotherapy

Talbot, James; Meyer, Juergen; Watts, Richard; Grasset, Raphaël

doi:10.1007/978-3-642-03474-9_174

Cited by 5 publications

(7 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In 2008, Talbot [15][16][17] et al proposed the application of AR in radiotherapy for the first time. A system for visual guidance in the patient's setup for external-beam radiotherapy procedures was developed by using AR.…”

Section: Discussionmentioning

confidence: 99%

Augmented reality‐guided positioning system for radiotherapy patients

et al. 2022

J Applied Clin Med Phys

View full text Add to dashboard Cite

In modern radiotherapy, error reduction in the patients’ daily setup error is important for achieving accuracy. In our study, we proposed a new approach for the development of an assist system for the radiotherapy position setup by using augmented reality (AR). We aimed to improve the accuracy of the position setup of patients undergoing radiotherapy and to evaluate the error of the position setup of patients who were diagnosed with head and neck cancer, and that of patients diagnosed with chest and abdomen cancer. We acquired the patient's simulation CT data for the three‐dimensional (3D) reconstruction of the external surface and organs. The AR tracking software detected the calibration module and loaded the 3D virtual model. The calibration module was aligned with the Linac isocenter by using room lasers. And then aligned the virtual cube with the calibration module to complete the calibration of the 3D virtual model and Linac isocenter. Then, the patient position setup was carried out, and point cloud registration was performed between the patient and the 3D virtual model, such the patient's posture was consistent with the 3D virtual model. Twenty patients diagnosed with head and neck cancer and 20 patients diagnosed with chest and abdomen cancer in the supine position setup were analyzed for the residual errors of the conventional laser and AR‐guided position setup. Results show that for patients diagnosed with head and neck cancer, the difference between the two positioning methods was not statistically significant (P > 0.05). For patients diagnosed with chest and abdomen cancer, the residual errors of the two positioning methods in the superior and inferior direction and anterior and posterior direction were statistically significant (t = −5.80, −4.98, P < 0.05). The residual errors in the three rotation directions were statistically significant (t = −2.29 to −3.22, P < 0.05). The experimental results showed that the AR technology can effectively assist in the position setup of patients undergoing radiotherapy, significantly reduce the position setup errors in patients diagnosed with chest and abdomen cancer, and improve the accuracy of radiotherapy.

show abstract

Section: Discussionmentioning

confidence: 99%

Augmented reality‐guided positioning system for radiotherapy patients

et al. 2022

J Applied Clin Med Phys

View full text Add to dashboard Cite

show abstract

“…Their system achieved realtime superimposition of a 3D path towards predefined targets on top of endoscopic images. On the same period, Fuchs, et al [18] proposed a system that obtained the 3D surface of patient's anatomy using a 3D endoscope and superimposed its virtual reconstruction on top of the real anatomy using HMD glasses instead of the typical monitor involved in laparoscopic surgery. Also targeting in MIS, Traub, et al [19] proposed a system that would help surgeons in achieving optimal port placement and intra-operative navigation in robotically assisted minimally invasive cardiovascular surgery.…”

Section: Augmented Reality In Open Surgery and Mismentioning

confidence: 99%

Surgical Simulation Training Systems: Box Trainers, Virtual Reality and Augmented Reality Simulators

Lahanas¹,

Georgiou²,

Loukas³

2016

IJARA

View full text Add to dashboard Cite

In contrast to Virtual Reality (VR) and traditional surgical training, simulation-based training in Minimally Invasive Surgery (MIS), and Augmented Reality (AR) technology, constitute relatively new application fields in surgery. However, between simulation and AR there is a direct link: the utilization of state-of-the art computer graphics tools and techniques. Nevertheless, an integrated research system that introduces AR properties in simulation-based surgical training scenarios has not yet been proposed in the current literature. In this article we provide a survey on the simulation techniques and systems employed for surgical skills training based on traditional as well as more advanced VR technologies. Moreover, we summarize recent experimental results with regard to the design of a novel ARbased simulator developed in our lab for basic skills training in MIS.

show abstract

“…To address these issues, both AR and MixR concepts have been previously suggested for this use case. Early work utilized a video‐pass through approach (as opposed to optical‐see‐through) to capture a scene and register it with a digital overlay of the patient's surface on the treatment couch 24 . The perspective, however, was fixed based on the position of the camera system and the display limited to a traditional 2D monitor.…”

Section: Introductionmentioning

confidence: 99%

“…Early work utilized a video-pass through approach (as opposed to optical-see-through) to capture a scene and register it with a digital overlay of the patient's surface on the treatment couch. 24 The perspective, however, was fixed based on the position of the camera system and the display limited to a traditional 2D monitor. The introduction of inexpensive RGB-D cameras, for example, Kinect by Microsoft, allowed researchers to experiment with marker-based and VSLAM approaches using mobile sensors.…”

Section: Introductionmentioning

confidence: 99%

Patient posture correction and alignment using mixed reality visualization and the HoloLens 2

et al. 2021

View full text Add to dashboard Cite

Purpose The purpose of this study was to develop and preliminarily test a radiotherapy system for patient posture correction and alignment using mixed reality (MixR) visualization. The write‐up of this work also provides an opportunity to introduce the concepts and technology of MixR for a medical physics audience who may be unfamiliar with the topic. Methods A MixR application was developed for on optical‐see‐through head‐mounted display (HoloLens 2) allowing a user to simultaneously and directly view a patient and a reference hologram derived from their simulation CT scan. The hologram provides a visual reference for the exact posture needed during treatment and is initialized in relation to the origin of a radiotherapy device using marker‐based tracking. The system further provides marker‐less tracking that allows the user tofreely navigate the room as they view and align the patient from various angles. The system was preliminarily tested using both a rigid (pelvis) and nonrigid (female mannequin) anthropomorphic phantom. Each phantom was aligned via hologram and accuracy quantified using CBCT and CT. Results A fully realized system was developed. Rigid registration accuracy was on the order of 3.0 ± 1.5 mm based on the performance of three users repeating alignment five times each. The lateral direction showed the most variability among users and was associated with the largest off‐sets (approximately 2.0 mm). For nonrigid alignment, the MixR setup outperformed a setup based on three‐point alignment and setup photos, the latter of which showed a difference in arm position of 2 cm and a torso roll of 6–7°. Conclusions MixR visualization is a rapidly emerging domain that has the potential to significantly impact the field of medicine. The current application is an illustration of this and highlights the advantages of MixR for patient setup in radiation oncology. The key feature of the system is the way in which it transforms nonrigid registration into rigid registration by providing an efficient, portable, and cost‐effective mechanism for reproducing patient posture without the use of ionizing radiation. Preliminary estimates of registration accuracy indicate clinical viability and form the foundation for further development and clinical testing.

show abstract

An Augmented Reality Application for Patient Positioning and Monitoring in Radiotherapy

Cited by 5 publications

References 9 publications

Augmented reality‐guided positioning system for radiotherapy patients

Augmented reality‐guided positioning system for radiotherapy patients

Surgical Simulation Training Systems: Box Trainers, Virtual Reality and Augmented Reality Simulators

Patient posture correction and alignment using mixed reality visualization and the HoloLens 2

Contact Info

Product

Resources

About