Ultrasound training simulator using augmented reality glasses: an accuracy and precision assessment study

Costa, Jose N; Gomes‐Fonseca, João; Valente, Simao; Ferreira, Luis; Oliveira, Bruno; Torres, Helena R.; Morais, Pedro; Alves, Victor; Vilaça, João L.

doi:10.1109/embc48229.2022.9871406

Cited by 5 publications

(3 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In an attempt to offer physicians a more accessible US training solution, Costa et al addressed the problem that conventional simulators require special hardware and developed a HoloLens application that tracks a QR code attached to a Clarius ( , accessed on 27 December 2022) wireless US probe [ 9 ]. Tracked US probe movements are then fed into simulation software that runs on an external computer, which returns an aligned US slice to the HoloLens at the location of the tracked QR code.…”

Section: State Of the Artmentioning

confidence: 99%

CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording

et al. 2022

View full text Add to dashboard Cite

Obstetric ultrasound (US) training teaches the relationship between foetal anatomy and the viewed US slice to enable navigation to standardised anatomical planes (head, abdomen and femur) where diagnostic measurements are taken. This process is difficult to learn, and results in considerable inter-operator variability. We propose the CAL-Tutor system for US training based on a US scanner and phantom, where a model of both the baby and the US slice are displayed to the trainee in its physical location using the HoloLens 2. The intention is that AR guidance will shorten the learning curve for US trainees and improve spatial awareness. In addition to the AR guidance, we also record many data streams to assess user motion and the learning process. The HoloLens 2 provides eye gaze, head and hand position, ARToolkit and NDI Aurora tracking gives the US probe positions and an external camera records the overall scene. These data can provide a rich source for further analysis, such as distinguishing expert from novice motion. We have demonstrated the system in a sample of engineers. Feedback suggests that the system helps novice users navigate the US probe to the standard plane. The data capture is successful and initial data visualisations show that meaningful information about user behaviour can be captured. Initial feedback is encouraging and shows improved user assessment where AR guidance is provided.

show abstract

Section: State Of the Artmentioning

confidence: 99%

CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording

et al. 2022

View full text Add to dashboard Cite

show abstract

“…These innovations reshape healthcare capabilities on a broader scale [8][9][10]. Beyond the clinic, these technologies extend into education, offering possibilities for online training [11,12] and interactive learning experiences [9,13]. They transcend treatment confines, influencing patient rehabilitation and advancing comprehensive healthcare [10].…”

Section: Introductionmentioning

confidence: 99%

Current Trends and Beyond Conventional Approaches: Advancements in Breast Cancer Surgery through Three-Dimensional Imaging, Virtual Reality, Augmented Reality, and the Emerging Metaverse

Żydowicz,

Skokowski,

Marano

et al. 2024

JCM

View full text Add to dashboard Cite

Breast cancer stands as the most prevalent cancer globally, necessitating comprehensive care. A multidisciplinary approach proves crucial for precise diagnosis and treatment, ultimately leading to effective disease management. While surgical interventions continue to evolve and remain integral for curative treatment, imaging assumes a fundamental role in breast cancer detection. Advanced imaging techniques not only facilitate improved diagnosis but also contribute significantly to the overall enhancement of breast cancer management. This review article aims to provide an overview of innovative technologies such as virtual reality, augmented reality, and three-dimensional imaging, utilized in the medical field to elevate the diagnosis and treatment of breast cancer. Additionally, the article delves into an emerging technology known as the metaverse, still under development. Through the analysis of impactful research and comparison of their findings, this study offers valuable insights into the advantages of each innovative technique. The goal is to provide physicians, surgeons, and radiologists with information on how to enhance breast cancer management.

show abstract

“…This system uses QR codes to locate a mannequin, place a 3D rendering of the internal organs, a US probe, and the puncture needle to provide the best puncture path for the user. In 2022, Kashiwagi et al [ 20 ], Nguyen et al [ 21 ] and our previous work [ 22 ] experimented with AR glasses as a visualization tool for US images. These solutions only display the US images in the user’s field of view.…”

Section: Introductionmentioning

confidence: 99%

Augmented Reality-Assisted Ultrasound Breast Biopsy

Costa

Ferreira

Araújo

et al. 2023

Sensors

Self Cite

View full text Add to dashboard Cite

Breast cancer is the most prevalent cancer in the world and the fifth-leading cause of cancer-related death. Treatment is effective in the early stages. Thus, a need to screen considerable portions of the population is crucial. When the screening procedure uncovers a suspect lesion, a biopsy is performed to assess its potential for malignancy. This procedure is usually performed using real-time Ultrasound (US) imaging. This work proposes a visualization system for US breast biopsy. It consists of an application running on AR glasses that interact with a computer application. The AR glasses track the position of QR codes mounted on an US probe and a biopsy needle. US images are shown in the user’s field of view with enhanced lesion visualization and needle trajectory. To validate the system, latency of the transmission of US images was evaluated. Usability assessment compared our proposed prototype with a traditional approach with different users. It showed that needle alignment was more precise, with 92.67 ± 2.32° in our prototype versus 89.99 ± 37.49° in a traditional system. The users also reached the lesion more accurately. Overall, the proposed solution presents promising results, and the use of AR glasses as a tracking and visualization device exhibited good performance.

show abstract

Ultrasound training simulator using augmented reality glasses: an accuracy and precision assessment study

Cited by 5 publications

References 8 publications

CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording

CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording

Current Trends and Beyond Conventional Approaches: Advancements in Breast Cancer Surgery through Three-Dimensional Imaging, Virtual Reality, Augmented Reality, and the Emerging Metaverse

Augmented Reality-Assisted Ultrasound Breast Biopsy

Contact Info

Product

Resources

About