Augmented reality elastography ultrasound via generate adversarial network for breast cancer diagnosis

Abstract

Elastography ultrasound (EUS) imaging is a vital ultrasound imaging modality. The current use of EUS faces many challenges, such as vulnerability to subjective manipulation, echo signal attenuation, and unknown risks of elastic pressure in certain delicate tissues. The hardware requirement of EUS also hinders the trend of miniaturization of ultrasound equipment. We therefore present a cost-efficient solution by designing a deep neural network to synthesize augmented reality EUS (AR-EUS) from conventional B-mode images. By using 4580 cases from 15 medical centers, we evaluate the performance of AR-EUS on breast cancer diagnosis. The quantitative metric and blind evaluation results show no significant difference between AR-EUS and real EUS in image authenticity and in clinical diagnosis. The performance of pocket-sized ultrasound in breast tumor diagnosis is also significantly improved after AR-EUS is equipped. These results highlight the potential of AR-EUS in clinical application.

Unveiling the future of breast cancer assessment: a critical review on generative adversarial networks in elastography ultrasound

“…( 20 ), Yu et al. ( 40 ) utilize the same GAN framework and dataset to show the feasibility of V-EUS in augmented reality (AR-EUS) for improved diagnosis of breast cancer with pocket US. The quantitative and blind evaluation of elastograms in augmented reality shows no significant discrepancies between the AR-EUS and real EUS, establishing the authencity of AR-EUS.…”

“…However, the V-EUS (20) generation approach is a preferable end-to-end solution because it generates elastograms directly from conventional B-mode US rather than upsampling the lateral resolution to improve quality. As an extension to the contributions of Yao et al (20), Yu et al (40) utilize the same GAN framework and dataset to show the feasibility of V-EUS in augmented reality (AR-EUS) for improved diagnosis of breast cancer with pocket US. The quantitative and blind evaluation of elastograms in augmented reality shows no significant discrepancies between the AR-EUS and real EUS, establishing the authencity of AR-EUS.…”

“…( 20 ) and Yu et al. ( 40 ) for accurate breast lesion elastogram synthesis, aiding in accurate diagnosis of detected lesions in US image. …”