Compensating for visibility artefacts in photoacoustic imaging with a deep learning approach providing prediction uncertainties

Abstract

Photoacoustic imaging is a promising biomedical imaging modality providing optical contrasts at depth. Conventional reconstructions suffer from the limited view and bandwidth of the ultrasound transducers. As a result, structures elongated in the axis of the probe or large compared to the point spread function of the system are not fully recovered. A deep learning approach is proposed to handle these problems and is demonstrated both in simulations and in experiments on a multi-scale model of leaf skeleton. We employed an experimental approach to build the training and the test sets using photographs of the samples as ground truth images. Reconstructions produced by the neural network show a greatly improved image quality as compared to conventional approaches. In addition, this work aimed at quantifying the reliability of the neural network predictions. To achieve this, the dropout Monte-Carlo procedure is applied to estimate a pixel-wise degree of confidence on each predicted picture. This degree of confidence is well correlated to the variability observed in certain regions, among a stack of subsequently acquired frames. Last, we address the possibility to use transfer learning with simulated data in order to drastically limit the size of the experimental dataset.

Deep learning for biomedical photoacoustic imaging: A review

“…A core strength of such approaches is that experimental PA data can be utilized for training, by artificially undersampling the available channels and training the algorithm to predict the reconstructions from (1) full data, (2) sparse data, or (3) limited-view data. [91][92][93][94][95][96] Reflection artifact can be introduced by the presence of acoustic reflectors in the medium (for example air). Allman et al 97 showed that deep learning can be used to distinguish between artifacts and true signals and Shan et al 98 demonstrated that the technology is also capable of removing such artifacts from the images.…”