No abstract

No abstract

No abstract

PurposeDuring needle interventions, successful automated detection of the needle immediately after insertion is necessary to allow the physician identify and correct any misalignment of the needle and the target at early stages, which reduces needle passes and improves health outcomes.MethodsWe present a novel approach to localize partially inserted needles in 3D ultrasound volume with high precision using convolutional neural networks. We propose two methods based on patch classification and semantic segmentation of the needle from orthogonal 2D cross-sections extracted from the volume. For patch classification, each voxel is classified from locally extracted raw data of three orthogonal planes centered on it. We propose a bootstrap resampling approach to enhance the training in our highly imbalanced data. For semantic segmentation, parts of a needle are detected in cross-sections perpendicular to the lateral and elevational axes. We propose to exploit the structural information in the data with a novel thick-slice processing approach for efficient modeling of the context.ResultsOur introduced methods successfully detect 17 and 22 G needles with a single trained network, showing a robust generalized approach. Extensive ex-vivo evaluations on datasets of chicken breast and porcine leg show 80 and 84% F1-scores, respectively. Furthermore, very short needles are detected with tip localization errors of less than 0.7 mm for lengths of only 5 and 10 mm at 0.2 and 0.36 mm voxel sizes, respectively.ConclusionOur method is able to accurately detect even very short needles, ensuring that the needle and its tip are maximally visible in the visualized plane during the entire intervention, thereby eliminating the need for advanced bi-manual coordination of the needle and transducer.

Abstract-Ultrasound-guided medical interventions are broadly applied in diagnostics and therapy, e.g. regional anesthesia or ablation. A guided intervention using 2D ultrasound is challenging due to the poor instrument visibility, limited field of view and the multi-fold coordination of the medical instrument and ultrasound plane. Recent 3D ultrasound transducers can improve the quality of the image-guided intervention if an automated detection of the needle is used. In this paper, we present a novel method for detecting medical instruments in 3D ultrasound data that is solely based on image processing techniques and validated on various ex-vivo and in-vivo datasets. In the proposed procedure, the physician is placing the 3D transducer at the desired position and the image processing will automatically detect the best instrument view, so that the physician can entirely focus on the intervention. Our method is based on classification of instrument voxels using volumetric structure directions and robust approximation of the primary tool axis. A novel normalization method is proposed for the shape and intensity consistency of instruments to improve the detection. Moreover, a novel 3D Gabor wavelet transformation is introduced and optimally designed for revealing the instrument voxels in the volume, while remaining generic to several medical instruments and transducer types. Experiments on diverse datasets including in-vivo data from patients show that for a given transducer and instrument type, high detection accuracies are achieved with position errors smaller than the instrument diameter in the 0.5 to 1.5 millimeter range on average.

No abstract

No abstract

No abstract