Objectives
To develop a convolutional neural network system to jointly segment and classify a hepatic lesion selected by user clicks in ultrasound images.
Methods
In total, 4309 anonymized ultrasound images of 3873 patients with hepatic cyst (n = 1214), hemangioma (n = 1220), metastasis (n = 1001), or hepatocellular carcinoma (HCC) (n = 874) were collected and annotated. The images were divided into 3909 training and 400 test images. Our network is composed of one shared encoder and two inference branches used for segmentation and classification and takes the concatenation of an input image and two Euclidean distance maps of foreground and background clicks provided by a user as input. The performance of hepatic lesion segmentation was evaluated based on the Jaccard index (JI), and the performance of classification was based on accuracy, sensitivity, specificity, and the area under the receiver operating characteristic curve (AUROC).
Results
We achieved performance improvements by jointly conducting segmentation and classification. In the segmentation only system, the mean JI was 68.5%. In the classification only system, the accuracy of classifying four types of hepatic lesions was 79.8%. The mean JI and classification accuracy were 68.5% and 82.2%, respectively, for the proposed joint system. The optimal sensitivity and specificity and the AUROC of classifying benign and malignant hepatic lesions of the joint system were 95.0%, 86.0%, and 0.970, respectively. The respective sensitivity, specificity, and the AUROC for classifying four hepatic lesions of the joint system were 86.7%, 89.7%, and 0.947.
Conclusions
The proposed joint system exhibited fair performance compared to segmentation only and classification only systems.
Key Points
• The joint segmentation and classification system using deep learning accurately segmented and classified hepatic lesions selected by user clicks in US examination.
• The joint segmentation and classification system for hepatic lesions in US images exhibited higher performance than segmentation only and classification only systems.
• The joint segmentation and classification system could assist radiologists with minimal experience in US imaging by characterizing hepatic lesions.
Small RHs in peripheral areas may require aggressive treatment because they respond well to treatment. In larger RHs, staged treatment could reduce treatment-related complications. Transpupillary thermotherapy could be an effective method in tumor regression for moderate-to-large-sized RHs showing tumor regression rate of 70%.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.