Background: Artificial intelligence can be trained to outperform dermatologists in image-based skin cancer diagnostics. However, the networks' sensitivity to biases and overfitting may hamper their clinical applicability. Objectives:The aim of this study was to explain the potential consequences of implementing convolutional neural networks for stand-alone melanoma diagnostics and skin lesion triage. Methods:In this algorithm validation study on retrospective data, we reproduced and evaluated the performance of state-of-the-art artificial intelligence (convolutional neural networks) for skin cancer diagnostics. The networks were trained on 25,331 annotated dermoscopic skin lesion images from an open-source data set (ISIC-2019) and tested using a novel data set (AISC-2021) consisting of 26,591 annotated dermoscopic skin lesion images. We tested the trained algorithms' ability to generalize to new data and their diagnostic performance in two simulations (melanoma diagnostics and skin lesion triage). Results: The trained algorithms performed significantly less accurate diagnostics on images of nevi, melanomas and actinic keratoses from the AISC-2021 data set than the ISIC-2019 data set (p < 0.003). Almost one-third (31.1%) of the melanomas were misclassified during the melanoma diagnostics simulation, irrespective of their Breslow thickness. Furthermore, the algorithms marked 92.7% of the lesions 'suspicious' during the triage simulation, which yielded a triage sensitivity and specificity of 99.7% and 8.2%, respectively. Conclusions: Although state-of-the-art artificial intelligence outperforms dermatologists on image-based skin lesion classification within an artificial
Most artificial intelligence (AI) research and innovations have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in Sub-Saharan Africa, the rate of perinatal mortality is very high due to limited access to antenatal screening. In these countries, AI models could be implemented to help clinicians acquire fetal ultrasound planes for the diagnosis of fetal abnormalities. So far, deep learning models have been proposed to identify standard fetal planes, but there is no evidence of their ability to generalise in centres with low resources, i.e. with limited access to high-end ultrasound equipment and ultrasound data. This work investigates for the first time different strategies to reduce the domain-shift effect arising from a fetal plane classification model trained on one clinical centre with high-resource settings and transferred to a new centre with low-resource settings. To that end, a classifier trained with 1792 patients from Spain is first evaluated on a new centre in Denmark in optimal conditions with 1008 patients and is later optimised to reach the same performance in five African centres (Egypt, Algeria, Uganda, Ghana and Malawi) with 25 patients each. The results show that a transfer learning approach for domain adaptation can be a solution to integrate small-size African samples with existing large-scale databases in developed countries. In particular, the model can be re-aligned and optimised to boost the performance on African populations by increasing the recall to $$0.92 \pm 0.04$$ 0.92 ± 0.04 and at the same time maintaining a high precision across centres. This framework shows promise for building new AI models generalisable across clinical centres with limited data acquired in challenging and heterogeneous conditions and calls for further research to develop new solutions for the usability of AI in countries with fewer resources and, consequently, in higher need of clinical support.
BackgroundTesting is critical for detecting SARS-CoV-2 infection, but the best sampling method remains unclear.ObjectivesTo determine whether nasopharyngeal swab (NPS), oropharyngeal swab (OPS) or saliva specimen collection has the highest detection rate for SARS-CoV-2 molecular testing.MethodsWe conducted a randomised clinical trial at two COVID-19 outpatient test centres where NPS, OPS and saliva specimens were collected by healthcare workers in different orders for reverse transcriptase PCR testing. The SARS-CoV-2 detection rate was calculated as the number positive by a specific sampling method divided by the number in which any of the three sampling methods was positive. As secondary outcomes, test-related discomfort was measured with an 11-point numeric scale and cost-effectiveness was calculated.ResultsAmong 23 102 adults completing the trial, 381 (1.65%) were SARS-CoV-2 positive. The SARS-CoV-2 detection rate was higher for OPSs, 78.7% (95% CI 74.3 to 82.7), compared with NPSs, 72.7% (95% CI 67.9 to 77.1) (p=0.049) and compared with saliva sampling, 61.9% (95% CI 56.9 to 66.8) (p<0.001). The discomfort score was highest for NPSs, at 5.76 (SD, 2.52), followed by OPSs, at 3.16 (SD 3.16) and saliva samples, at 1.03 (SD 18.8), p<0.001 between all measurements. Saliva specimens were associated with the lowest cost, and the incremental costs per detected SARS-CoV-2 infection for NPSs and OPSs were US$3258 and US$1832, respectively.ConclusionsOPSs were associated with higher SARS-CoV-2 detection and lower test-related discomfort than NPSs for SARS-CoV-2 testing. Saliva sampling had the lowest SARS-CoV-2 detection but was the least costly strategy for mass testing.Trial registration numberNCT04715607.
The placenta is crucial to fetal well-being and it plays a significant role in the pathogenesis of hypertensive pregnancy disorders. Moreover, a timely diagnosis of placenta previa may save lives. Ultrasound is the primary imaging modality in pregnancy, but high-quality imaging depends on the access to equipment and staff, which is not possible in all settings. Convolutional neural networks may help standardize the acquisition of images for fetal diagnostics. Our aim was to develop a deep learning based model for classification and segmentation of the placenta in ultrasound images. We trained a model based on manual annotations of 7,500 ultrasound images to identify and segment the placenta. The model's performance was compared to annotations made by 25 clinicians (experts, trainees, midwives). The overall image classification accuracy was 81%. The average intersection over union score (IoU) reached 0.78. The model’s accuracy was lower than experts’ and trainees’, but it outperformed all clinicians at delineating the placenta, IoU = 0.75 vs 0.69, 0.66, 0.59. The model was cross validated on 100 2nd trimester images from Barcelona, yielding an accuracy of 76%, IoU 0.68. In conclusion, we developed a model for automatic classification and segmentation of the placenta with consistent performance across different patient populations. It may be used for automated detection of placenta previa and enable future deep learning research in placental dysfunction.
Background Training and assessment of operator competence for the less invasive surfactant administration (LISA) procedure vary. This study aimed to obtain international expert consensus on LISA training (LISA curriculum (LISA-CUR)) and assessment (LISA assessment tool (LISA-AT)). Methods From February to July 2022, an international three-round Delphi process gathered opinions from LISA experts (researchers, curriculum developers, and clinical educators) on a list of items to be included in a LISA-CUR and LISA-AT (Round 1). The experts rated the importance of each item (Round 2). Items supported by more than 80% consensus were included. All experts were asked to approve or reject the final LISA-CUR and LISA-AT (Round 3). Results A total of 153 experts from 14 countries participated in Round 1, and the response rate for Rounds 2 and 3 was >80%. Round 1 identified 44 items for LISA-CUR and 22 for LISA-AT. Round 2 excluded 15 items for the LISA-CUR and 7 items for the LISA-AT. Round 3 resulted in a strong consensus (99–100%) for the final 29 items for the LISA-CUR and 15 items for the LISA-AT. Conclusions This Delphi process established an international consensus on a training curriculum and content evidence for the assessment of LISA competence. Impact This international consensus-based expert statement provides content on a curriculum for the less invasive surfactant administration procedure (LISA-CUR) that may be partnered with existing evidence-based strategies to optimize and standardize LISA training in the future. This international consensus-based expert statement also provides content on an assessment tool for the LISA procedure (LISA-AT) that can help to evaluate competence in LISA operators. The proposed LISA-AT enables standardized, continuous feedback and assessment until achieving proficiency.
Introduction: Efficient interpretation of dermoscopic images relies on pattern recognition, and the development of expert-level proficiency typically requires extensive training and years of practice. While traditional methods of transferring knowledge have proven effective, technological advances may significantly improve upon these strategies and better equip dermoscopy learners with the pattern recognition skills required for real-world practice. Objectives: A narrative review of the literature was performed to explore emerging directions in medical image interpretation education that may enhance dermoscopy education. This article represents the first of a two-part review series on this topic. Methods: To promote innovation in dermoscopy education, the International Skin Imaging Collaboration (ISIC)assembled a 12-member Education Working Group that comprises international dermoscopy experts and educational scientists. Based on a preliminary literature review and their experiences as educators, the group developed and refined a list of innovative approaches through multiple rounds of discussion and feedback. For each approach, literature searches were performed for relevant articles. Results: Through a consensus-based approach, the group identified a number of emerging directions in image interpretation education. The following theory-based approaches will be discussed in this first part: whole-task learning, microlearning, perceptual learning, and adaptive learning. Conclusions: Compared to traditional methods, these theory-based approaches may enhance dermoscopy education by making learning more engaging and interactive and reducing the amount of time required to develop expert-level pattern recognition skills. Further exploration is needed to determine how these approaches can be seamlessly and successfully integrated to optimize dermoscopy education.
Introduction: In image interpretation education, many educators have shifted away from traditional methods that involve passive instruction and fragmented learning to interactive ones that promote active engagement and integrated knowledge. By training pattern recognition skills in an effective manner, these interactive approaches provide a promising direction for dermoscopy education. Objectives: A narrative review of the literature was performed to probe emerging directions in medical image interpretation education that may support dermoscopy education. This article represents the second of a two-part review series. Methods: To promote innovation in dermoscopy education, the International Skin Imaging Collaboration (ISIC) assembled an Education Working Group that comprises international dermoscopy experts and educational scientists. Based on a preliminary literature review and their experiences as educators, the group developed and refined a list of innovative approaches through multiple rounds of discussion and feedback. For each approach, literature searches were performed for relevant articles. Results: Through a consensus-based approach, the group identified a number of theory-based approaches, as discussed in the first part of this series. The group also acknowledged the role of motivation, metacognition, and early failures in optimizing the learning process. Other promising teaching tools included gamification, social media, and perceptual and adaptive learning modules (PALMs). Conclusions: Over the years, many dermoscopy educators may have intuitively adopted these instructional strategies in response to learner feedback, personal observations, and changes in the learning environment. For dermoscopy training, PALMs may be especially valuable in that they provide immediate feedback and adapt the training schedule to the individual’s performance.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.