CT and MRI radiomics of bone and soft-tissue sarcomas: a systematic review of reproducibility and validation strategies

Abstract

Background Feature reproducibility and model validation are two main challenges of radiomics. This study aims to systematically review radiomic feature reproducibility and predictive model validation strategies in studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas. The ultimate goal is to promote achieving a consensus on these aspects in radiomic workflows and facilitate clinical transferability. Results Out of 278 identified papers, forty-nine papers published between 2008 and 2020 were included. They dealt with radiomics of bone (n = 12) or soft-tissue (n = 37) tumors. Eighteen (37%) studies included a feature reproducibility analysis. Inter-/intra-reader segmentation variability was the theme of reproducibility analysis in 16 (33%) investigations, outnumbering the analyses focused on image acquisition or post-processing (n = 2, 4%). The intraclass correlation coefficient was the most commonly used statistical method to assess reproducibility, which ranged from 0.6 and 0.9. At least one machine learning validation technique was used for model development in 25 (51%) papers, and K-fold cross-validation was the most commonly employed. A clinical validation of the model was reported in 19 (39%) papers. It was performed using a separate dataset from the primary institution (i.e., internal validation) in 14 (29%) studies and an independent dataset related to different scanners or from another institution (i.e., independent validation) in 5 (10%) studies. Conclusions The issues of radiomic feature reproducibility and model validation varied largely among the studies dealing with musculoskeletal sarcomas and should be addressed in future investigations to bring the field of radiomics from a preclinical research area to the clinical stage.

An updated systematic review of radiomics in osteosarcoma: utilizing CLAIM to adapt the increasing trend of deep learning application in radiomics

“…Finally, due to the heterogeneity and limited numbers of studies, we only rated the evidence level of radiomics in prediction of NAC response. Further investigation is needed to lay a more robust scientific basis for translating the radiomics approach to a clinical useful tool [ 23 , 24 ].…”

Radiomics as a New Frontier of Imaging for Cancer Prognosis: A Narrative Review

“…They concluded that, despite the promising results, further efforts are needed to make sarcoma radiomics studies reproducible with an acceptable level of evidence. In this context, Gitto et al investigated the reproducibility and validation strategies, and found a huge variation among different studies, thus mining the introduction of TA in the clinical setting [195].…”

A Newly Established Cuproptosis-Associated Long Non-Coding RNA Signature for Predicting Prognosis and Indicating Immune Microenvironment Features in Soft Tissue Sarcoma

“…Sarcomas are solid tumors originating from the mesenchymal tissue and are classified as osteosarcoma and STSs [ 1 ], with more than 50 histological types. The incidence of human osteosarcoma and STS is 1 per 100,000 and (4-5)/100,000 per year, respectively, accounting for approximately 1% of all malignancies [ 2 ]. Despite the fact that STSs can arise anywhere in the body, extremities account for 60–70% [ 3 ].…”