Circulating tumor DNA (ctDNA) sequencing is being rapidly adopted in precision oncology, but the accuracy, sensitivity, and reproducibility of ctDNA assays is poorly understood. Here we report the findings of a multi-site, cross-platform evaluation of the analytical performance of five industry-leading ctDNA assays. We evaluated each stage of the ctDNA sequencing workflow with simulations, synthetic DNA spike-in experiments, and proficiency testing on standardized cell line–derived reference samples. Above 0.5% variant allele frequency, ctDNA mutations were detected with high sensitivity, precision and reproducibility by all five assays, whereas below this limit detection became unreliable and varied widely between assays, especially when input material was limited. Missed mutations (false-negatives) were more common than erroneous candidates (false-positives), indicating that the reliable sampling of rare ctDNA fragments is the key challenge for ctDNA assays. This comprehensive evaluation of the analytical performance of ctDNA assays serves to inform best-practice guidelines and provides a resource for precision oncology.
Background
Targeted sequencing using oncopanels requires comprehensive assessments of accuracy and detection sensitivity to ensure analytical validity. By employing reference materials characterized by the U.S. Food and Drug Administration-led SEquence Quality Control project phase2 (SEQC2) effort, we perform a cross-platform multi-lab evaluation of eight Pan-Cancer panels to assess best practices for oncopanel sequencing.
Results
All panels demonstrate high sensitivity across targeted high-confidence coding regions and variant types for the variants previously verified to have variant allele frequency (VAF) in the 5–20% range. Sensitivity is reduced by utilizing VAF thresholds due to inherent variability in VAF measurements. Enforcing a VAF threshold for reporting has a positive impact on reducing false positive calls. Importantly, the false positive rate is found to be significantly higher outside the high-confidence coding regions, resulting in lower reproducibility. Thus, region restriction and VAF thresholds lead to low relative technical variability in estimating promising biomarkers and tumor mutational burden.
Conclusion
This comprehensive study provides actionable guidelines for oncopanel sequencing and clear evidence that supports a simplified approach to assess the analytical performance of oncopanels. It will facilitate the rapid implementation, validation, and quality control of oncopanels in clinical use.
Context.—
RET gene fusions are oncogenic drivers in nonsmall cell lung cancer and nonmedullary thyroid cancer. Selpercatinib (RETEVMO), a targeted inhibitor of RET, was approved by the US Food and Drug Administration for the treatment of RET fusion–positive nonsmall cell lung cancer and nonmedullary thyroid cancer emphasizing the need for rapid and accurate diagnosis of RET fusions. Fluorescence in situ hybridization (FISH) has been used to detect gene rearrangements, but its performance detecting RET rearrangements is understudied.
Objective.—
To validate and describe the performance of Abbott Molecular RET break-apart FISH probes for detecting RET rearrangements.
Design.—
A training set with RET fusion–positive (13) and RET fusion–negative nonsmall cell lung cancer and nonmedullary thyroid cancer samples (12) was used to establish criteria for FISH scoring. The scoring criteria was then applied to a larger validation set of samples (96).
Results.—
A cutoff of 19% or more positive nuclei by FISH was established in the training set and determined by the mean ±3 SD. The validation set was tested using Abbott Molecular RET break-apart FISH compared with sequencing. With this cutoff, a sensitivity of 86% (12 of 14) and specificity of 99% (81 of 82) was achieved. Bootstrapping showed sensitivity could be optimized by using a greater than 13% cutoff with indeterminate samples of 13% to 18% abnormal nuclei requiring confirmation by an orthogonal method. Using this 3-tier scoring system sensitivity increased to 100% (14 of 14) and specificity was 96% (79 of 82).
Conclusions.—
Abbott Molecular break-apart FISH probes can be used to detect RET fusions. Laboratories can optimize cutoffs and/or testing algorithms to maximize sensitivity and specificity to ensure appropriate patients receive effective, timely therapy.
Background:Pirtobrutinib, a highly selective, non-covalent (reversible) BTKi, demonstrated broad efficacy in patients (pts) with CLL/SLL who were resistant to cBTKi. Mechanisms of resistance to pirtobrutinib have not been systematically analyzed to date.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.