Analysis of Discrepancy Between Diagnostic Clinical Examination Findings and Corresponding Evaluation of Digital Images in the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity Study

Abstract

IMPORTANCEAs effective treatments for potentially blinding retinopathy of prematurity (ROP) have been introduced, the importance of consistency in findings has increased, especially with the shift toward retinal imaging in infants at risk of ROP.OBJECTIVE To characterize discrepancies in findings of ROP between digital retinal image grading and examination results from the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity study, conducted from May 2011 to October 2013. DESIGN, SETTING, AND PARTICIPANTSA poststudy consensus review of images was conducted by 4 experts, who examined discrepancies in findings between image grades by trained nonphysician readers and physician examination results in infants with referral-warranted ROP (RW-ROP). Images were obtained from 13 North American neonatal intensive care units from eyes of infants with birth weights less than 1251 g. For discrepancy categories with more than 100 cases, 40 were randomly selected; in total, 188 image sets were reviewed. MAIN OUTCOMES AND MEASURESConsensus evaluation of discrepant image and examination findings for RW-ROP components. RESULTS Among 5350 image set pairs, there were 161 instances in which image grading did not detect RW-ROP noted on clinical examination (G−/E+) and 854 instances in which grading noted RW-ROP when the examination did not (G+/E−). Among the sample of G−/E+ cases, 18 of 32 reviews (56.3%) agreed with clinical examination findings that ROP was present in zone I and 18 of 40 (45.0%) agreed stage 3 ROP was present, but only 1 of 20 (5.0%) agreed plus disease was present. Among the sample of G+/E− cases, 36 of 40 reviews (90.0%) agreed with readers that zone I ROP was present, 23 of 40 (57.5%) agreed with readers that stage 3 ROP was present, and 4 of 16 (25.0%) agreed that plus disease was present. Based on the consensus review results of the sampled cases, we estimated that review would agree with clinical examination findings in 46.5% of the 161 G−/E+ cases (95% CI, 41.6-51.6) and agree with trained reader grading in 70.0% of the 854 G+/E− cases (95% CI, 67.3-72.8) for the presence of RW-ROP.CONCLUSIONS AND RELEVANCE This report highlights limitations and strengths of both the remote evaluation of fundus images and bedside clinical examination of infants at risk for ROP. These findings highlight the need for standardized approaches as ROP telemedicine becomes more widespread.

Detection of Potentially Severe Retinopathy of Prematurity by Remote Image Grading

“…5,6 The e-ROP study found high sensitivity (90.0%) and specificity (87.0%) for detecting infants who warranted a referral to an ophthalmologist to consider treatment; for example, 1 or both eyes had referral-warranted (RW) ROP, defined as zone I ROP, stage 3 ROP or more, or plus disease. In a recent report, 7 e-ROP investigators presented a review by a consensus panel of ROP experts that examined 161 false-negative and 854 false-positive images from eyes in which findings consistent with RW-ROP were noted either on diagnostic examination or grading, but not both. Based on the panel results, it was estimated that the ROP experts would agree with the clinical examination findings in 46.5% (95% CI, 41.6%–51.6%) of the false-negative cases (ie, RW-ROP found by examination but not by image evaluation) and agree with trained readers’ grading in 70.0% (95% CI, 67.3%–72.8%) of the false-positive cases.…”

Resultados del Programa Nacional de Prevención de la Ceguera en la Infancia por Retinopatía del Prematuro en Argentina (2004-2016)

“…La introducción de la telemedicina en sus diferentes versiones (RetCam, fotos por teléfonos móviles, entre otros) permite el envío de imágenes por redes virtuales que favorecen la consulta en situaciones de duda diagnóstica y/o tratamiento. 13,23,24 Una segunda opinión puede evitar el traslado innecesario de niños de alto riesgo y su consecuente morbilidad agregada.…”

Results of the National Program for the Prevention of Blindness in Childhood by Retinopathy of Prematurity in Argentina (2004-2016)

“…allows to send images using virtual networks that facilitate consultation in case of diagnostic suspicion and/or treatment. 13,23,24 A second opinion may prevent the unnecessary transport of high-risk children and the resulting added morbidity.…”