Summary Receiver Operating Characteristic Curve Analysis Techniques in the Evaluation of Diagnostic Tests

Jones, Catherine M.; Athanasiou, Thanos

doi:10.1016/j.athoracsur.2004.09.040

Cited by 418 publications

(311 citation statements)

References 15 publications

Supporting

Mentioning

304

Contrasting

Unclassified

Order By: Relevance

“…However, the specificity of 0.97 is relatively high to confirm diagnosis. The SROC curve presents as a summary of the diagnostic performance, which shows the trade-off between sensitivity and specificity [26]. Our SROC analysis showed that the maximum joint of sensitivity and specificity was 0.91 and an AUC of 0.96, suggesting a high overall accuracy.…”

Section: Discussionmentioning

confidence: 76%

Diagnostic value of nucleic acid amplification tests on bronchoalveolar lavage fluid for smear-negative pulmonary tuberculosis: a meta-analysis

et al. 2015

View full text Add to dashboard Cite

SynopsisThe diagnosis of smear-negative pulmonary tuberculosis (SNPT) remains a clinical challenge. Many studies suggest that nucleic acid amplification tests (NAATs) on bronchoalveolar lavage fluid (BALF) plays a role in diagnosing SNPT, but with considerable varying results. The current study aimed to summarize the overall diagnostic accuracy of NAATs assay on BALF for SNPT. A systematic literature search was performed and data were retrieved. Pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR) and diagnostic odds ratio (DOR) were calculated. A summary receiver operating characteristic curve and area under the curve (AUC) were used to evaluate the overall diagnostic performance. All the statistical analysis was performed by using STATA 12.0 and Meta-DiSc 1.4 software. A total of nine studies with 1214 subjects were included this meta-analysis. The pooled sensitivity, specificity, PLR, NLR and DOR were 0.

show abstract

Section: Discussionmentioning

confidence: 76%

Diagnostic value of nucleic acid amplification tests on bronchoalveolar lavage fluid for smear-negative pulmonary tuberculosis: a meta-analysis

et al. 2015

View full text Add to dashboard Cite

show abstract

“…Another indicator obtained to evaluate the quality of the test was the odds ratio, calculated on the basis of the sensitivity and specificity values. (22)(23)(24) The overall sensitivity and specificity values, together with their respective 95% CIs, were also found through the SROC curve. Using these values, we calculated the post-test probability for various, randomly determined prevalences of tuberculosis.…”

Section: Methodsmentioning

confidence: 99%

Avaliação da adenosina desaminase no diagnóstico da tuberculose pleural: uma metanálise brasileira

Morisson

Neves

2008

J. bras. pneumol.

View full text Add to dashboard Cite

Objective: To evaluate Brazilian studies by summarizing the accuracy of adenosine deaminase in the diagnosis of the pleural tuberculosis, with the objective of lending support to the movement to make the test part of the routine in the investigation of pleural effusions. Methods: A search for Brazilian studies related to the determination of adenosine deaminase levels in the pleural liquid was carried out. These studies were evaluated and included in this study. The data were analyzed using summary receiver operating characteristic (SROC) curves, which enabled the studies to be collected and evaluated regarding the accuracy of the diagnosis. As for the global values of sensitivity and specificity, the Bayes' theorem was applied to calculate the post-test probabilities in different prevalences of the disease. Results: Twenty-five studies dating from 1987 to 2005 and including enough information to be used in the meta-analysis were identified. After evaluation, nine studies were included, totaling 1674 patients. According to the SROC curve, a sensitivity of 91.8% (95% CI: 89.8-93.6%) and a specificity of 88.4% (95% CI: 86.0-90.5%) were found, with an area of 0.969 below the curve. The overall odds ratio was 112.0 (95% CI: 51.6-243.2). Considering a prevalence of tuberculosis of 50% (considered neutral), the post-test probability was 88.7% for a positive test and 91.5% for a negative test. Conclusion: Despite the differences found among studies, it is possible to conclude that the determination of adenosine deaminase levels has high accuracy in the diagnosis of the pleural tuberculosis and should be used as a routine test in its investigation.Keywords: Pleural effusion; Tuberculosis; Diagnosis; Adenosine deaminase; Meta-analysis. ResumoObjetivo: Avaliar trabalhos brasileiros resumindo a acurácia da adenosina desaminase no diagnóstico da tuberculose pleural, com o intuito de contribuir para a concretização do exame como rotina na investigação dos derrames pleurais. Métodos: Depois de realizada uma busca por trabalhos brasileiros referentes à dosagem da adenosina desaminase no líquido pleural, estes foram avaliados e incluídos no estudo.A análise dos dados foi feita por meio da curva summary receiver operating characteristic (SROC) que possibilitou a reunião dos estudos quanto a acurácia para o diagnóstico. Com os valores globais de sensibilidade e especificidade foi aplicado o teorema de Bayes para calcular as probabilidades pós-teste em diferentes prevalências da doença. Resultados: Entre 1987 e 2005 foram encontrados 25 estudos contendo informações suficientes que poderiam ser utilizadas na metanálise. Após avaliação, foram incluídos nove estudos, totalizando 1.674 pacientes. De acordo com a curva SROC, foi encontrada uma sensibilidade de 91,8% (IC95%: 89,8-93,6%) e uma especificidade de 88,4% (IC95%: 86,0-90,5%), com uma área abaixo da curva de 0,969. O odds ratio global foi de 112,0 (IC95%: 51,6-243,2). Considerando uma prevalência da tuberculose pleural de 50% (considerada neutra), a probabilidade do di...

show abstract

“…Size AUC>0.8, generally indicates that the test is accurate, and more close to the curve at the top left corner, which is the point (0, 1) the more accurate. The larger AUC makes more accurate diagnostic test (Jones and Athanasiou, 2005;Chaudron et al, 2010). However, for screening purposes, the value of higher sensitivity is preferred, although the AUC have the same size.…”

Section: Auc and Roc Curvesmentioning

confidence: 99%

“…The bigger ROC triangle, optimize combination of sensitivity and specificity (Jones and Athanasiou, 2005;Akobeng, 2007). ROC curve analysis is also a method used to evaluate the logistic regression model.…”

Section: Auc and Roc Curvesmentioning

confidence: 99%

Precision and Accuracy of Thyroid Dysfunction Questionnaire (TDQ) for Hyperthyroidism Screening in Childbearing Age Women

et al. 2016

View full text Add to dashboard Cite

Background: Community-based case finding efforts of hyperthyroidism rather not to do, but constrained because accurate markers measurements using hormones. TDQ as a screening instrument which meets several criteria diagnostic tests, provide more convenience for the patient, cheaper, easier and simpler. This study aimed to determine the precision and accuracy of diagnostic test of hyperthyroidism screening in childbearing age women. Subjects and Method:The study was a diagnostic study with cross sectional design. It conducted in Prambanan, Sleman, Yogyakarta. The sample consisted of 112 randomly selected of childbearing age women.Clinical symptoms of hyperthyroidism were measured using the TDQ, thyroid status measured by thyroid stimulating hormone (TSH) and free thyroxin (FT4). TDQ diagnostic precision and accuracy were tested using the percent agreement (PA), Kappa coefficient, sensitivity (Se), specificity (Sp), LR (+), LR (-), Youden's index, the area under the curve (AUC) in the receiver operating curve (ROC) and diagnostic odds ratio (DOR). Results: The best value in diagnostic precision is TDQ score with cutoff point score of 40, with PA 81.2 % and Kappa coefficient 0.62. Similarly, the best accuracy value Se 90%, Sp 76%, LR(+) 3.75, LR(-) 0.13, Youden's index 0.66, AUC 0.831 and DOR 28.8. Conclusion:The values and the optimal accuracy obtained from the best score of 40 and this cut off point of the score is sufficient to be used as a threshold determination of a diagnosis of hyperthyroidism by TDQ scores.

show abstract

Summary Receiver Operating Characteristic Curve Analysis Techniques in the Evaluation of Diagnostic Tests

Cited by 418 publications

References 15 publications

Diagnostic value of nucleic acid amplification tests on bronchoalveolar lavage fluid for smear-negative pulmonary tuberculosis: a meta-analysis

Diagnostic value of nucleic acid amplification tests on bronchoalveolar lavage fluid for smear-negative pulmonary tuberculosis: a meta-analysis

Avaliação da adenosina desaminase no diagnóstico da tuberculose pleural: uma metanálise brasileira

Precision and Accuracy of Thyroid Dysfunction Questionnaire (TDQ) for Hyperthyroidism Screening in Childbearing Age Women

Contact Info

Product

Resources

About