Predictive Modeling for Diagnostic Tests with High Specificity, but Low Sensitivity: A Study of the Glycerol Test in Patients with Suspected Menière’s Disease

Abstract

A high specificity does not ensure that the expected benefit of a diagnostic test outweighs its cost. Problems arise, in particular, when the investigation is expensive, the prevalence of a positive test result is relatively small for the candidate patients, and the sensitivity of the test is low so that the information provided by a negative result is virtually negligible. The consequence may be that a potentially useful test does not gain broader acceptance. Here we show how predictive modeling can help to identify patients for whom the ratio of expected benefit and cost reaches an acceptable level so that testing these patients is reasonable even though testing all patients might be considered wasteful. Our application example is based on a retrospective study of the glycerol test, which is used to corroborate a suspected diagnosis of Menière’s disease. Using the pretest hearing thresholds at up to 10 frequencies, predictions were made by K-nearest neighbor classification or logistic regression. Both methods estimate, based on results from previous patients, the posterior probability that performing the considered test in a new patient will have a positive outcome. The quality of the prediction was evaluated using leave-one-out cross-validation, making various assumptions about the costs and benefits of testing. With reference to all 356 cases, the probability of a positive test result was almost 0.4. For subpopulations selected by K-nearest neighbor classification, which was clearly superior to logistic regression, this probability could be increased up to about 0.6. Thus, the odds of a positive test result were more than doubled.

Comparison of eleven commercially available rapid tests for detection of Bacillus anthracis, Francisella tularensis and Yersinia pestis

“…But it is extremely difficult to conform to these criteria. It is often necessary to find a reasonable balance between sensitivity and specificity (Lutkenhoner and Basel ). In case of ‘in the field’ detection of highly pathogenic bacteria, sensitivity seems to be a priority as positive samples are usually confirmed by more sophisticated methods in a reference laboratory.…”

Assessment of the Applicability of Integrative Tumor Response Assays in Advanced Epithelial Ovarian Cancer

“…In this study, the sensitivity of ITRA was high and its specificity was low. Sensitivity is considered equivalent to the true-positive rate (29), and the high sensitivity in this study signifies that the chemotherapy agent selected based on ITRA results had a high rate of clinical efficacy. Therefore, ITRA may help with screening to choose the second-line drug.…”

Non-Invasive Modeling of Intracranial Hypertension from Physiological Channels

“…As a diagnostic model, the maximum weight on choosing the best model should be on the "sensitivity" metric even at the cost of losing some specificity. An idea diagnostic model should have a high sensitivity and a high specificity, however such models are rarely available and for ICP prediction it has been yet a long journey ahead for all of the proposed models to find their way into clinical practices [167].…”