A short-version PACIC is now available and ready for use in research with diabetic patients. Its use is encouraged in future research, particularly in the exploration of its validity against actual CCM services delivered and long-term clinical outcomes.
Over the past 30 years, a general consensus has emerged within the medical community regarding the essential role served by grading guidelines in evaluating the quality of evidence produced by a medical research study. Specifically, consensus exists regarding the hierarchy of evidence, where randomized controlled trials (RCTs) are considered the ''gold standard'' followed by nonrandomized controlled trials (non-RCTs) and uncontrolled trials. As guidelines have become more sophisticated, processes have been developed for downgrading poorly conducted studies and upgrading strong studies. Lists of threats to internal validity have been disseminated, thereby assisting reviewers in grading studies. However, despite these many accomplishments, considerable issues remain unresolved with respect to how to evaluate the strength of evidence produced by flawed RCTs versus well-conducted non-RCTs. The purpose of this article is to evaluate existing evidence-based grading guidelines and to offer suggestions for how such guidelines may be improved.
Background
The Itch Numeric Rating Scale (NRS), Skin Pain NRS, and Atopic Dermatitis Sleep Scale (ADSS) are self-administered patient-reported outcome (PRO) instruments developed to assess symptoms in patients with atopic dermatitis (AD). The objective of this study was to evaluate the psychometric properties (reliability, validity, and responsiveness) and interpretability thresholds of these PROs using data from three pivotal Phase 3 studies in adults.
Methods
BREEZE-AD1, BREEZE-AD2, and BREEZE-AD5 evaluated the safety and efficacy of baricitinib in adults with moderate-to-severe AD. Clinician-reported outcomes and other PROs commonly assessed in patients with AD were used to estimate meaningful changes and evaluate test–retest reliability, convergent and divergent validity, known-groups validity, responsiveness, and meaningful change thresholds (MCTs) of the Itch NRS, Skin Pain NRS, and ADSS.
Results
The test–retest reliability of the Itch NRS, Skin Pain NRS, and ADSS was evidenced by generally large intraclass correlation coefficients (> 0.7) in stable groups of patients between baseline and Week 1 and Weeks 4 and 8. Moderate-to-large correlations (r > 0.4) at baseline and Week 16 were generally observed between each measure and other PROs measuring the same concept, supporting convergent validity. Small-to-moderate correlations with clinician-reported outcomes demonstrated divergent validity. Each instrument was able to distinguish between known groups of disease severity as assessed using other indicators of AD severity. The responsiveness of the Itch NRS, Skin Pain NRS, and ADSS scales was demonstrated through significant differences in their change scores from baseline to Week 16 between categories of change in another PRO also from baseline to Week 16. Thresholds for interpreting meaningful change were estimated as − 4.0 for the 0–10 Itch and Skin Pain NRS items; − 1.25 for the 0–4 ADSS Items 1 and 3 and; − 1.50 for the 0–29 ADSS Item 2, these equivalent to moderate degrees of change.
Conclusions
Results of this study demonstrate that the psychometric properties of the Itch NRS, Skin Pain NRS, and ADSS are good to excellent. These findings support the use of these instruments in daily assessment of AD symptoms in adults with moderate-to-severe AD.
Trial registration ClinicalTrials.gov numbers: NCT03334396, NCT03334422, and NCT03435081.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.