Computerized adaptive testing of population psychological distress: simulation-based evaluation of GHQ-30

Abstract

PurposeGoldberg’s General Health Questionnaire (GHQ) items are frequently used to assess psychological distress but no study to date has investigated the GHQ-30’s potential for adaptive administration. In computerized adaptive testing (CAT) items are matched optimally to the targeted distress level of respondents instead of relying on fixed-length versions of instruments. We therefore calibrate GHQ-30 items and report a simulation study exploring the potential of this instrument for adaptive administration in a longitudinal setting.MethodsGHQ-30 responses of 3445 participants with 2 completed assessments (baseline, 7-year follow-up) in the UK Health and Lifestyle Survey were calibrated using item response theory. Our simulation study evaluated the efficiency of CAT administration of the items, cross-sectionally and longitudinally, with different estimators, item selection methods, and measurement precision criteria.ResultsTo yield accurate distress measurements (marginal reliability at least 0.90) nearly all GHQ-30 items need to be administered to most survey respondents in general population samples. When lower accuracy is permissible (marginal reliability of 0.80), adaptive administration saves approximately 2/3 of the items. For longitudinal applications, change scores based on the complete set of GHQ-30 items correlate highly with change scores from adaptive administrations.ConclusionsThe rationale for CAT-GHQ-30 is only supported when the required marginal reliability is lower than 0.9, which is most likely to be the case in cross-sectional and longitudinal studies assessing mean changes in populations. Precise measurement of psychological distress at the individual level can be achieved, but requires the deployment of all 30 items.

Children’s family experiences: development of the PROMIS® pediatric family relationships measures

“…However, the excluded items provide valuable information about unique and important aspects of family functioning. As item banking initiatives advance toward multidimensionality and the application of bi-factor models [50–52], the utility of forming Family Relationships subscales should be reconsidered. Lastly, additional validation of the measures in socio-demographic and clinical subgroups is warranted, particularly evaluations of the instruments’ sensitivity to change.…”

Diabetic Retinopathy and Macular Edema Quality-of-Life Item Banks: Development and Initial Evaluation Using Computerized Adaptive Testing

“…However, our aim was to produce unidimensional measurement tools that provide users with the ability to administer selected scales for a given purpose. However, given that multidimensional IRT and bifactor models are available for use in item banking and CAT, [48][49][50] the potential to form a multidimensional DR/DME QoL item bank should be considered. For practical reasons, both face-to-face and phone interviews were conducted.…”

Mediterranean diet and mental distress: “10,001 Dalmatians” study

“…General Health Questionnaire with 30 items (GHQ-30) was used as a screening tool to assess minor psychiatric disorders and mental distress in study participants (Goldberg, 1972). GHQ-30 is widely used and validated questionnaire to identify non-specific, clinically significant psychological distress in general population (Stochl et al , 2016), and it was previously used in the similar study in the population from the Island of Vis, Croatia (Zgaga et al , 2013). Total GHQ-30 score was obtained by applying the four-point Likert scoring scheme (0–1–2–3) and summed across all 30 items.…”