Background: Applied health science research commonly measures concepts via multiple-item tools (scales), such as self-reported questionnaires or observation checklists. They are usually validated in more detail in separate psychometric studies or very cursorily in substantive studies. However, methodologists advise that, as validity is a property of the inferences based on measurement in a context, psychometric analyses should be performed in substantive studies as well. Until recently, performing comprehensive psychometrics required expert knowledge of different, often proprietary, software. The increasing availability of statistical techniques in the R environment now makes it possible to integrate such analyses in applied research. Methods: In this tutorial, I introduce a 6-step protocol which allows detailed diagnosis of core psychometric properties (e.g. structural validity, internal consistency) for scales with binary and ordinal response options aiming to measure differences in degree or quantity, the most common in applied research. The protocol includes investigations of (1) item distributions and summary statistics, item properties via (2) non-parametric and (3) parametric item response theory, (4) scale structure using factor analysis, (5) reliability via classical test theory, and (6) calculation and description of global scores. I illustrate the procedure on a measure of self-reported disability, the 24-item Sickness Impact Profile Roland Scale (RM-SIP), administered in a survey of 222 chronic pain sufferers. An R Markdown script is provided that generates reproducible reports. Results: In this sample, 15 of 24 RM-SIP items formed a unidimensional ordinal scale with good homogeneity (H = 0.43) and reliability (α = .86[.84-.89]; ω = .87 [.85-.88]). The two versions were highly correlated (r = .96), and regression models predicting RM-SIP disability produced comparable results. Conclusions: The example analysis illustrates how psychometric properties may be assessed in substantive studies and identify avenues for measure improvement. Applied researchers can adapt this script to perform and communicate these analyses as part of questionnaire validation and substantive studies.
BackgroundThe eHealth Literacy Scale (eHEALS) is a tool to assess consumers’ comfort and skills in using information technologies for health. Although evidence exists of reliability and construct validity of the scale, less agreement exists on structural validity.ObjectiveThe aim of this study was to validate the Italian version of the eHealth Literacy Scale (I-eHEALS) in a community sample with a focus on its structural validity, by applying psychometric techniques that account for item difficulty.MethodsTwo Web-based surveys were conducted among a total of 296 people living in the Italian-speaking region of Switzerland (Ticino). After examining the latent variables underlying the observed variables of the Italian scale via principal component analysis (PCA), fit indices for two alternative models were calculated using confirmatory factor analysis (CFA). The scale structure was examined via parametric and nonparametric item response theory (IRT) analyses accounting for differences between items regarding the proportion of answers indicating high ability. Convergent validity was assessed by correlations with theoretically related constructs.ResultsCFA showed a suboptimal model fit for both models. IRT analyses confirmed all items measure a single dimension as intended. Reliability and construct validity of the final scale were also confirmed. The contrasting results of factor analysis (FA) and IRT analyses highlight the importance of considering differences in item difficulty when examining health literacy scales.ConclusionsThe findings support the reliability and validity of the translated scale and its use for assessing Italian-speaking consumers’ eHealth literacy.
Adequate medication adherence is key for optimal benefit of pharmacological treatments. A wealth of research has been conducted to understand and identify opportunities to intervene to improve medication adherence, but variations in adherence definitions within prior research have led to ambiguity in study findings. The lack of a standard taxonomy hinders the development of cumulative science in adherence research. This article reviews the newly established Ascertaining Barriers to Compliance (ABC) taxonomy for medication adherence with a particular focus on its relevance and applicability within the context of asthma and chronic obstructive pulmonary disease management. Building on traditional definitions and concepts within medication adherence, the ABC taxonomy considers the temporal sequence of steps a patient must undertake to be defined as "adherent to treatment": (A) initiation, (B) implementation, and (C) persistence. We explain the clinical and research relevance of differentiating between these phases, point to differences in its applicability in observational and experimental research, review strengths and limitations of available measures, and highlight recent findings on specific determinants of these behaviors. Finally, we provide recommendations for research and practice with a view to supporting and sign posting opportunities to improve future respiratory medication adherence and associated research.
Nonadherence to inhaled medication leads to poor asthma control and increased healthcare utilisation. Many studies exploring adherence determinants have been conducted, but summaries of the evidence are scarce. We performed a systematic review of observational research on determinants of asthma inhaler adherence among adults.We searched for articles in English reporting quantitative observational studies on inhaler adherence correlates among adults in developed countries, published in EMBASE, Medline, PsychInfo and PsychArticles in 1990-2014. Two coders independently assessed eligibility and extracted data, and assessed study quality. Results were summarised qualitatively into social and economic, and healthcare-, therapy-, condition-and patient-related factors.The 51 studies included mainly examined patient-related factors and found consistent links between adherence and stronger inhaler-necessity beliefs, and possibly older age. There was limited evidence on the relevance of other determinants, partly due to study heterogeneity regarding the types of determinants examined. Methodological quality varied considerably and studies performed generally poorly on their definitions of variables and measures, risk of bias, sample size and data analysis.A broader adoption of common methodological standards and health behaviour theories is needed before cumulative science on the determinants of adherence to asthma inhalers among adults can develop further. @ERSpublications Major opportunities for strengthening evidence on determinants of nonadherence to asthma inhalers: methods and theory
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.