Methodology Review: Statistical Approaches for Assessing Measurement Bias

Millsap, Roger E.; Everson, Howard T.

doi:10.1177/014662169301700401

Cited by 386 publications

(338 citation statements)

References 119 publications

Supporting

Mentioning

330

Contrasting

Unclassified

Order By: Relevance

“…29 However, the effect of type of payer on fear-avoidance beliefs of work items has not been studied. For example, if patients receiving benefits from workers' compensation answer fear-avoidance beliefs items differently compared to patients receiving benefits from HMOs, which by definition is differential item functioning, 29,47 the presence of differential item functioning by payer would invalidate use of the single-item screen for fear-avoidance of work in models containing patients receiving benefits from different payer types. We would prefer to know if fear-avoidance beliefs of work activity items display differential item functioning by payer, before including fear of work activities in our models.…”

Section: Discussionmentioning

confidence: 99%

Effect of Fear-Avoidance Beliefs of Physical Activities on a Model That Predicts Risk-Adjusted Functional Status Outcomes in Patients Treated for a Lumbar Spine Dysfunction

Hart¹,

Werneke²,

Deutscher³

et al. 2011

J Orthop Sports Phys Ther

View full text Add to dashboard Cite

Functional status (FS) outcomes of patients with lumbar spine dysfunctions managed in outpatient rehabilitation clinics are affected by many variables, including patient demographic variables. 35 Before clinicians can interpret associations between treatments and outcomes in a meaningful way, FS outcomes must be statistically risk-adjusted to control the effect of variables that may or may not be related to clinical care. 8,23,33,35,52 Although statistical risk adjustment models can appear complicated, 53,54 results of these models tend to be clinically logical. For example, it is clinically logical that patients who are older or patients whose symptoms are more chronic should report less FS change compared to patients who are younger or have more acute symptoms, and, indeed, results support this inverse relationship (ie, as patients age, or symptoms become chronic, FS T T STUDY DESIGN: Retrospective analysis of a prospective, longitudinal cohort study of 30 858 patients being treated for a lumbar spine dysfunction in outpatient physical therapy. T T OBJECTIVES:To determine effect of adding a single-item screening variable classifying patients with elevated versus not-elevated scores of fearavoidance beliefs of physical activities at intake, on a model predicting risk-adjusted functional status (FS) outcomes. T T BACKGROUND:Outcomes must be risk-adjusted before making meaningful interpretations. Elevated fear-avoidance beliefs scores have been predictive of poor outcomes. But the importance of elevated fear-avoidance scores in a multivariable model predicting FS outcomes needs further study. T T METHODS:Using retrospective analyses, predictive ability (R 2 ) of multivariable linear regression models of discharge FS with and without classification by elevated versus not-elevated fearavoidance scores were compared, while controlling for intake FS, age, symptom acuity, surgical history, gender, number of comorbidities, and payer. Percent variance controlled and beta coefficients (95% confidence intervals) of each variable in both models were compared. A split-half design was used for model cross-validation. Predictive ratios (predicted FS, divided by actual discharge FS) were assessed. T T RESULTS:Adding fear-avoidance beliefs classification to the discharge FS model improved (P<.001) model predictive ability but only slightly (R 2 without, and with, fear-avoidance classification, 0.2997 and 0.3010, respectively). Variables impacted models similarly (95% confidence intervals not different). Fear-avoidance classification added 0.2% data variance control to the existing model. Cross-validation was supported. Predictive ratios were 1.09 and 1.10, without and with fearavoidance, respectively. T T CONCLUSION:Although screening for elevated fear-avoidance beliefs of physical activities significantly improves the FS outcomes predictive model, the amount of additional meaningful interpretation of FS outcomes was minimal. Exploration of other clinically relevant variables designed to improve outcomes prediction is warranted...

show abstract

Section: Discussionmentioning

confidence: 99%

Effect of Fear-Avoidance Beliefs of Physical Activities on a Model That Predicts Risk-Adjusted Functional Status Outcomes in Patients Treated for a Lumbar Spine Dysfunction

Hart¹,

Werneke²,

Deutscher³

et al. 2011

J Orthop Sports Phys Ther

View full text Add to dashboard Cite

show abstract

“…Methods to detect DIF are described in the literature (Holland & Wainer, 1993;Millsap & Everson, 1993), but some of the DIF tests do not distinguish between unequal locations and discriminations.…”

Section: Descriptive Dimensionsmentioning

confidence: 99%

A Conceptual and Psychometric Framework for Distinguishing Categories and Dimensions.

Boeck¹,

Wilson²,

Acton³

2005

Psychological Review

106

View full text Add to dashboard Cite

An important, sometimes controversial feature of all psychological phenomena is whether they are categorical or dimensional. A conceptual and psychometric framework is described for distinguishing whether the latent structure behind manifest categories (e.g., psychiatric diagnoses, attitude groups, or stages of development) is category-like or dimension-like. Being dimension-like requires (a) withincategory heterogeneity and (b) between-category quantitative differences. Being category-like requires (a) within-category homogeneity and (b) between-category qualitative differences. The relation between this classification and abrupt versus smooth differences is discussed. Hybrid structures are possible. Being category-like is itself a matter of degree; the authors offer a formalized framework to determine this degree. Empirical applications to personality disorders, attitudes toward capital punishment, and stages of cognitive development illustrate the approach.

show abstract

“…Mathematically, the requirement of measurement invariance means that the function that relates psychological abilities to test scores should be invariant over groups (Mellenbergh, 1989;Meredith, 1993). In the past decades, several methods that allow for the detection of violation of this requirement have been developed (e.g., see Holland & Wainer, 1993;Millsap & Everson, 1993), and these methods are now commonly used in large testing programs. For instance, measurement invariance is routinely investigated by the Educational Testing Service, which is responsible for the widely used SAT.…”

mentioning

confidence: 99%