A Simulation Study on Methods of Correcting for the Effects of Extreme Response Style

Wetzel, Eunike; Böhnke, Jan R.; Rose, Norman

doi:10.1177/0013164415591848

Cited by 24 publications

(32 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Nevertheless, correlations between narcissism facets and age and gender were similar across countries, both for unadjusted trait estimates and adjusted trait estimates (taking measurement noninvariance into account). In addition, method biases such as differences in using the response scales (e.g., acquiescence, extreme response style) could have influenced the results though the impact of response styles appears to be less severe than is often assumed (Plieninger, 2017;Wetzel, Böhnke, & Rose, 2016). Lastly, taking measurement invariance into account when investigating mean differences across countries cannot control for the reference-group effect (Heine, Buchtel, & Norenzayan, 2008;Mottus et al, 2012).…”

Section: Limitations and Future Directionsmentioning

confidence: 99%

Measurement invariance of three narcissism questionnaires across the US, the UK, and Germany

Wetzel¹,

Lang²,

Back³

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

With a recent surge of research on narcissism, narcissism questionnaires are increasingly beingtranslated and applied in various countries. The measurement invariance of an instrument across countries is a precondition for being able to compare scores across countries. We investigated the cross-cultural measurement invariance of three narcissism questionnaires (Brief Pathological Narcissism Inventory, B-PNI; Narcissistic Personality Inventory, NPI; and Narcissistic Admiration and Rivalry Questionnaire, NARQ) and mean-level differences across samples from the United States (N = 2,464), the United Kingdom (N = 307), and Germany (N = 925). Overall, the B-PNI and NARQ functioned equivalently for US and UK participants. More violations of measurement invariance were found between Germany and the combined US and UK samples, and for the NPI. In the B-PNI and NARQ, Americans scored higher than individuals from the UK regarding agentic aspects (self-sacrificing self-enhancement, admiration), while Germans scored lower than both Americans and UK individuals regarding antagonistic (entitlement rage, rivalry) and neurotic (hiding the self, contingent self-esteem) aspects. More inconsistent results were found for NPI facets. When noninvariance was present, observed means yielded biased results. Thus, the degree of measurement invariance across translated instrument versions should be considered in cross-cultural comparisons, even with culturally similar countries.

show abstract

Section: Limitations and Future Directionsmentioning

confidence: 99%

Measurement invariance of three narcissism questionnaires across the US, the UK, and Germany

Wetzel¹,

Lang²,

Back³

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…Content invariance at the latent variable level has been a frequent topic of discussion in the response style literature in the form of consistency or stability (Austin, Deary, & Egan, ; Weijters, Cabooter, & Schillewaert, ; Wetzel et al , ; Wetzel, Carstensen, & Böhnke, ). For instance, Weijters et al .…”

Section: Irtree Invariances For Studying Ersmentioning

confidence: 99%

“…Measuring psychological constructs in social science research is often based on self‐report questionnaires (Böckenholt, ; Wetzel, Böhnke, & Rose, ). Most self‐reported questionnaires utilize rating scale items that include multiple response options such as ‘strongly disagree’, ‘disagree’, ‘agree’ and ‘strongly agree’ (or numerical analogues such as 4‐, 5‐, or 7‐scales).…”

Section: Introductionmentioning

confidence: 99%

Evaluation on types of invariance in studying extreme response bias with an IRTree approach

Jeon

Boeck

2019

Brit J Math & Statis

View full text Add to dashboard Cite

In recent years, item response tree (IRTree) approaches have received increasing attention in the response style literature for their ability to partial out response style latent variables as well as associated item parameters. When an IRTree approach is adopted to measure extreme response styles, directional and content invariance could be assumed at the latent variable and item parameter levels. In this study, we propose to evaluate the empirical validity of these invariance assumptions by employing a general IRTree model with relaxed invariance assumptions. This would allow us to examine extreme response biases, beyond extreme response styles. With three empirical applications of the proposed evaluation, we find that relaxing some of the invariance assumptions improves the model fit, which suggests that not all assumed invariances are empirically supported. Specifically, at the latent variable level, we find reasonable evidence for directional invariance but mixed evidence for content invariance, although we also find that estimated correlations between content-specific extreme response latent variables are high, hinting at the potential presence of a general extreme response tendency. At the item parameter level, we find no directional or content invariance for thresholds and no content invariance for slopes. We discuss how the variant item parameter estimates obtained from a general IRTree model can offer useful insight to help us understand response bias related to extreme responding measured within the IRTree framework.

show abstract

“…The mixed IRT approach is beneficial for exploring ISU patterns in data, whereas multidimensional IRT models and SEM appear to be superior in eliminating effects of ad hoc defined ISU from latent trait values (Wetzel et al, 2015). …”

Section: Limitationsmentioning

confidence: 99%

Using a Mixed IRT Model to Assess the Scale Usage in the Measurement of Job Satisfaction

2017

View full text Add to dashboard Cite

This study investigated the adequacy of a rating scale with a large number of response categories that is often used in panel surveys for assessing diverse aspects of job satisfaction. An inappropriate scale usage is indicative of overstraining respondents and of diminished psychometric scale quality. The mixed Item Response Theory (IRT) approach for polytomous data allows exploring heterogeneous patterns of inappropriate scale usage in form of avoided categories and response styles. In this study, panel data of employees (n = 7036) on five aspects of job satisfaction measured on an 11-point rating scale within the “Household, Income and Labor Dynamics in Australia” (wave 2001) were analyzed. A three-class solution of the restricted mixed generalized partial credit model fit the data best. The results showed that in no class the 11-point scale was appropriately used but that the number of categories used was reduced in all three classes. Respondents of the large class (40%) appropriately differentiate between up to six categories. The two smaller classes (33 and 27%) avoid even more categories and show some kind of extreme response style. Furthermore, classes differ in socio-demographic and job-related factors. In conclusion, a two- to six-point scale without the middle point might be more adequate for assessing job satisfaction.

show abstract

A Simulation Study on Methods of Correcting for the Effects of Extreme Response Style

Cited by 24 publications

References 25 publications

Measurement invariance of three narcissism questionnaires across the US, the UK, and Germany

Measurement invariance of three narcissism questionnaires across the US, the UK, and Germany

Evaluation on types of invariance in studying extreme response bias with an IRTree approach

Using a Mixed IRT Model to Assess the Scale Usage in the Measurement of Job Satisfaction

Contact Info

Product

Resources

About