Consistency of extreme response style and non-extreme response style across traits

Wetzel, Eunike; Carstensen, Claus H.; Böhnke, Jan R.

doi:10.1016/j.jrp.2012.10.010

Cited by 81 publications

(96 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The extension makes the assumption that the ERS tendency is constant across traits, an assumption that appears plausible based on prior work (Weijters et al, 2010;Wetzel, Carstensen, & Böhnke, 2013) and is also consistent with a theory that extreme response style underlies the paradoxical country-level correlations between achievement and multiple attitudinal scales. In this paper, we extend the Bolt & Newton (2011) approach in additional ways to examine the attitude-achievement paradox.…”

Section: Introductionmentioning

confidence: 68%

Examining the attitude-achievement paradox in PISA using a multilevel multidimensional IRT model for extreme response style

Bolt

2015

Large-scale Assess Educ

View full text Add to dashboard Cite

In this paper, we consider a two-level multidimensional item response model that examines country differences in extreme response style (ERS) as a possible cause for the achievement-attitude paradox in PISA 2006. The model is an extension of Bolt & Newton (2011) that uses response data from seven attitudinal scales to assess response style and to control for its effects in estimating correlations between attitudes and achievement. Despite detectable variability in ERS across countries and detectable biasing effects of ERS on attitudinal scores, our results suggest that the unexpected between-country correlation between attitudes and achievement is not attributable to country differences in ERS. The remaining between-country correlations between mean attitudes and mean achievement once controlling for ERS can be explained by the observation that (1) despite detectable country differences, most variability in ERS occurs within, as opposed to between, countries, and (2) ERS appears to be only weakly correlated with achievement. The methodological approach used in this paper is argued to provide an informative way of studying the effects (or lack thereof) of cross-country variability in response style.

show abstract

Section: Introductionmentioning

confidence: 68%

Examining the attitude-achievement paradox in PISA using a multilevel multidimensional IRT model for extreme response style

Bolt

2015

Large-scale Assess Educ

View full text Add to dashboard Cite

show abstract

“…Pronounced simplifying strategies are commonly known as response styles: the preference for extreme categories (extreme response style, ERS), preference of the middle category (MRS), as well as an acquiescent response style (ARS) and a disacquiescent response style (DARS). Empirically, these are found in major sample portions, for example, for ERS 25–30% of respondents, for MRS 11–33%, and for ARS 32–52% (Meiser and Machunsky, 2008; Carter et al, 2011; Wetzel et al, 2013). Less pronounced strategies such as avoidance of certain categories have received less attention (see for a recent overview Viswanathan et al, 2004; Van Vaerenbergh and Thomas, 2013).…”

Section: Introductionmentioning

confidence: 99%

Using a Mixed IRT Model to Assess the Scale Usage in the Measurement of Job Satisfaction

2017

View full text Add to dashboard Cite

This study investigated the adequacy of a rating scale with a large number of response categories that is often used in panel surveys for assessing diverse aspects of job satisfaction. An inappropriate scale usage is indicative of overstraining respondents and of diminished psychometric scale quality. The mixed Item Response Theory (IRT) approach for polytomous data allows exploring heterogeneous patterns of inappropriate scale usage in form of avoided categories and response styles. In this study, panel data of employees (n = 7036) on five aspects of job satisfaction measured on an 11-point rating scale within the “Household, Income and Labor Dynamics in Australia” (wave 2001) were analyzed. A three-class solution of the restricted mixed generalized partial credit model fit the data best. The results showed that in no class the 11-point scale was appropriately used but that the number of categories used was reduced in all three classes. Respondents of the large class (40%) appropriately differentiate between up to six categories. The two smaller classes (33 and 27%) avoid even more categories and show some kind of extreme response style. Furthermore, classes differ in socio-demographic and job-related factors. In conclusion, a two- to six-point scale without the middle point might be more adequate for assessing job satisfaction.

show abstract

“…A widespread concern is that such response behavior distorts the reliability and validity of measures comprised of rating items. Past research revealed that response styles may be conceptualized as trait-like constructs that are stable across time and content domains (e.g., Aichholzer, 2013;Billiet & Davidov, 2008;Weijters, Geuens, & Schillewaert, 2010a, 2010bWetzel, Carstensen, & Böhnke, 2013).…”

Section: Introductionmentioning

confidence: 99%

Validity of Multiprocess IRT Models for Separating Content and Response Styles

Plieninger

Meiser

2014

Educational and Psychological Measurement

View full text Add to dashboard Cite

Response styles, the tendency to respond to Likert-type items irrespective of content, are a widely known threat to the reliability and validity of self-report measures. However, it is still debated how to measure and control for response styles such as extreme responding. Recently, multiprocess item response theory models have been proposed that allow for separating multiple response processes in rating data. The rationale behind these models is to define process variables that capture psychologically meaningful aspects of the response process like, for example, content-and response style-related processes. The aim of the present research was to test the validity of this approach using two large data sets. In the first study, responses to a 7-point rating scale were disentangled, and it was shown that response style-related and content-related processes were selectively linked to extraneous criteria of response styles and content. The second study, using a 4-point rating scale, focused on a content-related criterion and revealed a substantial suppression effect of response style. The findings have implications for both basic and applied fields, namely, for modeling response styles and for the interpretation of rating data.

show abstract

Consistency of extreme response style and non-extreme response style across traits

Cited by 81 publications

References 22 publications

Examining the attitude-achievement paradox in PISA using a multilevel multidimensional IRT model for extreme response style

Examining the attitude-achievement paradox in PISA using a multilevel multidimensional IRT model for extreme response style

Using a Mixed IRT Model to Assess the Scale Usage in the Measurement of Job Satisfaction

Validity of Multiprocess IRT Models for Separating Content and Response Styles

Contact Info

Product

Resources

About