Wording Effects in Self-Esteem Scales: Methodological Artifact or Response Style?

Horan, Patrick M.; DiStefano, Christine; Motl, Robert W.

doi:10.1207/s15328007sem1003_6

Cited by 144 publications

(168 citation statements)

References 27 publications

Supporting

Mentioning

130

Contrasting

Unclassified

Order By: Relevance

“…Specifically, positively worded items originally from the Burnout scale presented low factor loadings, and were thus excluded from the scale. It has been suggested that the use of positively -and negativelyworded items may introduce systematic measurement errors that disrupt analyses and interpretations of the results (e.g., Horan, DiStefano, & Motl, 2003). Also, an analysis of the content of such items suggests they may not be specific of burnout but have a more general meaning and thus may not aggregate with the other items of the Burnout scale.…”

Section: Discussionmentioning

confidence: 99%

Professional quality of life in nurses: Contribution for the validation of the Portuguese version of the Professional Quality of Life Scale-5 (ProQOL-5)

Duarte¹

2017

Análise Psicológica

View full text Add to dashboard Cite

Job stress and burnout are highly prevalent in healthcare professionals, and nurses in particular. Given its deleterious consequences not only for professionals' well-being but also for patients and organizations, it is important to have adequate measures to assess professional quality of life. This study aimed to offer a contribution for the Portuguese validation of the Professional Quality of Life Scale-5. This scale was designed to measure three dimensions of professional quality of life: compassion satisfaction, burnout, and compassion fatigue. The sample was composed by 390 nurses recruited from five public hospitals from Portugal north and center regions. Participants had on average 38.58 years of age (SD=9.10) and were mainly female, married, and practiced nursing in a variety of fields with an average of 15.66 (SD=9.09) years of practice. Results from the confirmatory factor analysis indicated that the original version of the scale had several problematic items and that a revised version showed superior model fit. In addition, results showed that female scored higher than men on Compassion Satisfaction. Also, nurses working in an oncology hospital had higher scores of Compassion Fatigue. Finally, higher scores of Burnout and Compassion Fatigue, and lower scores of Compassion Satisfaction, were associated with greater Depression, Anxiety, and Stress symptoms. The ProQOL-5 is thus an adequate instrument to assess professional quality of life in nurses and may be valuable for designing effective interventions to tackle burnout and compassion fatigue, and promote satisfaction with one's work.

show abstract

Section: Discussionmentioning

confidence: 99%

Professional quality of life in nurses: Contribution for the validation of the Portuguese version of the Professional Quality of Life Scale-5 (ProQOL-5)

Duarte¹

2017

Análise Psicológica

View full text Add to dashboard Cite

show abstract

“…For example, a unidimensional model in which high and low self-esteem are considered to be opposite poles of a single underlying continuum might be rejected in favor of a model in which separate, correlated factors are posited for positive and negative self-esteem corresponding to regular and reversed items (cf. Horan, DiStefano, & Motl, 2003;Motl & DiStefano, 2002).A variety of models have been proposed to take into account differences in responding to regular and reverse-keyed items and to avoid the mistaken specification of additional substantive factors, including models with method factors or correlated uniquenesses for either the regular or the reversed items or both (e.g., Tomás & Oliver, 1999). Although these models generally achieve a better fit to the data than a model with only substantive factors, it is often difficult to distinguish between them based on statistical criteria, and the preferred model may differ in different applications (even when the same scale is analyzed).…”

mentioning

confidence: 99%

Reversed item bias: An integrative model.

Weijters

Baumgartner

Schillewaert

2013

Psychological Methods

269

204

View full text Add to dashboard Cite

In the recent methodological literature, various models have been proposed to account for the phenomenon that reversed items (defined as items for which respondents' scores have to be recoded in order to make the direction of keying consistent across all items) tend to lead to problematic responses. In this paper we propose an integrative conceptualization of three important sources of reversed item method bias (acquiescence, careless responding, and confirmation bias) and specify a multi-sample confirmatory factor analysis model with two method factors to empirically test the hypothesized mechanisms, using explicit measures of acquiescence and carelessness and experimentally manipulated versions of a questionnaire that varies three item arrangements and the keying direction of the first item measuring the focal construct. We explain the mechanisms, review prior attempts to model reversed item bias, present our new model, and apply it to responses to a four-item self-esteem scale (N = 306) and the six-item Revised Life Orientation Test (N = 595). Based on the literature review and the empirical results, we formulate recommendations on how to use reversed items in questionnaires.Key words: reverse-keyed items, method effects, response styles, survey research, structural equation modeling. 1 Reverse-keyed items are items for which respondents' scores have to be recoded (i.e., reflected about the midpoint of the rating scale) in order for all the items in a multi-item scale to have the same directional relationship with the underlying construct of interest. The use of reverse-keyed items (also called oppositely-keyed, reversed-polarity, reverse-worded, negatively worded, negatively-keyed, keyed-false, or simply reversed items) is sometimes recommended to disrupt non-substantive responding and to enable the detection and control of aberrant response behavior when it occurs (e.g., Nunnally, 1978, Chapter 15;Paulhus, 1991).However, research has shown that reversed items often lead to problems, particularly poor model fit of factor models (e.g., Marsh, 1986). In some cases, the problem is not simply that the model based on the originally hypothesized substantive factor structure is found to be inadequate, but that the lack of fit stimulates the revision of a more parsimonious conceptualization and the specification of additional substantive factors. For example, a unidimensional model in which high and low self-esteem are considered to be opposite poles of a single underlying continuum might be rejected in favor of a model in which separate, correlated factors are posited for positive and negative self-esteem corresponding to regular and reversed items (cf. Horan, DiStefano, & Motl, 2003;Motl & DiStefano, 2002).A variety of models have been proposed to take into account differences in responding to regular and reverse-keyed items and to avoid the mistaken specification of additional substantive factors, including models with method factors or correlated uniquenesses for either the regular or the reversed items ...

show abstract

“…Los estudios de las propiedades de las pruebas psicológicas demuestran que incluir ítems en formato negativo, aunque común y aceptado como una medida de control de la aquiescencia ante los ítems positivos, favorece la división de factores espurios que no debiesen interpretarse como constructos verdaderos (p. ej., Horan, DiStefano & Motl, 2003). En cuanto al modelo tridimensional (Graetz, 1991), encontramos que los índices de ajuste fueron los más adecuados entre los modelos tradicionales, resultado común en varios estudios (Hankins, 2008;Smith, et al, 2013).…”

Section: Discussionunclassified

Estructura factorial del cuestionario de salud general GHQ-12 en población general de México.

et al. 2016

View full text Add to dashboard Cite

RESUMENOBJETIVO: conocer la estructura factorial del GHQ-12 en México y explorar su utilidad para identificar a personas que perciben tener problemas de salud. METODO: participaron 1093 adultos sin diagnóstico de enfermedades crónicas; 462 fueron varones, con una edad media de 32.2 años (DT=13.2) y 631 mujeres, con una edad media de 29.1 años (DT=12.0). Se realizaron comparaciones de correlaciones, medias y varianzas para explorar los efectos de la redacción de ítems en forma negativa versus positiva. Posterior al AFE, se compararon los índices de ajuste de los modelos multidimensionales, del unidimensional original y del unidimensional con 'efectos del método'. Se comparó la percepción general de salud y los puntajes del GHQ-12 para mujeres y hombres. RESULTADOS: el modelo unidimensional con 'efectos de método' (errores correlacionados) mostró el mejor ajuste a los datos. Los puntajes de ítems positivos, negativos y el total fueron más altos para participantes con problemas de salud, pero solo las varianzas e intervalos de confianza de los ítems positivos fueron consistentes y homogéneos. CONCLUSION: se apoya que el GHQ-12 es una medida unidimensional. Aplicado en población mexicana muestra una estructura factorial semejante a la de países orientales y occidentales. Se sugiere utilizar el puntaje de los ítems positivos del instrumento como un método general de tamizaje del bienestar/malestar psicológico.PALABRAS CLAVE: Análisis factorial confirmatorio, efectos de redacción, estructura factorial, GHQ-12, México. ABSTRACT OBJECTIVES: 1. To know the factor structure of the GHQ-12 in Mexican adult population. 2. To explore its usefulness to identify individuals who report health problems. METHOD: The study was carried out with a sample composed of 1093 adults without diagnosis of chronic diseases, divided into 462 males with an average age of 32.2 (DT = 13.2) and 631 females with an average age of 29.1 (DT = 12.0). In order to explore worded items effects positively and negatively, correlations, means, and variances were compared. Following the EFA, the adjustment of index of multidimensional models (the 'original' unidimensional model and the unidimensional with method effects) was compared. Also comparisons between self-reported health and GHQ-12 scores for both sexes were performed. RESULTS: The unidimensional model with 'method effects' obtained the best adjustment. Scores from positive, negative, and total items were higher for participants with self-reported health problems; however, only variances and confidence intervals with positive items were found homogeneous and consistent. CONCLUSION: GHQ-12 is confirmed as a unidimensional measure. Structural factor is similar to that of western and eastern countries when applied to Mexican population. Using the scores of GHQ-12 positive items as a screening method of psychological welfare/psychological is advised.

show abstract

Wording Effects in Self-Esteem Scales: Methodological Artifact or Response Style?

Cited by 144 publications

References 27 publications

Professional quality of life in nurses: Contribution for the validation of the Portuguese version of the Professional Quality of Life Scale-5 (ProQOL-5)

Professional quality of life in nurses: Contribution for the validation of the Portuguese version of the Professional Quality of Life Scale-5 (ProQOL-5)

Reversed item bias: An integrative model.

Estructura factorial del cuestionario de salud general GHQ-12 en población general de México.

Contact Info

Product

Resources

About