The Effects of Item Grouping on the Reliability and Scale Scores of an Affective Measure

Melnick, Steven A.

doi:10.1177/0013164493053001023

Cited by 10 publications

(5 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition to the five reversed items, Items 14, 15, and 16 of the original PSWQ also were eliminated. 7 The mere positioning of these items as the final three on the PSWQ may suggest some effect of response bias as it pertains to item placement (Melnick, 1993;Mollenkopf, 1950). For example, it is conceivable that older adults may become less attentive to item content as a function of the passage of time and number of items requiring responses.…”

Section: Discussionmentioning

confidence: 99%

Assessing worry in older adults: Confirmatory factor analysis of the Penn State Worry Questionnaire and psychometric properties of an abbreviated model.

Hopko

Stanley

Reas

et al. 2003

Psychological Assessment

218

178

View full text Add to dashboard Cite

The assessment of worry among older adults typically has involved measures designed with younger cohorts. Because of special concerns in assessing older adults, modifications to existing instruments may be necessary. Addressing equivocal factor analytic data on the Penn State Worry Questionnaire (PSWQ) among younger adults, the authors conducted confirmatory factor analyses to evaluate the generalizability of previous models to older adults with generalized anxiety disorder. Data fit poorly with established single- and two-factor models. The single-factor model was modified, resulting in the elimination of 8 items, strong fit indices, high internal consistency, adequate test-retest reliability, and good convergent and divergent validity. Further psychometric work is required to assess whether the revised model is a more parsimonious method to assess late-life anxiety.

show abstract

Section: Discussionmentioning

confidence: 99%

Assessing worry in older adults: Confirmatory factor analysis of the Penn State Worry Questionnaire and psychometric properties of an abbreviated model.

Hopko

Stanley

Reas

et al. 2003

Psychological Assessment

218

178

View full text Add to dashboard Cite

show abstract

“…The CVI process and item refinement were repeated until an acceptable level of content validity was reached (average CVI ≥ 0.80; [ 48 ]). Items were ordered thematically in relation to the domain they were intended to represent, as this has been shown to enhance internal consistency reliability ( 49 , 50 ).…”

Section: Methodsmentioning

confidence: 99%

Establishing Face and Content Validity of a Survey to Assess Users’ Perceptions of Automated Vehicles

Mason

Classen

Wersal

et al. 2020

Transportation Research Record

View full text Add to dashboard Cite

Fully automated vehicles hold promise for providing numerous societal benefits, including drastically reducing road fatalities. However, we know little about the adoption practices of individuals related to automated vehicles. To assess transportation users’ perceptions of automated vehicles, a 40-item survey was designed using guidance from several technology acceptance models. A focus group was used to assess face validity to ensure the items appeared credible and understandable to the layperson. Seven subject-matter experts rated items for their relevance to provide a content validity index for each item and for the overall survey. The final scale had a scale content validity index rating of 1.00, with 32 of 32 items rated greater than or equal to 0.86 and a scale content validity index of 0.96 (mean content validity index of all items), indicating acceptable content validity. The approach adopted in this study ensured the face and content validity of the survey and enhanced the items’ relevance, concision, and clarity. Future validation is required to assess scale reliability and validity. The paper provides an overview of models used for determining acceptance and adoption of technology and describes in detail the methodology used to establish face and content validity of the questionnaire survey developed for assessing adults’ perceptions of automated vehicles.

show abstract

“…The AVUPS developed by Mason et al (2020) , measures adults’ perceptions of AVs to assess the effects of being exposed to AV technology. Items were ordered thematically in relation to the domains they were intended to represent, to enhance internal consistency reliability ( Melnick, 1993 ). The AVUPS contained 28 visual analoge scale (VAS) items, placed on a 100 mm horizontal line with verbal anchors on the extremes, ranging from disagree to agree.…”

Section: Methodsmentioning

confidence: 99%

Construct Validity and Test–Retest Reliability of the Automated Vehicle User Perception Survey

et al. 2021

View full text Add to dashboard Cite

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a) Intention to use; (b) perceived barriers; and (c) well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale = 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (range Hscale = 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N = 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N = 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs.

show abstract

The Effects of Item Grouping on the Reliability and Scale Scores of an Affective Measure

Cited by 10 publications

References 3 publications

Assessing worry in older adults: Confirmatory factor analysis of the Penn State Worry Questionnaire and psychometric properties of an abbreviated model.

Assessing worry in older adults: Confirmatory factor analysis of the Penn State Worry Questionnaire and psychometric properties of an abbreviated model.

Establishing Face and Content Validity of a Survey to Assess Users’ Perceptions of Automated Vehicles

Construct Validity and Test–Retest Reliability of the Automated Vehicle User Perception Survey

Contact Info

Product

Resources

About