Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review

Kusmaryono, Imam; Wijayanti, Dyana

doi:10.12973/ijem.8.4.625

Cited by 23 publications

(12 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Though, with fewer than four alternatives, the reliability and validity decrease, and from seven alternatives onwards psychometric properties of the scale scarcely increase further (Lozano et al, 2008). In addition, Kusmaryono et al (2022) reported that Likert scale with response categories (5) was the most popular than the other choices, and both response categories (5 and 7) resulted in a higher mean score and their statistical characteristics were very similar. However, the measurement spectrum was somewhat wider for longer responses.…”

Section: Discussionmentioning

confidence: 99%

Psychometric properties of the Cultural Intelligence Scale based on item response theory

Darandari,

Khayat

2023

Int J Selection Assessment

View full text Add to dashboard Cite

The aim of this study was to investigate the psychometric properties of Cultural Intelligence Scale (CQS), based on item response theory (IRT) using the graded response model (GRM). The study calibration sample included 400, while the study sample included 1000, male and female Saudi participants, aged between 18 and 62 years. IRT‐GRM results supported the quality of the psychometric properties of CQS, and its appropriateness to measure cultural intelligence (CQ) for the majority of individuals. CQS well‐distinguished people at different ability levels along the CQ latent trait, particularly with middle and low abilities. However, CQS full scale and subscales had less accurate measurement precision at high levels of CQ, and some subscales had more precision at low level abilities. CQS items had medium ability to differentiate among subjects, and they provided more information in evaluating individuals with medium CQ. Therefore, CQS might be more suitable for identification and development purposes, where low to med‐levels of CQ are expected. Additional assessment procedures need to be added, for selection or promotion purposes to increase the measurement precision. Confirmatory factor analysis results confirmed the multidimensional construct of CQS with four specific‐related factors at the first level, and an aggregate factor at the second level. This model provided better model fit using IRT‐GRM approach, and it was supported by classical test theory analysis results. Therefore, it is important to rely on subscale scores, besides the total score to interpret CQ for individuals. The study stressed the importance of examining CQS item parameters and information based on the country it is adapted for, to investigate how they interact with country culture; and to take into account ability level, when selecting optimal measures.

show abstract

Section: Discussionmentioning

confidence: 99%

Psychometric properties of the Cultural Intelligence Scale based on item response theory

Darandari,

Khayat

2023

Int J Selection Assessment

View full text Add to dashboard Cite

show abstract

“…Each item was ranked on a 5-point scale with anchors of 1 (highly unlikely) to 5 (highly likely). Likert scales are commonly used in social science research and measure qualitative data in an ordinal manner [ 56 ]. Previous research has shown them to have validity and reliability greater than 0.80 [ 57 ].…”

Section: Methodsmentioning

confidence: 99%

COVID-19 vaccine intentions and attitudes in Black American emerging adults with asthma

Hall,

Movva,

Dailey

et al. 2024

BMC Public Health

View full text Add to dashboard Cite

Background Emerging adults (aged 18–29) are less likely to receive the COVID-19 vaccine than any other adult age group. Black Americans are less likely than non-Hispanic white Americans to be fully vaccinated against COVID-19. This study explored factors which affect vaccine intention and attitudes in Black American emerging adults with asthma. Methods Participants were recruited from an NHLBI-funded clinical trial to improve asthma control. Fifty-nine Black American emerging adults completed a Qualtrics survey that assessed asthma control, intention to vaccinate, and factors which may affect the decision to vaccinate. Twenty-five participants also completed a semi-structured interview via Zoom. Bivariate correlations and descriptive statistics, including Chi Square analyses, were run using SPSS. Interview thematic analyses were conducted via QDA Miner. Results Of the 59 Black American emerging adults with asthma who completed surveys, 32.2% responded that they were highly unlikely to receive the COVID-19 vaccine, while 50.8% responded that they were highly likely to receive it. Increased asthma control was significantly correlated with a higher likelihood to discuss the COVID-19 vaccine with their healthcare provider (ρ = 0.339, α = 0.011). Concerns about immediate (ρ= -0.261, α = 0.050) and long-term (ρ= -0.280, α = 0.035) side effects were inversely correlated with intention to vaccinate. Only 17% of the participants who were unemployed stated that they were highly likely to receive the vaccines compared to 65% of the participants who were employed; however, interview participants who were unemployed stated not needing the vaccine because they were protecting themselves by social distancing. When deciding whether to receive the vaccine, safety, efficacy, and immediate side effects were the top three factors for 91%, 54%, and 49% of the participants, respectively. Beliefs about the vaccines’ safety and efficacy, information gathering, personal factors, and societal factors emerged as important themes from the interviews. Conclusion Only half of the surveyed Black American emerging adults with asthma were highly likely to receive the COVID-19 vaccine. Safety and efficacy were important for the majority of the participants, regardless of vaccine intention. Greater asthma control, but not access to asthma-related healthcare, was correlated with intention to discuss the vaccine with their healthcare provider.

show abstract

“…This section discusses the methods applied to report on the concept, implementation, and impact of multiple representation approach learning in elementary school science learning. The PRISMA method in this study used Scopus and ERIC databases to run systematic reviews, eligibility and exclusion criteria, review process procedures (identification, screening, eligibility), and data abstraction and analysis (Kusmaryono & Maharani, 2022;Mohd Rashid & Wong, 2023;Nizhenkovska et al, 2022).…”

Section: Methodsmentioning

confidence: 99%

Multiple Representation Approach in Elementary School Science Learning: A Systematic Literature Review

Zuhri

Wilujeng

Haryanto

2023

IJLTER

View full text Add to dashboard Cite

The paper investigates the multiple representation approach as used in elementary school science learning. A systematic literature review (SLR) method and preferred reporting items for systematic review and meta-analysis (PRISMA) protocol were employed in this research. This included systematic review stages, eligibility and exclusion criteria, review process procedures, and data abstraction and analysis assisted by Publish or Perish 7, VOSviewer, and NVivo 12 Plus applications. The search for publications on Scopus through the Publish or Perish 7 application yielded 605 publications, and for the ERIC database, there were 2018 publications, making 2623 publications. The publications were then filtered according to compatible themes and 50 were selected to be used as material for the SLR. The 50 publications were analyzed according to the assigned topics through the NVivo 12 Plus application, and the results are described in this paper. According to literature, multiple representations is a learning approach that involves using more than one or two representations. This is done by utilizing text, video, tables, audio, animation, diagrams, analogies, cartoons, movements, formulas, and graphs to reflect, interpret, and solve scientific problems in elementary science learning. The multiple representation approach is implemented through task assignment, visualization technology; representation of images, symbols, tables, pictures, and graphs; scientific investigations; engineering design; technological skills; applications; recordings; and written symbols. The impact that the multiple representation approach has in elementary science learning is an increase in reasoning skills, critical thinking skills, communication skills, solving of science problems, concern for nature conservation, and social and visual intelligence. This paper contributes to research examining multiple representations in elementary school science learning.

show abstract

Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review

Cited by 23 publications

References 65 publications

Psychometric properties of the Cultural Intelligence Scale based on item response theory

Psychometric properties of the Cultural Intelligence Scale based on item response theory

COVID-19 vaccine intentions and attitudes in Black American emerging adults with asthma

Multiple Representation Approach in Elementary School Science Learning: A Systematic Literature Review

Contact Info

Product

Resources

About