A parametric analysis of ordinal quality-of-life data can lead to erroneous results

Kahler, Elke; Rogausch, Anja; Brunner, Edgar; Himmel, Wolfgang

doi:10.1016/j.jclinepi.2007.05.019

Cited by 42 publications

(31 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Much deliberation appears in the literature about the nature of Likert-type data and the assumptions needed to be met for this Figure 1. Implementation of the SSI program type of data to be analyzed parametrically (Clason & Dormody, 1994;Jamieson, 2004;Kahler, Rogausch, Brunner, & Himmel, 2008;Nanna & Sawilosky, 1998). Due to the ordinal nature of our data, particularly when analyzing data consisting of two or three combined Likert items, appropriate non-parametric tests of significance were used to determine the extent the SSI program facilitated changes in the students' character and values as global citizens (Cohen, 1988;Conover, 1999;Grissom & Kim, 2005).…”

Section: Data Collection and Analysismentioning

confidence: 99%

Socioscientific Issues as a Vehicle for Promoting Character and Values for Global Citizens

Lee

Yoo

Choi

et al. 2013

International Journal of Science Education

138

View full text Add to dashboard Cite

Our guiding presupposition in this study was that socioscientific issues (SSI) instruction, given the humanistic features that comprise this type of instruction, could play a role as a vehicle for cultivating character and values as global citizens. Our main objective was to observe how and to what extent SSI instruction might contribute to this. In order to achieve this aim, we implemented a SSI program on genetic modification technology for 132 ninth-grade students over 3-4 weeks and identified its educational effects using a mixed method approach. Data sources included student responses to questionnaire items that measure the students' character and values, records of student discussions, and semi-structured interviews with the students and their teachers. Results indicated that the students became more sensitive to moral and ethical aspects of scientific and technological development and compassionate to diverse people who are either alienated by the benefits of advanced technology or who are vulnerable to the dangers of its unintended effects. In addition, the students felt more responsible for the future resolution of the genetic SSI. However, the students struggled to demonstrate willingness and efficacy to participate within broader communities that entailed action toward SSI resolution.

show abstract

Section: Data Collection and Analysismentioning

confidence: 99%

Socioscientific Issues as a Vehicle for Promoting Character and Values for Global Citizens

Lee

Yoo

Choi

et al. 2013

International Journal of Science Education

138

View full text Add to dashboard Cite

show abstract

“…Interval measures are preferable to ordinal scores: They are characterized by measurement units that maintain the same size over the entire domain so that the measurement of change is more precise. Misusing ordinal scores as they were interval measures can lead to erroneous conclusions in clinical trials [5]. A method that produces interval measures from ordinal scores is desirable.…”

Section: Introductionmentioning

confidence: 99%

Measurement of change in health status with Rasch models

Anselmi

Vidotto

Bettinardi³

et al. 2015

Health and Quality of Life Outcomes

View full text Add to dashboard Cite

BackgroundThe traditional approach to the measurement of change presents important drawbacks (no information at individual level, ordinal scores, variance of the measurement instrument across time points), which Rasch models overcome. The article aims to illustrate the features of the measurement of change with Rasch models.MethodsTo illustrate the measurement of change using Rasch models, the quantitative data of a longitudinal study of heart-surgery patients (N = 98) were used. The scale “Perception of Positive Change” was used as an example of measurement instrument. All patients underwent cardiac rehabilitation, individual psychological intervention, and educational intervention. Nineteen patients also attended progressive muscle relaxation group trainings. The scale was administered before and after the interventions. Three Rasch approaches were used. Two separate analyses were run on the data from the two time points to test the invariance of the instrument. An analysis was run on the stacked data from both time points to measure change in a common frame of reference. Results of the latter analysis were compared with those of an analysis that removed the influence of local dependency on patient measures. Statistics t, χ2 and F were used for comparing the patient and item measures estimated in the Rasch analyses (a-priori α = .05). Infit, Outfit, R and item Strata were used for investigating Rasch model fit, reliability, and validity of the instrument.ResultsData of all 98 patients were included in the analyses. The instrument was reliable, valid, and substantively unidimensional (Infit, Outfit < 2 for all items, R = .84, item Strata range = 3.93-6.07). Changes in the functioning of the instrument occurred across the two time, which prevented the use of the two separate analyses to unambiguously measure change. Local dependency had a negligible effect on patient measures (p ≥ .8674). Thirteen patients improved, whereas 3 worsened. The patients who attended the relaxation group trainings did not report greater improvement than those who did not (p = .1007).ConclusionsRasch models represent a valid framework for the measurement of change and a useful complement to traditional approaches.

show abstract

“…Literature warned researchers against the practice of misusing ordinal raw scores as they were interval measures (eg, calculating means, standard deviations and effect sizes) [31,32], and showed erroneous conclusions that can derive from applying parametric analyses inappropriately [33]. Since Rasch models allow for the transformation of ordinal raw scores into interval measures, they have been suggested as a valuable tool in both the analysis of clinical data, and the development and evaluation of instruments [30,34,35].…”

Section: Discussionmentioning

confidence: 99%

A short questionnaire to assess pediatric resident’s competencies: the validation process

et al. 2013

View full text Add to dashboard Cite

BackgroundIn order to help assess resident performance during training, the Residency Affair Committee of the Pediatric Residency Program of the University of Padua (Italy) administered a Resident Assessment Questionnaire (ReAQ), which both residents and faculty were asked to complete. The aim of this article is to present the ReAQ and its validation.MethodsThe ReAQ consists of 20 items that assess the six core competencies identified by the Accreditation Council of Graduate Medical Education (ACGME). A many-facet Rasch measurement analysis was used for validating the ReAQ.ResultsBetween July 2011 and June 2012, 211 evaluations were collected from residents and faculty. Two items were removed because their functioning changed with the gender of respondents. The step calibrations were ordered. The self evaluations (residents rating themselves) positively correlated with the hetero evaluations (faculty rating residents; Spearman’s ρ = 0.75, p < 0.001). Unfortunately, the observed agreement among faculty was smaller than expected (Exp = 47.1%; Obs = 41%), which indicates that no enough training to faculty for using the tool was provided.ConclusionsIn its final form, the ReAQ provides a valid unidimensional measure of core competences in pediatric residents. It produces reliable measures, distinguishes among groups of residents according to different levels of performance, and provides a resident evaluation that holds an analogous meaning for residents and faculty.

show abstract

A parametric analysis of ordinal quality-of-life data can lead to erroneous results

Cited by 42 publications

References 31 publications

Socioscientific Issues as a Vehicle for Promoting Character and Values for Global Citizens

Socioscientific Issues as a Vehicle for Promoting Character and Values for Global Citizens

Measurement of change in health status with Rasch models

A short questionnaire to assess pediatric resident’s competencies: the validation process

Contact Info

Product

Resources

About