Ordinal response variation of the polytomous Rasch model

Turetsky, Vladimir; Bashkansky, Emil

doi:10.1007/s40300-022-00229-w

Cited by 5 publications

(4 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To conclude, we have presented both a methodology [25] to overcome current practice shortcomings in analyzing word learning list tests, i.e., using the Rasch model [17] and CSE [4], [5], as well as additional evidence for how repeated trials can lead to learning effects. This can be clinically used not only to measure a person's memory but also his or her learning ability.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Entropy-based explanations of serial position and learning effects in ordinal responses to word list tests

Melin,

Kettunen,

Wallin

et al. 2023

Acta IMEKO

View full text Add to dashboard Cite

Measuring a person’s cognitive abilities, such as memory and learning, is central in many medical conditions to reliably diagnose, treat and monitor disease progression. Common tests typically include tasks of recalling sequences of blocks, digits or words. Recalling a word list is affected by so-called serial position effects (SPE), meaning that words at the beginning or end of the list are more likely to be recalled. In our earlier work, as part of including ordinal and nominal properties in metrology, compensation for ordinality in the raw test scores has been performed with psychometric Rasch measurement theory. Thereafter, SPE have been successfully explained with construct specification equations (CSE) dominated by information theoretical entropy as candidate reference measurement procedures. Here, we present how previous German results for explaining memory difficulty in the immediate recalling (IR, trial 1) task of the Rey’s Auditory Verbal Learning Test (RAVLT) can be replicated with a Swedish cohort (the Gothenburg Mild Cognitive Impairment study, n = 251). This CSE replicability for RAVLT demonstrates comparability across the two cohorts in a kind of inter-laboratory study. Moreover, RAVLT includes repeated trials and learning through practice is expected. How memory task difficulty changes over the eight trials in RAVLT is studied: SPE are not so prominent for the delayed recalling sequences and there is an overall reduction in the task difficulty CSE intercept with trial number, interpreted as an effect of learning. To conclude, the methodology and evidence provided here can be clinically used not only to measure a person’s memory ability but also his or her learning ability, as well as understanding the relationship between learning ability and other cognitive domains.

show abstract

Section: Discussionmentioning

confidence: 99%

“…For example, Moradi et al [4] define learning in RAVLT as the score of trial 5 minus the score of trial 1. Raw scores equal 1 for pass or 0 for fail, i.e., an ordinal scale [17], [18]. However, because of ordinality, such classifications have no numerical meaning and only serve to clearly indicate the ordered categories [8].…”

Section: Introductionmentioning

confidence: 99%

Entropy-based explanations of serial position and learning effects in ordinal responses to word list tests

Melin,

Kettunen,

Wallin

et al. 2023

Acta IMEKO

View full text Add to dashboard Cite

show abstract

“…For example, in the memory Rey’s Auditory Verbal Learning Test (RAVLT), where raw scores equal 1 for pass or 0 for fail, Moradi et al ([ 47 ], p. 417) defined learning as the score of trial 5 minus the score of trial 1. However, raw scores have no numerical meaning and only serve to indicate the ordered categories ([ 48 ], p. 2). In turn, such an improper analysis will only lead to unnecessarily large uncertainties (expressed in terms of entropy according to (ii) above) and to associated increased risks of incorrect decisions.…”

Section: Appendix A1 Analysing Categorical Responsesmentioning

confidence: 99%

The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests: Extension to Word Lists

Melin

Cano²,

Flöel

et al. 2022

Entropy

View full text Add to dashboard Cite

Metrological methods for word learning list tests can be developed with an information theoretical approach extending earlier simple syntax studies. A classic Brillouin entropy expression is applied to the analysis of the Rey’s Auditory Verbal Learning Test RAVLT (immediate recall), where more ordered tasks—with less entropy—are easier to perform. The findings from three case studies are described, including 225 assessments of the NeuroMET2 cohort of persons spanning a cognitive spectrum from healthy older adults to patients with dementia. In the first study, ordinality in the raw scores is compensated for, and item and person attributes are separated with the Rasch model. In the second, the RAVLT IR task difficulty, including serial position effects (SPE), particularly Primacy and Recency, is adequately explained (Pearson’s correlation R=0.80) with construct specification equations (CSE). The third study suggests multidimensionality is introduced by SPE, as revealed through goodness-of-fit statistics of the Rasch analyses. Loading factors common to two kinds of principal component analyses (PCA) for CSE formulation and goodness-of-fit logistic regressions are identified. More consistent ways of defining and analysing memory task difficulties, including SPE, can maintain the unique metrological properties of the Rasch model and improve the estimates and understanding of a person’s memory abilities on the path towards better-targeted and more fit-for-purpose diagnostics.

show abstract

“…Passes or fails in responses to memory tests are just observations, lying at best on an ordinal response scale, and simply counting the number of passes cannot be regarded as measurement, since the latter must be at least on an interval scale [7,27,28]. Ordinal observations (such as responses to memory tests) are subject to possible scale non-linearity, which, unless evaluated and corrected for, will lead to uncertainties and decision risks.…”

Section: Introductionmentioning

confidence: 99%

Forward and Backward Recalling Sequences in Spatial and Verbal Memory Tasks: What Do We Measure?

Melin

Göschel

Hagell

et al. 2023

Entropy

View full text Add to dashboard Cite

There are different views in the literature about the number and inter-relationships of cognitive domains (such as memory and executive function) and a lack of understanding of the cognitive processes underlying these domains. In previous publications, we demonstrated a methodology for formulating and testing cognitive constructs for visuo-spatial and verbal recall tasks, particularly for working memory task difficulty where entropy is found to play a major role. In the present paper, we applied those insights to a new set of such memory tasks, namely, backward recalling block tapping and digit sequences. Once again, we saw clear and strong entropy-based construct specification equations (CSEs) for task difficulty. In fact, the entropy contributions in the CSEs for the different tasks were of similar magnitudes (within the measurement uncertainties), which may indicate a shared factor in what is being measured with both forward and backward sequences, as well as visuo-spatial and verbal memory recalling tasks more generally. On the other hand, the analyses of dimensionality and the larger measurement uncertainties in the CSEs for the backward sequences suggest that caution is needed when attempting to unify a single unidimensional construct based on forward and backward sequences with visuo-spatial and verbal memory tasks.

show abstract

Ordinal response variation of the polytomous Rasch model

Cited by 5 publications

References 29 publications

Entropy-based explanations of serial position and learning effects in ordinal responses to word list tests

Entropy-based explanations of serial position and learning effects in ordinal responses to word list tests

The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests: Extension to Word Lists

Forward and Backward Recalling Sequences in Spatial and Verbal Memory Tasks: What Do We Measure?

Contact Info

Product

Resources

About