The Determination of the Significance of Change between Pre- and Posttesting Periods

Linn, Robert L.; Slinde, Jeffrey A.

doi:10.2307/1169971

Cited by 81 publications

(103 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…According to a number of analysts working in educational research, change scores are systematically related to random errors of measurement at both baseline and follow-up and have lower reliability than the variables from which they were derived (16)(17)(18). One effect of this is to substantially attenuate correlations with other variables, which may lead to erroneous conclusions concerning the predictors of change (17). Some believe that these problems are so severe that change scores should never be used in the analysis of change (16).…”

Section: Psychometric Propertiesmentioning

confidence: 99%

See 1 more Smart Citation

Issues in measuring change in self-perceived oral health status

Locker

1998

Community Dentistry and Oral Epidemiology

View full text Add to dashboard Cite

An important goal of a health care intervention or system is to improve the health of an individual or a population. The challenge for health services research is to measure and explain this change. However, the issue of how changes in health status should be defined and measured has been given relatively little attention. This paper draws on the rather sparse literature to examine some issues involved in measuring changes in oral health status and illustrates these using data from a longitudinal study of the oral health of older adults. The paper draws a distinction between quantitative and qualitative change and the challenges involved with each. Four different ways of assessing change are reviewed and their strengths and weaknesses highlighted. Global transition judgements, although relatively simple measures of change, incorporate patients' values and avoid the statistical problems associated with measures such as change scores. Nevertheless, the measurement of change in oral health status is complex and controversial and no approach is universally accepted. Consequently, the decision as to which strategy to adopt is far from simple.

show abstract

Section: Psychometric Propertiesmentioning

confidence: 99%

“…This provides a base-free measure of change which is unrelated to the initial measurement. Again, there is a debate concerning the extent to which they avoid the problems associated with the use of raw change scores (17).…”

mentioning

confidence: 99%

Issues in measuring change in self-perceived oral health status

Locker

1998

Community Dentistry and Oral Epidemiology

View full text Add to dashboard Cite

show abstract

“…In other studies, in particular concerning older children and adults, the time needed to complete the task is analysed, sometimes controlling for baseline speed by subtracting or dividing by the time needed for a control task (e.g., Lehto et al, 2003;Miyake et al, 2000). However, difference scores may compromise task reliability, as measurement error variance increases (Linn & Slinde, 1977). Using difference scores also fails to take into account the overadditivity effect: participants that are slow on a control task, slow down disproportionally on any more difficult task (Faust, Balota, Spieler, & Ferraro, 1999).…”

mentioning

confidence: 99%

The structure of executive functions in children: A closer examination of inhibition, shifting, and updating

Ven

Kroesbergen

Boom

et al. 2012

British J of Dev Psycho

118

View full text Add to dashboard Cite

An increasing number of studies has investigated the latent factor structure of executive functions. Some studies found a three-factor structure of inhibition, shifting, and updating, but others could not replicate this finding. We assumed that the task choices and scoring methods might be responsible for these contradictory findings. Therefore, we selected tasks in which input modality was varied, controlled for baseline speed, and used both speed and accuracy scores, in order to investigate whether a three factor model with inhibition, shifting, and updating could still be replicated. In a group of 211 children, who were tested at the beginning of grade 1, at approximately 6 years of age, and again after 18 months, the best fitting model was not the three-factor model, but instead consisted of an updating factor and a combined inhibition and shifting factor, besides two baseline speed factors (verbal and motor). We argue that these results might indicate that the structural organization of executive functions might be different in children than in adults, but that there might also be an alternative explanation: the distinction in executive functions might not accurately represent cognitive structures but instead be a methodological artefact.

show abstract

“…In a gain score analysis, gain scores are calculated as the difference in total test score (number of items correct) across testing occasions. Gain scores have long been criticized for having poor psychometric properties, primarily low reliability (Cronbach & Furby, ; Linn & Slinde, ; Lord, ; Williams & Zimmerman, ). Alternatively, in a longitudinal IRT model the difference in ability estimates over testing occasions can be interpreted as a quantification of growth.…”

mentioning

confidence: 99%

Reliably Assessing Growth with Longitudinal Diagnostic Classification Models

Madison

2019

Educational Measurement

View full text Add to dashboard Cite

Recent advances have enabled diagnostic classification models (DCMs) to accommodate longitudinal data. These longitudinal DCMs were developed to study how examinees change, or transition, between different attribute mastery statuses over time. This study examines using longitudinal DCMs as an approach to assessing growth and serves three purposes: (1) to define and evaluate two reliability measures to be used in the application of longitudinal DCMs; (2) through simulation, demonstrate that longitudinal DCM growth estimates have increased reliability compared to longitudinal item response theory models; and (3) through an empirical analysis, illustrate the practical and interpretive benefits of longitudinal DCMs. A discussion describes how longitudinal DCMs can be used as practical and reliable psychometric models when categorical and criterion‐referenced interpretations of growth are desired.

show abstract

The Determination of the Significance of Change between Pre- and Posttesting Periods

Cited by 81 publications

References 0 publications

Issues in measuring change in self-perceived oral health status

Issues in measuring change in self-perceived oral health status

The structure of executive functions in children: A closer examination of inhibition, shifting, and updating

Reliably Assessing Growth with Longitudinal Diagnostic Classification Models

Contact Info

Product

Resources

About