Computerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison With Short Forms

Hol, A.M.; Vorst, Harrie C. M.; Mellenbergh, Gideon J.

doi:10.1177/0146621606297314

Cited by 23 publications

(27 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…., k j items. Each fixed-length test was created by selecting the first i j administered items of the scale (see Hol et al, 2007, for a similar procedure).…”

Section: Methodsmentioning

confidence: 99%

Polytomous Adaptive Classification Testing

Gnambs

Batinic

2011

Educational and Psychological Measurement

View full text Add to dashboard Cite

Computer-adaptive classification tests focus on classifying respondents in different proficiency groups (e.g., for pass/fail decisions). To date, adaptive classification testing has been dominated by research on dichotomous response formats and classifications in two groups. This article extends this line of research to polytomous classification tests for two-and three-group scenarios (e.g., inferior, mediocre, and superior proficiencies). Results of two simulation experiments with generated and real responses (N ¼ 2,000) to established personality scales of different length (12, 20, or 29 items) demonstrate that adaptive item presentations significantly reduce the number of items required to make such classification decisions while maintaining a consistent classification accuracy. Furthermore, the simulations highlight the importance of the selected test termination criterion, which has a significant impact on the average test length.

show abstract

“…., k j items. Each fixed-length test was created by selecting the first i j administered items of the scale (see Hol et al, 2007, for a similar procedure).…”

Section: Methodsmentioning

confidence: 99%

Polytomous Adaptive Classification Testing

Gnambs

Batinic

2011

Educational and Psychological Measurement

View full text Add to dashboard Cite

show abstract

“…Computer adaptive testing methods shorten test length by 62.5%, or require only an estimated nine items (Hol et al, 2007). In the present study, our CAT used much fewer items than the preset ten items and average respondents answered slightly more than 6 items for each construct.…”

Section: Discussionmentioning

confidence: 72%

“…Studies have shown that CAT improves test efficiency maintaining adequate precision with fewer items than the full test (Elhan et al, 2008;Flynn et al, 2008;Haley et al, 2008;Hart et al, 2006;Hol et al, 2007;Jette et al, 2008;Velozo et al, 2006;Ware et al, 2003;Weiss, 1982). CAT measures are highly correlated with other assessments intending to measure the same construct and require fewer items.…”

Section: Introductionmentioning

confidence: 99%

A Comparative Study of Oswestry Back Pain Disability Questionnaire Versus Computer Adaptive Testing for Measuring Back Pain

Choi¹

2013

Physical Therapy Korea

View full text Add to dashboard Cite

1)The aim of the present study was to compare measurement precisions of the Oswestry Back Pain Disability Questionnaire (ODQ) and a computer adaptive testing (CAT) method. The ODQ has been regarded as one of the most reliable condition-specific measure for back pain for decades. Cross-sectional study was carried out with two independent convenient samples from two out-patient rehabilitation clinics for back pain (n1=42) and non-back pain group (n2=42). Participants were asked to fill out the ODQ and CAT of International Classification of Functioning, Disability and Health-Activity Measure (ICF-AM). A series of Rasch analyses were performed to calculate person ability measures. The CAT measures had greater relative precision in discriminating the groups than did the ODQ measure in comparisons of the relative precision. The CAT measure appears to be more effective than did the ODQ measure in terms of measurement precision. By administering test items calibrated in a way, CAT measures using item response theory may promise a means with measurement precision as well as efficiency.

show abstract

“…Numerous studies have recently found that CAT improves both in measurement precision and efficiency relative to the full test (Elhan et al, 2008;Flynn et al, 2008;Haley et al, 2008;Hart et al, 2006;Hol et al, 2007;Jette et al, 2008;Ware et al, 2003;Weiss, 1982). Several studies have also been reported that CAT measures are highly correlated with other instruments measuring same construct and require fewer number of items with an average 6 items to reach the ability estimation (Fliege et al, 2009;Hart et al, 2008a;Hart et al, 2008b;Shone et al, 1993).…”

Section: Item Response Theory and Computer Adaptive Testingmentioning

confidence: 99%

Computer Adaptive Testing Method for Measuring Disability in Patients With Back Pain

Choi¹

2012

Physical Therapy Korea

View full text Add to dashboard Cite

1)Most conventional instruments measuring disability rely on total score by simply adding individual item responses, which is dependent on the items chosen to represent the underlying construct (test-dependent) and a test statistic, such as coefficient alpha for the estimate of reliability, varying from sample to sample (sample-dependent). By contrast, item response theory (IRT) method focuses on the psychometric properties of the test items instead of the instrument as a whole. By estimating probability that a respondent will select a particular rating for an item, item difficulty and person ability (or disability) can be placed on same linear continuum. These estimates are invariant regardless of the item used (test-free measurement) and the ability of sample applied (sample-free measurement). These advantages of IRT allow the creation of invariantly calibrated large item banks that precisely discriminate the disability levels of individuals. Computer adaptive testing (CAT) method often requiring a testing algorithm promise a means for administering items in a way that is both efficient and precise. This method permits selectively administering items that are closely matched to the ability level of individuals (measurement precision) and measuring the ability without the loss of precision provided by the full item bank (measurement efficiency). These measurement properties can reasonably be achieved using IRT and CAT method. This article aims to investigate comprehensive overview of the existing disability instrument for back pain and to inform physical therapists of an alternative innovative way overcoming the shortcomings of conventional disability instruments. An understanding of IRT and CAT method will equip physical therapist with skills in interpreting the measurement properties of disability instruments developed using the methods.

show abstract

Computerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison With Short Forms

Cited by 23 publications

References 30 publications

Polytomous Adaptive Classification Testing

Polytomous Adaptive Classification Testing

A Comparative Study of Oswestry Back Pain Disability Questionnaire Versus Computer Adaptive Testing for Measuring Back Pain

Computer Adaptive Testing Method for Measuring Disability in Patients With Back Pain

Contact Info

Product

Resources

About