Polytomous Adaptive Classification Testing

Gnambs, Timo; Batinic, Bernad

doi:10.1177/0013164410393956

Cited by 8 publications

(2 citation statements)

References 38 publications

(64 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…(Achtyes et al, 2015;Betz & Turner, 2011;Demir & French, 2021;Hol et al, 2007;Simms et al, 2011;Simms & Clark, 2005;Stochl et al, 2016). The results obtained in this study are consistent with those in the literature (Babcock & Weiss, 2012;Choi & Swartz, 2009;Deng et al, 2010;Eroğlu & Kelecioğlu, 2015;Gnambs & Batinic, 2011;He et al, 2014;Kezer, 2013;Linden, 2005;Ping et al, 2006;Sulak & Kelecioglu, 2019;Weiss, 1982).…”

Section: Discussionsupporting

confidence: 91%

Applicability and Efficiency of a Polytomous IRT-Based Computerized Adaptive Test for Measuring Psychological Traits

Şimşek

TAVŞANCIL>

2022

Eğitimde Ve Psikolojide Ölçme Ve Değerlendirme Dergisi

View full text Add to dashboard Cite

Currently, research on computerized adaptive testing (CAT) focuses mainly on dichotomous items and cognitive traits (achievement, aptitude, etc.). However, polytomous IRT-based CAT is a promising research area for measuring psychological traits that has attracted much attention. The main purpose of this study is to test the practicality of the polytomous IRT-based CAT and its equivalence with the paper-pencil version. Data were collected from 1449 high school students (45% female), using the paper-pencil version for IRT parameter estimates and CAT simulation studies. For the equivalence study, the research group consisted of 81 students (47% female) who participated in both the paper-pencil and live CAT application. The paper-pencil version of vocational interest inventory consists of 17 factors and 164 items. The simulation study showed that the EAP estimation method and the SE < .500 test termination strategy were superior compared to the other CAT designs. The Item selection did not help to reduce test duration or increase measurement accuracy. As a result, it was found that an area of interest can be assessed with about four items. The results of the live CAT application showed that the estimates of CAT were strongly positively correlated with its paper-pencil version. In addition, the live CAT application increased usability compared to the fixed-length test version by reducing test length by 50% and time by 77%. This study shows that the polytomous IRT-based CAT is applicable and efficient for measuring psychological traits.

show abstract

Section: Discussionsupporting

confidence: 91%

Applicability and Efficiency of a Polytomous IRT-Based Computerized Adaptive Test for Measuring Psychological Traits

Şimşek

TAVŞANCIL>

2022

Eğitimde Ve Psikolojide Ölçme Ve Değerlendirme Dergisi

View full text Add to dashboard Cite

show abstract

“…Thus, any hopes that a switch from paper to computer would automatically improve psychological measurements (Buchanan, 2000(Buchanan, , 2001 need to be abandoned. However, computerized testing (including unproctored WBT) holds a variety of additional advantages, such as the use of simulation-based assessment scenarios (Schönbrodt & Asendorpf, 2011) or adaptive item presentations (Gnambs & Batinic, 2011;Simms et al, 2011).…”

Section: Implications For Psychological Assessmentmentioning

confidence: 99%

Socially Desirable Responding in Web-Based Questionnaires: A Meta-Analytic Review of the Candor Hypothesis

Gnambs

Kaspar

2016

Assessment

Self Cite

View full text Add to dashboard Cite

Unproctored, web-based assessments supposedly reduce social desirability distortions in self-report questionnaires because of an increased sense of privacy among participants. Three random-effects meta-analyses focusing either on social desirability ( k = 30, total N = 3,746), the Big Five of personality ( k = 66, total N = 2,951), or psychopathology ( k = 96, total N = 16,034) compared social desirability distortions of self-reports across computerized and paper-and-pencil administration modes. Overall, a near-zero effect, Δ = 0.01, was obtained that did not indicate less socially desirable responding in computerized assessments. Moreover, moderator analyses did not identify differential effects for proctored and unproctored procedures. Thus, paper-and-pencil and computerized administrations of self-report scales yield comparable mean scores. Unproctored web-based surveys do not offer an advantage with regard to socially desirable responding in self-report questionnaires.

show abstract

Stopping Rules for Computer Adaptive Testing When Item Banks Have Nonuniform Information

Bass

Howard

Neapolitan

2019

International Journal of Testing

View full text Add to dashboard Cite

The standard error (SE) stopping rule, which terminates a computer adaptive test (CAT) when the SE is less than a threshold, is effective when there are informative questions for all trait levels. However, in domains such as patient reported outcomes, the items in a bank might all target one end of the trait continuum (e.g., negative symptoms), and the bank may lack depth for many individuals. In such cases, the predicted standard error reduction (PSER) stopping rule will stop the CAT even if the SE threshold has not been reached, and can avoid administering excessive questions that provide little additional information. By tuning the parameters of the PSER algorithm, a practitioner can specify a desired tradeoff between accuracy and efficiency. Using simulated data for the PROMIS Anxiety and Physical Function banks, we demonstrate that these parameters can substantially impact CAT performance. When the parameters were optimally tuned, the PSER stopping rule was found to outperform the SE stopping rule overall and particularly for individuals not targeted by the bank, and presented roughly the same number of items across the trait continuum. Therefore, the PSER stopping rule provides an effective method for balancing the precision and efficiency of a CAT.

show abstract

Polytomous Adaptive Classification Testing

Cited by 8 publications

References 38 publications

Applicability and Efficiency of a Polytomous IRT-Based Computerized Adaptive Test for Measuring Psychological Traits

Applicability and Efficiency of a Polytomous IRT-Based Computerized Adaptive Test for Measuring Psychological Traits

Socially Desirable Responding in Web-Based Questionnaires: A Meta-Analytic Review of the Candor Hypothesis

Stopping Rules for Computer Adaptive Testing When Item Banks Have Nonuniform Information

Contact Info

Product

Resources

About