The Information Product Methods: A Unified Approach to Dual-Purpose Computerized Adaptive Testing

Zheng, Chanjin; He, Guanrui; Chunlei, Gao

doi:10.1177/0146621617730392

Cited by 9 publications

(8 citation statements)

References 5 publications

(10 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similar results have been observed by Kang et al (2017) within the framework of dual-objective CD-CAT (Kang et al, 2017;McGlohen & Chang, 2008;Wang et al, 2014;Zheng et al, 2018). For simultaneously estimating examinees' α i and general ability θ i , the dual-objective CD-CAT is based on a CDM and an item response theory model.…”

Section: Jsd Indexsupporting

confidence: 71%

“…Tatsuoka & Ferguson, 2003;Xu et al, 2003), the likelihood-or posterior-weighted KL (LWKL or PWKL) index and the hybrid KL index (Cheng, 2009), the restrictive progressive or threshold PWKL index (Wang et al, 2011), the aggregate ranked information index and the aggregate standardized information index (Wang et al, 2014), the modified PWKL (MPWKL) index (Kaplan et al, 2015), the KL expected discrimination index (W. Y. Wang et al, 2015), the posterior-weighted cognitive diagnostic model (CDM) discrimination index and the posteriorweighted attribute-level CDM discrimination index (Zheng & Chang, 2016), and the information product index (Zheng et al, 2018). The second is based on the Shannon entropy, called the Shannon entropy (SHE) procedure (Cheng, 2009;McGlohen & Chang, 2008;C.…”

mentioning

confidence: 99%

See 1 more Smart Citation

A Note on the Relationship of the Shannon Entropy Procedure and the Jensen–Shannon Divergence in Cognitive Diagnostic Computerized Adaptive Testing

et al. 2020

View full text Add to dashboard Cite

The purpose of this study is to investigate the relationship between the Shannon entropy procedure and the Jensen–Shannon divergence (JSD) that are used as item selection criteria in cognitive diagnostic computerized adaptive testing (CD-CAT). Because the JSD itself is defined by the Shannon entropy, we apply the well-known relationship between the JSD and Shannon entropy to establish a relationship between the item selection criteria that are based on these two measures. To understand the relationship between these two item selection criteria better, an alternative way is also provided. Theoretical derivations and empirical examples have shown that the Shannon entropy procedure and the JSD in CD-CAT have a linear relation under cognitive diagnostic models. Consistent with our theoretical conclusions, simulation results have shown that two item selection criteria behaved quite similarly in terms of attribute-level and pattern recovery rates under all conditions and they selected the same set of items for each examinee from an item bank with item parameters drawn from a uniform distribution U(0.1, 0.3) under post hoc simulations. We provide some suggestions for future studies and a discussion of relationship between the modified posterior-weighted Kullback–Leibler index and the G-DINA (generalized deterministic inputs, noisy “and” gate) discrimination index.

show abstract

Section: Jsd Indexsupporting

confidence: 71%

mentioning

confidence: 99%

A Note on the Relationship of the Shannon Entropy Procedure and the Jensen–Shannon Divergence in Cognitive Diagnostic Computerized Adaptive Testing

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Dai et al (2016) have tried several values of ω (0.1, 0.3, 0.5, 0.7, and 0.9) and found that ω = 0.5 provided the best synthetic results. Besides, the information product approach with a weight of 0.5 can be considered as a natural extension of the weighted item selection (Zheng et al, 2018). Setting the weight to 0.5 is also consistent with the view that both α and θ should be considered equally.…”

Section: Discussionmentioning

confidence: 99%

Combining Cognitive Diagnostic Computerized Adaptive Testing With Multidimensional Item Response Theory

Luo

Wang

Guo

et al. 2022

Applied Psychological Measurement

View full text Add to dashboard Cite

The new generation of tests not only focuses on the general ability but also the process of finer-grained skills. Under the guidance of this thought, researchers have developed a dual-purpose CD-CAT (Dual-CAT). In the existing Dual-CAT, the models used in overall ability estimation are unidimensional IRT models, which cannot apply to the multidimensional tests. This article intends to develop a multidimensional Dual-CAT to improve its applicability. To achieve this goal, this article firstly proposes some item selection methods for the multidimensional Dual-CAT, and then verifies the estimation accuracy and exposure rate of these methods through both simulation study and a real item bank study. The results show that the established multidimensional Dual-CAT is effective and the new proposed methods outperform the traditional methods. Finally, this article discusses the future direction of the Dual-CAT.

show abstract

“…As well as data-driven model selection, for instance, use Akaike's information criterion and Bayesian information criterion to select the CDMs. Third, the application of the new method to the dual-objective CD-CAT (McGlohen and Chang, 2008 ; Wang et al, 2012 , 2014 ; Dai et al, 2016 ; Kang et al, 2017 ; Zheng et al, 2018 ) could be investigated in the future. The dual-objective CD-CAT combines the IRT model and CDMs; therefore, it may be able to provide both an overall score and specific diagnostic information for individuals.…”

Section: Discussionmentioning

confidence: 99%

Binary Restrictive Threshold Method for Item Exposure Control in Cognitive Diagnostic Computerized Adaptive Testing

et al. 2021

View full text Add to dashboard Cite

Although classification accuracy is a critical issue in cognitive diagnostic computerized adaptive testing, attention has increasingly shifted to item exposure control to ensure test security. In this study, we developed the binary restrictive threshold (BRT) method to balance measurement accuracy and item exposure. In addition, a simulation study was conducted to evaluate its performance. The results indicated that the BRT method performed better than the restrictive progressive (RP) and stratified dynamic binary searching (SDBS) approaches but worse than the restrictive threshold (RT) method in terms of classification accuracy. With respect to item exposure control, the BRT method exhibited noticeably stronger performance compared with the RT method, even though its performance was not as high as that of the RP and SDBS methods.

show abstract

The Information Product Methods: A Unified Approach to Dual-Purpose Computerized Adaptive Testing

Cited by 9 publications

References 5 publications

A Note on the Relationship of the Shannon Entropy Procedure and the Jensen–Shannon Divergence in Cognitive Diagnostic Computerized Adaptive Testing

A Note on the Relationship of the Shannon Entropy Procedure and the Jensen–Shannon Divergence in Cognitive Diagnostic Computerized Adaptive Testing

Combining Cognitive Diagnostic Computerized Adaptive Testing With Multidimensional Item Response Theory

Binary Restrictive Threshold Method for Item Exposure Control in Cognitive Diagnostic Computerized Adaptive Testing

Contact Info

Product

Resources

About