A new approach to computerized adaptive testing

Kuravsky, L S; Artemenkov, S L; Yuryev, G.A.; Grigorenko, Elena L.

doi:10.17759/exppsy.2017100303

Cited by 18 publications

(1 citation statement)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Probabilistic models represented by Markov random processes with discrete states and continuous time [6,[18][19][20][21][22][23][24][25]32] for each pattern cluster are created using the identification procedure to represent probabilistic dynamics for each operator skill class to forecast probabilistic class behavior. This step is implemented in two ways: via distribution of probabilities of being in model states and via dynamics of mathematical expectations for each independent parameter determined with the aid of the Principal Components Analysis (correspondingly, these parameters are considered approximately as independent ones).…”

Section: Basic Approach: Analysis Of Activity Parameters Represented mentioning

confidence: 99%

New approaches for assessing the activities of operators of complex technical systems

Kuravsky

Yuriev

Zlatomrezhev

2019

Experimental Psychology (Russia)

Self Cite

View full text Add to dashboard Cite

Presented are new approaches for supporting the outcome grading for activities of operators of complex technical systems, which are based on comparisons of current exercises with the activity database patterns in both the wavelet representation metric associated with time series of activity parameters and the likelihood metric of eigenvalue trajectories for these parameters transforms as well as on probabilistic assessments of skill class recognition using sample distribution functions of exercise distances to cluster centers in a scaling space and Bayesian likelihood estimations with the aid of probabilistic profile of staying in activity parameter ranges. These techniques have demonstrated the capabilities of recognizing sets of abnormal exercises and detection of parameters characterizing operator mistakes to reveal the causes of abnormality. The techniques in question overcome limitations of existing methods and provide advantages over manual data analysis since they greatly reduce the combinatorial enumeration of the options considered.

show abstract

Section: Basic Approach: Analysis Of Activity Parameters Represented mentioning

confidence: 99%

New approaches for assessing the activities of operators of complex technical systems

Kuravsky

Yuriev

Zlatomrezhev

2019

Experimental Psychology (Russia)

Self Cite

View full text Add to dashboard Cite

show abstract

Analysis of statistical dependencies between intellectual characteristics and gaming ability, measured with the aid of a computer game

Margolis

Kuravsky

Artemenkov

et al. 2020

Int. J. Model. Simul. Sci. Comput.

View full text Add to dashboard Cite

The aim of this paper is testing a computer game as an alternative tool for the assessment of intelligence and creativity of school children. The relevance of the research task is determined by the growing interest in practical psychology in the use of computer games as a special diagnostic tool in educational process. There are two original factor models that have been developed and the structural equation modeling of measured parameters has been carried out. The relationships between game dynamic and final individual results in the computer game, on the one hand, and psychometric intelligence and divergent creativity, on the other, are presented. Weak correlation between the above-mentioned and individually measured intellectual and creativity characteristics of the participants with the computer game results was discovered. Consideration of these characteristics in the form of a common latent factor makes it possible to identify the corresponding dependencies only in some cases when there is a dividing the sample into groups according to their ability level. Particularly, the dynamics of game scoring allows to refer participants to the target group with a certain level of abilities (high intelligence and creativity versus low intelligence and creativity), and it is the high level of psychological traits that determines effectiveness in the game behavior, but not vice versa. The qualitative ratios of the two groups of subsets of participants were revealed: weak, medium and strong players and players with three different levels of psychological abilities. The prospects for the further use of computer games for assessment of cognitive abilities in the measurement of combination of psychological abilities are discussed.

show abstract

A narrative review of adaptive testing and its application to medical education

Burr,

Gale,

Kisielewska

et al. 2023

MedEdPublish

View full text Add to dashboard Cite

Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.

show abstract

A new approach to computerized adaptive testing

Cited by 18 publications

References 6 publications

New approaches for assessing the activities of operators of complex technical systems

New approaches for assessing the activities of operators of complex technical systems

Analysis of statistical dependencies between intellectual characteristics and gaming ability, measured with the aid of a computer game

A narrative review of adaptive testing and its application to medical education

Contact Info

Product

Resources

About