An adaptive assessment system to compose serial test sheets using item response theory

Abstract

The conventional learning environment is being rapidly supplemented by an E-Learning environment, particularly Computer Assisted Instruction (CAI). Each learner has different learning status and therefore should use different test items in their evaluation. The Computerized Adaptive Test (CAT) can adjust the degree of difficulty of test items dynamically depending on their ability. One of the most important and challenging issues in conducting a good test is the construction of test sheets that can meet various criteria. Therefore, several measures have been proposed here to represent the quality of each test item. In E-Learning, there is a critical need of formative assessment and hence series of test sheets to be composed which pose some challenges. Consequently the selection of appropriate test items is important when constructing an assessment sheet that meets multi-criteria assessment requirements, such as expected difficulty degree, expected discrimination degree, specified distribution of relevant concept weights and exposure frequency of items. All behavior like selection of items, evaluation and termination of test are based on Item Response Theory, an educational theory. An adaptive assessment system is proposed to compose serial test sheets. This approach will improve the efficiency of composing near optimal serial test items to meet multiple assessment criteria.

Adaptive e-Assessment System: A General Approach

“…There has been considerable research attention focused on Item Response Theory (IRT) [7] where the objective is to design systems to automatically provide and score questionnaires to measure abilities, attitudes, or other variables. Amongst others, systems as PARES [8], ITSAS [9], IRTT [10] and AAS [11] have been proposed using variations of the IRT approach.…”

“…Based on the prediction model, Bayesian [11][12] [13] and Fuzzy [4] [14][15] methodologies have been used. These methodologies help to evaluate hypothesis based on some prior collected evidences.…”

An Intelligent Computer System for Assessing Student Performance

“…They have the potential to improve learning experience and standardized test results. The development of an adaptive assessment methodology that improves the quality of the examination system by integrating an intelligent computer model is of interest [35]. It is proposed to use an adaptive assessment system with a database combination [36].…”

Testes Adaptativos Computadorizados baseados na Teoria de Resposta ao Item em Sistemas e-learning: Uma revisão sistemática da literatura

“…Dentre as possíveis soluções encontradas, estão: (i) coletar maiores informações sobre o entendimento do aluno em relação aos tópicos de aprendizagem [Chen et al 2006] e (ii) considerar o nível de aderência entre as questões e os tópicos [Rajamani and Kathiravan 2013].…”