Automatically growing dually adaptive online IRT testing

Abstract

The item response theory (IRT) is widely used in many fields recently because it provides us the abilities of examinees and the difficulties of items simultaneously. Online IRT test systems are often equipped with the adaptive testing. Such a testing method selects the most appropriate items to examinees automatically. However, the item difficulty values remain the same even if the features of the examinees and the size of the items change. Calibration of the difficulty values is required in such cases, and the dually adaptive online IRT testing system works, where "dually adaptive" means that one is targeted to the adequate item selection and the other is targeted to the adjustment of the item difficulty values. Using this, the database in the system will automatically be growing and be updated. In this paper, we introduce such a novel system with applications.

An Adaptive Test Analysis Based on Students' Motivation

“…In this context, Huang (1996) presented the CBAT-2 algorithm: the questions are previously ordered by experts and the parameters are constantly checked as the questions are answered. Hirose and Aizawa (2014) proposed the use of two databases: one to select the item and the other to calibrate them. These banks are daily synchronized.…”

Accurate Student Ability Estimation by Removing Teacher Evaluation Bias via Full Computer Based Testing

“…From this response matrix, we can estimate students' abilities and difficulty and discrimination parameters of questions altogether using the item response theory (IRT); for general explanations, see [2,8,31], and for specific explanations to online testing applications, see [12][13][14][15][16]40]. We deal with the cases of the standard IRT evaluation using the two-parameter logistic function P i, j (θ i ; a j , b j ) shown below.…”

Prediction of Success or Failure for Examination using Nearest Neighbor Method to the Trend of Weekly Online Testing

“…and fairly. In addition, adaptive testing using IRT selects the most appropriate items to examinees automatically, resulting in more accurate ability estimation and more efficient test procedures (see [11], [12], [13], [14], [15], [25]). Thus, we incorporated IRT evaluation method into the online testing systems.…”