The K-Means Algorithm for Generating Sets of Items in Educational Assessment

Abstract

In a national-scale educational assessment system, such as the National Examination, the need for several sets of questions that have the same level of difficulty is very required to avoid cheating by students. Therefore, the objective, which is to make a set of questions with the same level of difficulty automatically, is done in this research. It used a machine learning approach, namely K-Means. To achieve this goal, several following procedures need to be implemented. Firstly, we need to create banks of questions to be assigned to students. Then, we build training data by determining the value of each question based on Bloom's Taxonomy, item characters/types, and other parameters. Then, with utilizing K-Means, several cluster centers are obtained to represent the uniformity of the questions in the cluster members. By using several heuristics criteria defined previously, several sets or packages of questions that have the same characteristics and difficulty levels are obtained. From the experiments conducted, the analysis with descriptive (i.e., mean, standard deviation, and data visualization) and inference (i.e., ANOVA) statistics of results are presented showing that questions of each sets have the same characteristics to ensure the fairness of examinations. Moreover, by using this system, the contents of the questions in the generated set do not need to be the same, the package of questions can be generated automatically quickly, and the level of the difficulties can be measured and guaranteed.

Application of the K-Means Clustering Agorithm to Group Train Passengers in Labuhanbatu

“…The K-Means method is an unsupervised learning method for defining cluster centers and grouping data based on the same data. (Riza, Rosdiyana, Wahyudin, & Pérez, 2021) So any data that has similarities and similarities will be clustered based on their respective groups. (Widiyanto & Witanti, 2021) This method is a kernel-based method as a non-probabilistic technique used to group data.…”

Design of Computerized Adaptive Testing Module into Our Dynamic Adaptive Hypermedia System

“…In 2016, Hoang Tieu Binh [14] proposed to combine IRT and K-Means to assess learners' ability in an e-learning system to rank their level in 10 pre-defined groups. A similar system was introduced in [15], where the authors used the same machine learning approach, namely K-Means. After creating banks of items, they used the algorithm K-Means to obtain packages or sets of items with the same characteristics and the same level of difficulty in an automatic way.…”

Comparison of Machine Learning Algorithms for Species Family Classification using DNA Barcode

“…Machine learning is a study attempting to extract knowledge from available data using computer programs that can learn and get smarter automatically based on experience [36] [37]. Currently, the application of machine learning can be found in various activities in everyday life, such as recommendations for goods in Amazon e-commerce services [38], recommendations on the music streaming platform Spotify [39], and recommendations in education assessment [40][41] [42]In bioinformatics, machine learning has been widely used to solve problems in various areas, including genomics, proteomics, systems biology, evolution, microarrays, and text mining [43][44] [45]. The application of machine learning in each case handles the different characteristics of the input data.…”