Question classification based on Bloom’s taxonomy cognitive domain using modified TF-IDF and word2vec

Abstract

The assessment of examination questions is crucial in educational institutes since examination is one of the most common methods to evaluate students' achievement in specific course. Therefore, there is a crucial need to construct a balanced and high-quality exam, which satisfies different cognitive levels. Thus, many lecturers rely on Bloom's taxonomy cognitive domain, which is a popular framework developed for the purpose of assessing students' intellectual abilities and skills. Several works have been proposed to automatically handle the classification of questions in accordance with Bloom's taxonomy. Most of these works classify questions according to specific domain. As a result, there is a lack of technique of classifying questions that belong to the multi-domain areas. The aim of this paper is to present a classification model to classify exam questions based on Bloom's taxonomy that belong to several areas. This study proposes a method for classifying questions automatically, by extracting two features, TFPOS-IDF and word2vec. The purpose of the first feature was to calculate the term frequency-inverse document frequency based on part of speech, in order to assign a suitable weight for essential words in the question. The second feature, pre-trained word2vec, was used to boost the classification process. Then, the combination of these features was fed into three different classifiers; K-Nearest Neighbour, Logistic Regression, and Support Vector Machine, in order to classify the questions. The experiments used two datasets. The first dataset contained 141 questions, while the other dataset contained 600 questions. The classification result for the first dataset achieved an average of 71.1%, 82.3% and 83.7% weighted F1-measure respectively. The classification result for the second dataset achieved an average of 85.4%, 89.4% and 89.7% weighted F1-measure respectively. The finding from this study showed that the proposed method is significant in classifying questions from multiple domains based on Bloom's taxonomy.

Research and application of online SPOC teaching mode in analog circuit course

“…With the in-depth study of this theory, people have developed seven levels including perception, stereotype, guided reflection, mechanical action, complex explicit reflection, adaptation and innovation. This classification method is applied to the examination, according to the cognitive field to establish a test classification model, and according to the students' cognitive level to send different papers (Mohammed and Omar, 2020). In the application of bloom classification, this method is improved according to the actual situation.…”

Examining Student Regulation of Collaborative, Computational, Problem-Solving Processes in Open-Ended Learning Environments

“…A term importance increases with the number of times a word appears in the document; however, this is counteracted by the frequency of the word in the corpus. One of the main characteristics of IDF is that it weights down the term frequency while scaling up the rare ones (Mohammed & Omar, 2020). For example, words such as "the" and "then" often appear in the text, and if we only use TF, terms such as these will dominate the frequency count.…”

Exploiting Syntactic and Semantic Information for Textual Similarity Estimation

“…erefore, researchers believe that different words should be assigned different weights. To propose a new attention weight based on traditional attention weight value, we introduce TF-IDF [24] to obtain the original attention weights of words. e original weight value can be calculated as follows:…”