Subjective Answers Evaluation Using Machine Learning and Natural Language Processing

Abstract

Subjective paper evaluation is a tricky and tiresome task to do by manual labor. Insufficient understanding and acceptance of data are crucial challenges while analyzing subjective papers using Artificial Intelligence (AI). Several attempts have been made to score students' answers using computer science. However, most of the work uses traditional counts or specific words to achieve this task. Furthermore, there is a lack of curated data sets as well. This paper proposes a novel approach that utilizes various machine learning, natural language processing techniques, and tools such as Wordnet, Word2vec, word mover's distance (WMD), cosine similarity, multinomial naive bayes (MNB), and term frequencyinverse document frequency (TF-IDF) to evaluate descriptive answers automatically. Solution statements and keywords are used to evaluate answers, and a machine learning model is trained to predict the grades of answers. Results show that WMD performs better than cosine similarity overall. With enough training, the machine learning model could be used as a standalone as well. Experimentation produces an accuracy of 88% without the MNB model. The error rate is further reduced by 1.3% using MNB.

Multilevel Evaluation of Teaching Quality in Higher Education Using Single-Valued Neutrosophic Set

“…The systematical operational rule for SVNS can be found in literature [20,21]. In this study, we focused on the application of SVNS in processing the evaluation data of teaching quality.…”

“…Recently, neutrosophic set (NS), defined as the generalization of interval fuzzy sets, has been used extensively in many fields, such as medical image processing, decision-making, and social judgments. It has been widely accepted that the NS-based technique supplies an effective tool for handling inconsistent and vague data [17][18][19][20][21]. Motivated by this, NS was increasingly employed to represent the qualitative indicator values in various fields, aiming for improving the credibility of the applications.…”

Transforming Handwritten Answer Assessment: A Multi-Modal Approach Combining Text Detection, Handwriting Recognition, and Language Models

“…The automated grading system offers several advantages over traditional manual methods, including improved consistency, scalability, and efficiency. It has the potential to alleviate the workload of instructors and graders, reduce human bias [1,6], and provide timely feedback to students. Furthermore, the system can be extended to support multi-modal inputs, personalized feedback generation, and educational analytics, opening up new avenues for enhancing the learning experience and data-driven decision-making in educational settings [2].…”

An efficient approach for textual data classification using deep learning

“…Tags or categories are assigned to unstructured text using text classification (Bashir et al, 2021 ; Rao et al, 2021 ). Since it is so versatile, it is considered one of the most effective natural language processing methods because it can organize, categorize, and structure any text to deliver meaningful information and solve problems.…”