Academic Performance Modelling with Machine Learning Based on Cognitive and Non-Cognitive Features

Abstract

The academic performance of students is essential for academic progression at all levels of education. However, the availability of several cognitive and non-cognitive factors that influence students’ academic performance makes it challenging for academic authorities to use conventional analytical tools to extract hidden knowledge in educational data. Therefore, Educational Data Mining (EDM) requires computational techniques to simplify planning and determining students who might be at risk of failing or dropping from school due to academic performance, thus helping resolve student retention. The paper studies several cognitive and non-cognitive factors such as academic, demographic, social and behavioural and their effect on student academic performance using machine learning algorithms. Heterogenous lazy and eager machine learning classifiers, including Decision Tree (DT), K-Nearest-Neighbour (KNN), Artificial Neural Network (ANN), Logistic Regression (LR), Random Forest (RF), AdaBoost and Support Vector Machine (SVM) were adopted and training was performed based on k-fold (k = 10) and leave-one-out cross-validation. We evaluated their predictive performance using well-known evaluation metrics like Area under Curve (AUC), F-1 score, Precision, Accuracy, Kappa, Matthew’s correlation coefficient (MCC) and Recall. The study outcome shows that Student Absence Days (SAD) are the most significant predictor of students’ academic performance. In terms of prediction accuracy and AUC, the RF (Acc = 0.771, AUC = 0.903), LR (Acc = 0.779, AUC = 0.90) and ANN (Acc = 0.760, AUC = 0.895) outperformed all other algorithms (KNN (Acc = 0.638, AUC = 0.826), SVM (Acc = 0.727, AUC = 0.80), DT (Acc = 0.733, AUC = 0.876) and AdaBoost (Acc = 0.748, AUC = 0.808)), making them more suitable for predicting students’ academic performance.

Predicting academic achievement from the collaborative influences of executive function, physical fitness, and demographic factors among primary school students in China: ensemble learning methods

“…LR algorithms are designed to predict the probability of future outcomes based on existing data performance. With a regularization term integrated into the model, LR can effectively reduce model complexity and counteract overfitting concerns [ 48 ]. Lastly, the LDA algorithm plays a pivotal role in projecting data into a low-dimensional space.…”

Arbitrator Miniature: A Paradigm using Data Science Methods to Predict Academic Performance

“…In [23] saw the implementation of and contrasted K-Nearest, Naive Bayes, and Decision Tree while utilizing 10-fold cross-validation and neighbor models. Other studies, including [25] and [24], used k-fold cross-validation to compare various data mining techniques using models to predict student performance. This is common knowledge how raising a model's forecast accuracy may be di cult.…”

Deep Learning Approach on Prediction of Soil Consolidation Characteristics

“…Techniques based on machine learning have witnessed significant growth in popularity over the last decade for their ability to make accurate predictions and have been applied to various real-world problems [28]. In geotechnical engineering, the comprehension and prediction of consolidation properties are crucial for ensuring the stability and durability of structures.…”