On learning platform metrics as markers for student success in a course

Abstract

Adaptive learning platforms are increasingly being used as part of varying instructional modalities. Particularly relevant to this paper, adaptive learning is a critical component of personalized, preclass learning in a flipped classroom. Previously inaccessible, data generated by adaptive learning platforms regarding student engagement with the course content provides an invaluable opportunity to gain a deeper understanding of the learning process and improve upon it. We aim to investigate the relationships between adaptive learning platform interactions and overall student success in the course and identify the variables most influential to student success. We present a comprehensive analysis of our adaptive learning platform data collected in a Numerical Methods course, including aggregate statistics, frequency analysis, and Principal Component Analysis, to determine which variables exhibited the most variability and, therefore, the most information in the data. Subsequently, we used the Partitioning Around Medoids clustering approach to investigate naturally occurring clusters of students and how these clusters relate to overall performance in the course. Our results show that overall performance in the course, as measured by the final course grade, is strongly associated with (1) the behavioral interactions of students with the adaptive platform and (2) their performance on the adaptive learning assessments. We also found distinct student clusters (as defined by success in the course) that exhibited distinctly different behaviors. These findings provide qualitative and quantitative information to identify students needing support and to craft an evidence‐based support strategy for these students.