Learning analytics application to examine validity and generalizability of game‐based assessment for spatial reasoning

Abstract

Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.

Learning analytics and assessment: Emerging research trends, promises and future opportunities

“…The authors demonstrated that this approach can be used to determine the effectiveness of test items and identify the items that need to be revised to improve the overall reliability of an exam. Kim et al (2022) utilised traced events collected in a game-based learning environment to evaluate the psychometric qualities of game-based assessment of students' spatial reasoning skills. The authors demonstrated that combining game-based assessment and learning analytics methods is a promising new approach to assessing students' cognitive skills.…”

Educating on spatial skills using a paper-folding-and-punched-hole videogame: gameplay data analysis

“…Nicolaidou et al (2021) showed that the more hours the young adults in their study played digital puzzle games, the higher their spatial reasoning skills. Kim et al (2023) European Union's Digital Education Action Plan -.…”

Mia Sinaga’ Developed of Bioentrepreneur Based Student Worksheets for Food Biotechnology Material on Entrepreneurial Interest and Student Creativity

“…Furthermore, Validation Surveys emerged as an important tool utilized by experts. Systematic assessment, using a Likert scale, carefully examines the quality, accuracy, and overall design of learning materials [17] . The culmination of expert perspectives triggers an iterative refinement process, ensuring content alignment with pedagogical goals.…”