Characterization of medical students recall of factual knowledge using learning objects and repeated testing in a novel e-learning system

Abstract

BackgroundSpaced-repetition and test-enhanced learning are two methodologies that boost knowledge retention. ALERT STUDENT is a platform that allows creation and distribution of Learning Objects named flashcards, and provides insight into student judgments-of-learning through a metric called ‘recall accuracy‘. This study aims to understand how the spaced-repetition and test-enhanced learning features provided by the platform affect recall accuracy, and to characterize the effect that students, flashcards and repetitions exert on this measurement.MethodsThree spaced laboratory sessions (s0, s1 and s2), were conducted with n=96 medical students. The intervention employed a study task, and a quiz task that consisted in mentally answering open-ended questions about each flashcard and grading recall accuracy. Students were randomized into study-quiz and quiz groups. On s0 both groups performed the quiz task. On s1 and s2, the study-quiz group performed the study task followed by the quiz task, whereas the quiz group only performed the quiz task. We measured differences in recall accuracy between groups/sessions, its variance components, and the G-coefficients for the flashcard component.ResultsAt s0 there were no differences in recall accuracy between groups. The experiment group achieved a significant increase in recall accuracy that was superior to the quiz group in s1 and s2. In the study-quiz group, increases in recall accuracy were mainly due to the session, followed by flashcard factors and student factors. In the quiz group, increases in recall accuracy were mainly accounted by flashcard factors, followed by student and session factors. The flashcard G-coefficient indicated an agreement on recall accuracy of 91% in the quiz group, and of 47% in the study-quiz group.ConclusionsRecall accuracy is an easily collectible measurement that increases the educational value of Learning Objects and open-ended questions. This metric seems to vary in a way consistent with knowledge retention, but further investigation is necessary to ascertain the nature of such relationship. Recall accuracy has educational implications to students and educators, and may contribute to deliver tailored learning experiences, assess the effectiveness of instruction, and facilitate research comparing blended-learning interventions.Electronic supplementary materialThe online version of this article (doi:10.1186/s12909-014-0275-0) contains supplementary material, which is available to authorized users.

What Are We Looking for in Computer-Based Learning Interventions in Medical Education? A Systematic Review

“…Judgments of knowledge together with other student activity metrics may provide data for a next generation of intelligent tutoring systems able to track, manage, and predict student performance [ 130 ]. An increase in studies reporting online activity measurements and correlations with other learning outcomes using reproducible tools, as described before, would generate useful evidence on the effectiveness of CBL methods in enhancing learning [ 131 ]. Metrics could include, for example, student communication style and sentiment [ 132 , 133 ] and time spent on different types of materials [ 134 ].…”

Conceptualising spaced learning in health professions education: A scoping review

“…For the online setting, the duration of events showed a great variety between studies. Information or questions were distributed through online sources daily 22,[27][28][29][30]33,34,37,55,85 (n = 10), every 2 days 19,23,24,31,52,53,64,78 (n = 8), every 3 days 41 (n = 1), wee kly 20,35,36,39,40,43,44,71,80,[114][115][116] (n = 12), every 2 weeks 45 (n = 1), or monthly 43,79 (n = 2). In studies explicitly stating that material was not only spaced but also repeated, repetition delays ranged from various days 22,55 (n = 2), to weeks 19,23,24,[27][28][29][31][32][33][34][35][39][40][41]…”

Online Self-testing Resources Prepared by Peer Tutors as a Formative Assessment Tool in Pharmacology Courses

“…13,14 This "testenhanced learning" improved learning, especially when used after studying to gauge knowledge and practice recall in a number of settings. 15,16 Larsen et al documented this long-term impact even in postgraduate neurologists and also found it superior to repeated studying alone. 16 The benefit of using formative self-assessments is also seen when comparing populations of students who take quizzes and those who do not routinely use quizzes.…”