Objective: We measured the long-term retention of knowledge gained through selected American Academy of Neurology annual meeting courses and compared the effects of repeated quizzing (known as test-enhanced learning) and repeated studying on that retention.Methods: Participants were recruited from 4 annual meeting courses. All participants took a pretest. This randomized, controlled trial utilized a within-subjects design in which each participant experienced 3 different postcourse activities with each activity performed on different material. Each key information point from the course was randomized in a counterbalanced fashion among participants to one of the 3 activities: repeated short-answer quizzing, repeated studying, and no further exposure to the materials. A final test covering all information points from the course was taken 5.5 months after the course.Results: Thirty-five participants across the 4 courses completed the study. Average score on the pretest was 36%. Performance on the final test showed that repeated quizzing led to significantly greater long-term retention relative to both repeated studying (55% vs 46%; t[34] 5 3.28, SEM 5 0.03, p 5 0.01, d 5 0.49) and no further exposure (55% vs 44%; t[34] 5 3.16, SEM 5 0.03, p 5 0.01, d 5 0.58). Relative to the pretest baseline, repeated quizzing helped participants to retain almost twice as much of the knowledge acquired from the course compared to repeated studying or no further exposure.Conclusions: Whereas annual meeting continuing medical education (CME) courses lead to longterm gains in knowledge, when repeated quizzing is added, retention is significantly increased. CME planners may consider adding repeated quizzing to increase the impact of their courses. Continuing medical education (CME) comprises a major component of both maintenance of certification and maintenance of licensure in most states.1,2 The rationale behind this position is that life-long learning is a critical part of professional development.2 The American Academy of Neurology (AAN) is a major source of CME for neurologists in the United States. Each year, thousands of neurologists spend considerable time and money to attend the annual meeting of the AAN in order to meet their CME requirements and to learn about the latest advances in the field. In order to better meet the educational needs of practicing neurologists, the AAN has developed interactive education sessions such as NeuroFlash and Morning Report sessions.
3NeuroFlash sessions use audience response systems to engage learners in presentations about recent developments in a topic. Morning Reports use a case-based discussion format to explore challenging clinical scenarios. These new formats focus not only on facts but on the clinical application of those facts, which is a key part of the definition of competence used for accreditation of CME courses. 4,5 Although increasing interaction during these sessions is a good educational strategy, a single, brief exposure to information may not be enough to produce