Validity evidence confirms expected relations with other variables and acceptable inter-rater reliability, but other validity evidence is sparse. Given the high-stakes use of this assessment (required for board eligibility), we suggest that more validity evidence is required, especially to support its content (selection of tasks and scoring rubric) and the consequences (favorable and unfavorable impact) of assessment.
Objective
Self-directed learning (SDL) can be as effective as instructor-led training. It employs less instructional resources and is potentially a more efficient educational approach. Although SDL is encouraged among residents in our surgical training program via 24-hour access to surgical task trainers and online modules, residents report that they seldom practice. We hypothesized that a mentor-guided SDL approach would improve practice habits among our residents.
Design
From 2011–2013, 12 PGY-2 general surgery residents participated in a six-week minimally invasive surgery (MIS) rotation. At the start of the rotation, residents were asked to practice laparoscopic skills until they reached peak performance in at least three consecutive attempts at a task (individual proficiency).
Setting
Trainees met with the staff surgeon at weeks three and six to evaluate progress and review a graph of their individual learning curve. All trainees subsequently completed a survey addressing their practice habits and suggestions for improvement of the curriculum.
Results
By the end of the rotation, 100% of participants improved in all practiced tasks (p < 0.05), and each reported that they practiced more in this rotation than during rotations without mentor-guided SDL. Six (50%) reported that their skill level had improved relative to their peers. Some residents (n=3) felt that the curriculum could be improved by including task-specific goals and additional practice sessions with the staff surgeon.
Conclusions
Mentor-guided SDL stimulated surgical residents to practice with greater frequency. This repeated deliberate practice led to significantly improved MIS skills without significantly increasing the need for faculty-led instruction. Some residents preferred more discrete goal setting and increased mentor guidance.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.