Performance on the Plastic Surgery In-Service Examination Can Predict Success on the American Board of Plastic Surgery Written Examination

Abstract

Background: Originally developed for resident self-assessment, the Plastic Surgery In-Service Examination has been administered for over 45 years. The Accreditation Council for Graduate Medical Education requires that at least 70 percent of graduates pass the American Board of Plastic Surgery Written Examination on their first attempt. This study evaluates the role of In-Service Exam scores in predicting Written Exam success. Methods: In-Service Exam scores from 2009 to 2015 were collected from the National Board of Medical Examiners. Data included residency training track, training year, and examination year. Written Exam data were gathered from the American Board of Plastic Surgery. Multivariate analysis was performed and receiver operating characteristic curves were used to identify optimal In-Service Exam score cut-points for Written Exam success. Results: Data from 1364 residents were included. Residents who failed the Written Exam had significantly lower In-Service Exam scores than those who passed (p < 0.001). Independent residents were 7.0 times more likely to fail compared with integrated/combined residents (p < 0.001). Residents who scored above the optimal cut-points were significantly more likely to pass the Written Exam. The optimal cut-point score for independent residents was the thirty-sixth percentile and the twenty-second percentile for integrated/combined residents. Conclusions: Plastic Surgery In-Service Exam scores can predict success on the American Board of Plastic Surgery Written Exam. Residents who score below the cut-points are at an increased risk of failing. These data can help identify residents at risk for early intervention.

Design and implementation of an academic enrichment program to improve performance on the internal medicine in-training exam

“…Given that previous studies have demonstrated a direct correlation between performance on the ITE and ABIM certification exam pass rate for first-time takers in internal medicine [8][9][10][11]27], we hypothesized that the AEP, among other factors, would have a downstream favorable impact on ABIM certification amongst exposed residents, as shown by a non-significant trend towards a higher 3-year rolling pass rate for first-time takers. Similar correlations have been observed in other specialties, including emergency medicine [28], surgical specialties [29][30][31][32], and obstetrics and gynecology [33].…”

Clinical Competency Committees in Plastic Surgery Residency

“…In line with the historic data on board passage, 11 our CCC recommends a textbook reading plan from any of the various comprehensive plastic surgery textbooks to any resident who scores below the 30th percentile on the In-service Examination. This specific ILP is not meant to be punitive in nature, but more so an acknowledgment that a structured reading program will assist the resident in the intellectual maturation associated with life-long learning and application of acquired skills as a practitioner of the art of surgery, as opposed to the regurgitation of facts for the satisfactory completion of a medical school examination.…”

“…Indeed, scores on this examination predict whether a graduate will pass the American Board of Plastic Surgery written examination. 11 Low rates of Board passage can result in an entire program being placed on probation. A plastic surgery program is judged successful by the ACGME if either of the following is true:…”

“…Using the prior 70% ACGME cutoff (from the 2017 guidelines), Girotto et al calculated the optimal In-service percentile cutoffs at 22nd (integrated) and 36th (independent) to maximize the area under the curve of testing toward board passage. 11 …”

The Plastic Surgery In-service Training Examination: An In-depth Reference Analysis

“…This examination allows residents to assess their knowledge of core plastic surgery topics, gauge their knowledge against national peers, and serve as an indicator of areas needing concentrated educational efforts. Recent work has demonstrated that performance on the PSITE can predict success on the American Board of Plastic Surgery Written Examination, 1 thereby further increasing motivation to prepare for and perform well on this examination. The American Society of Plastic Surgeons’s In-service Examination Committee prepares the questions.…”