The Utility of Pre-Residency Standardized Tests for Anesthesiology Resident Selection

Guffey, Ryan; Rusin, Konstantin; Chidiac, Elie Joseph; Marsh, H. Michael

doi:10.1213/ane.0b013e3181fcfacd

Cited by 35 publications

(34 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Three-digit scores for both of these exams vary slightly from year to year, but the typical range of scores is from 140 to 260, with a standard deviation of 20. 15 Passing score cutoffs are provided to the test taker with their exam score and published on the NBME website each year. For example, in 2010, the passing scores for the Step 1 and Step 2 exams were 188 and 184, respectively.…”

Section: Independent Variablesmentioning

confidence: 99%

“…Studies in other specialties have largely demonstrated that USMLE Step 1 and Step 2 scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] However, one study involving ophthalmology residents failed to find a correlation between USMLE Step 1 and the ophthalmology specialty board examination. 18 Quantitative academic assessments of resident performance are typically collected during the course of residency.…”

Section: Introductionmentioning

confidence: 99%

“…Several studies in multiple other medical specialties have shown that annual American Board of Medical Specialties (ABMS) In-Training Examinations (ITEs) are good predictors of performance on the specialty board certification examination. 6,[8][9][10][11][12][13][14][15][17][18][19][20][21][22][23][24][25] ITEs occur yearly during residency training and are typically mandatory except during extenuating circumstances such as illness or a leave of absence. This relationship between ITEs and board certification has been demonstrated in anesthesiology as well.…”

Section: Introductionmentioning

confidence: 99%

“…This relationship between ITEs and board certification has been demonstrated in anesthesiology as well. 3,15,26 Kearney et al investigated whether or not the American Board of Anesthesiology-American Society of Anesthesiologists InTraining Examination (ABA-ASA ITE) was a good predictor of performance on the Royal College of Physicians and Surgeons of Canada certification examination, which is comparable to the ABA Part 1 examination. 26 Their results from nine residency programs suggest that scores greater than the 50 th percentile on the ABA-ASA ITE were highly predictive of passing their written board specialty examination.…”

Section: Introductionmentioning

confidence: 99%

“…3 Guffey et al found that the USMLE Step 1 and Step 2 examinations were significant predictors of performance on the ABA Part 1 examination, though they found the Step 1 examination to be a stronger predictor than Step 2. 15 Residents' performance on departmental, in-house multiple choice question examinations that were written by departmental faculty may also be a means of objective assessment with which to identify at-risk residents during training. One study found that pediatric resident performance on these exams significantly correlated with success on the pediatric ITEs.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Predictors of success on the written anesthesiology board certification examination

et al. 2012

View full text Add to dashboard Cite

Objectives: To determine whether information available prior to and during anesthesia residency training can predict American Board of Anesthesiology (ABA) Part 1 (Written) performance and help identify anesthesia residents at risk for failure. Methods: Retrospective analysis of 97 anesthesiology residents' academic files at a single Midwestern residency program. ABA Part 1 score was used as the dependent variable. Categorical demographic predictor variables included gender, under-represented minority status, and type of medical degree. Quantitative academic predictor variables included first-attempt scores on United States Medical Licensing Examination (USMLE) Steps 1 and 2, annual ABA In-Training Exam (ITE) scores, and biannual Basic Science Examination (BSE) scores. Predictors that correlated significantly with the dependent variable were entered into stepwise linear regression analyses. Results:In our analyses, only the USMLE Step 2 score was a significant pre-residency predictor (B=0.169; SE=0.031, p<0.001). Scores on ITEs were significant predictors at every time point. In the final regression model using all available measures during residency, the most recent ITE (B = 0.627; SE=0.090; p<0.001) and BSE (B=0.096; SE = 0.047; p=0.046) scores were significant predictors. The model accounted for 52% of the variance in the outcome variable, with 50% of the variance explained by ITE score alone. The model had a specificity of 0.83 and a sensitivity of 0.82 for predicting passing the ABA Part 1 exam. Conclusions: First-attempt scores on the USMLE Step 2 examination and the CA-2 ITE are moderately strong predictors of anesthesiology board examination performance, and may help target residents who are at risk of failing.

show abstract

Section: Independent Variablesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Predictors of success on the written anesthesiology board certification examination

et al. 2012

View full text Add to dashboard Cite

show abstract

Interventions Associated With Racial and Ethnic Diversity in US Graduate Medical Education

et al. 2023

View full text Add to dashboard Cite

ImportanceRacially and ethnically minoritized individuals remain underrepresented in graduate medical education relative to their proportion in the population. While many programs and initiatives have been developed to address this problem, there is little consensus regarding strategies that work to improve representation across specialties.ObjectiveTo examine and synthesize evidence-based practices that have been used to increase the proportions of underrepresented in medicine (URiM) trainees at US residency and fellowship programs.Evidence ReviewThe authors searched PubMed, Google Scholar, Embase, PsycInfo, ERIC, Cochrane Reviews, Cochrane Trials, CINAHL, Scopus, and PROSPERO electronic databases to identify relevant studies published through January 2022. They screened all titles and abstracts for relevance and read full-text articles to identify articles reporting reliable data describing the outcomes of interventions to improve racial and ethnic diversity among trainees.FindingsTwenty-seven articles were included in this review. Two studies reported on fellowship programs. The most common interventions included holistic review (48%), decreased emphasis on United States Medical Licensing Examination Step 1 scores (48%), and explicit institutional messaging regarding the importance of diversity (37%). A combination of interventions was associated with an increased number of URiM applicants, interviewees, and matriculants across various medical and surgical specialties.Conclusions and RelevanceIn this scoping review, approaches and interventions associated with increased diversity in residency and fellowship programs were identified. Continued efforts are necessary to sustain such efforts and assess long-term outcomes.

show abstract

Grade point average is an inappropriate measure of a residency candidate's knowledge and skills

Soric

Robinson

Ulbrich

2019

J Am Coll Clin Pharm

View full text Add to dashboard Cite

Accreditation standards set forth by the American Society of Health‐System Pharmacists note that postgraduate year one programs should have a formal process in place to screen candidates based upon predetermined criteria to ensure applicants have the appropriate qualifications to complete residency training. This standard encourages programs to have a set of consistent criteria and an objective approach to evaluate each applicant. As a result, many programs rely heavily on accessible metrics, such as grade point average (GPA), to quickly compare candidates. The GPA has many flaws that, if utilized by residency programs, could result in screening out highly qualified candidates early in the application review process who possess the skills that residency program directors covet, such as work ethic, passion, adaptability, leadership, research experience, communication skills, professionalism, cultural competency, and personality fit. To identify qualified candidates for postgraduate residency training, the application review process must be reexamined to promote a more holistic approach, going beyond the student's ability in the classroom. Further discussion is needed regarding the pros and cons of utilization of standardized and consistent assessments of residency applicants' knowledge, skills, behaviors, and attitudes to complete a holistic review of candidates as discussed in this article. Further research is needed to identify the factors defining a successful resident and tools to predict those factors.

show abstract

The Utility of Pre-Residency Standardized Tests for Anesthesiology Resident Selection

Cited by 35 publications

References 23 publications

Predictors of success on the written anesthesiology board certification examination

Predictors of success on the written anesthesiology board certification examination

Interventions Associated With Racial and Ethnic Diversity in US Graduate Medical Education

Grade point average is an inappropriate measure of a residency candidate's knowledge and skills

Contact Info

Product

Resources

About