Psychiatry Residency Directors’ Attitudes Toward and Uses of the Medical Student Performance Evaluation and Other Potential Tools for Residency Selection

Russo, Rachel A.; Hameed, Usman; Ibrahim, Yasin; Joshi, Aditya; Kerlek, Anna J.; Klapheke, Martin; Kovach, Jessica G; Raml, Dana; Schatte, Dawnelle; Thomas, Lia A.; Rakofsky, Jeffrey J.

doi:10.1007/s40596-022-01636-x

Cited by 3 publications

(3 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…After the initial search, 351 duplicates were removed and 44 were excluded after title and abstract review, 4,[7][8][9][10][11][12][13][14][15] based on inclusion and exclusion criteria. [16][17][18][19][20][21][22][23][24][25] Full-text review was performed on 98 articles, [26][27][28][29][30][31][32][33][34][35] of which 45 studies were included [36][37][38][39][40][41][42][43][44][45][46][47][48][49][50] (see Figure, Supplemental Digital Content 5, which illustrates a flow-chart of our literature search, as well as our full search strategies).…”

Section: Study Selectionmentioning

confidence: 99%

Perceptions and Expectations Regarding the Step 1 Score Change Among Surgical and Non-Surgical Program Directors: A Systematic Review and Meta-Analysis

Srinivasan,

Samaan,

Premkumar

et al. 2024

The American Surgeon™

View full text Add to dashboard Cite

There are currently no studies examining differences in perceptions and expected impact of the Step 1 score change to pass/fail between surgical and non-surgical program directors (PDs). We conducted a systematic review in May 2023 of PubMed, Scopus, Web of Science, and PSYCInfo to evaluate studies examining PDs’ perspectives regarding the Step 1 score change. We performed random-effects meta-analyses to determine differences in perspectives among surgical and non-surgical PDs. Surgical PDs (76.8% [95% CI, 72.1%-82.0%], I2 = 52%) reported significantly greater rates of disagreement with the score change compared to non-surgical (65.1% [95% CI, 57.9%-73.1%], I2 = 69.7%) ( P = .01). Surgical PDs also reported significantly greater rates of agreement that the score change will increase the difficulty in objectively comparing applicants (88.1% [95% CI, 84.6%-91.7%], I2 = 16.4%), compared to non-surgical (81.0% [95% CI, 75.6%-86.8%], I2 = 72.6%) ( P = .04). There was less heterogeneity among non-surgical PDs (88.7% [95% CI, 86.2%-91.2%], I2 = 0%), compared to surgical (84.7% [95% CI, 79.0%-90.8%], I2 = 67.3%), regarding expected increases in emphasis on Step 2, although the difference in rates of agreement was not statistically significant. Overall, there is significant heterogeneity in the literature regarding expected changes in the residency application review process. Most PDs reported significant disagreement with the score change, greater expected difficulty in objectively evaluating applicants, and greater emphasis on Step 2, with surgical PDs reporting greater rates of disagreement, greater expected difficulty, and heterogeneity regarding expected increases in emphasis on Step 2, compared to non-surgical. Additionally, there is significant heterogeneity in the overall literature regarding expected changes in the residency application review process. Further research is needed to establish evidence-based guidelines that improve the overall residency application process for all stakeholders.

show abstract

Section: Study Selectionmentioning

confidence: 99%

Perceptions and Expectations Regarding the Step 1 Score Change Among Surgical and Non-Surgical Program Directors: A Systematic Review and Meta-Analysis

Srinivasan,

Samaan,

Premkumar

et al. 2024

The American Surgeon™

View full text Add to dashboard Cite

show abstract

“…[6][7][8][9] Several specialty-specific reports indicated that letters of recommendation, USMLE Step 2 scores, and the medical school performance evaluation would be highly valued going forward. [10][11][12][13][14] However, several studies report conflicting predictive values of these and other criteria on trainee success. 5, [15][16][17] Student research participation is often a factor that program directors (PDs) consider when reviewing applicants.…”

Section: Performance On the United States Medical Licensing Examinati...mentioning

confidence: 99%

“…6–9 Several specialty-specific reports indicated that letters of recommendation, USMLE Step 2 scores, and the medical school performance evaluation would be highly valued going forward. 10–14 However, several studies report conflicting predictive values of these and other criteria on trainee success. 5,15–17…”

mentioning

confidence: 99%

Residency Program Directors’ Views on Research Conducted During Medical School: A National Survey

Wolfson¹,

Fairchild

Bahner³

et al. 2023

Academic Medicine

View full text Add to dashboard Cite

Purpose With the United States Medical Licensing Examination Step 1 transition to pass/fail in 2022, uncertainty exists regarding how other residency application components, including research conducted during medical school, will inform interview and ranking decisions. The authors explore program director (PD) views on medical student research, the importance of disseminating that work, and the translatable skill set of research participation. Method Surveys were distributed to all U.S. residency PDs and remained open from August to November 2021 to query the importance of research participation in assessing applicants, whether certain types of research were more valued, productivity measures that reflect meaningful research participation, and traits for which research serves as a proxy. The survey also queried whether research would be more important without a numeric Step 1 score and the importance of research vs other application components.

show abstract

Implementing a Holistic Review Process for Psychiatry Residency Screening and Interviewing

Shirazi,

Cabrera,

Malik

et al. 2024

FOC

View full text Add to dashboard Cite

Psychiatry Residency Directors’ Attitudes Toward and Uses of the Medical Student Performance Evaluation and Other Potential Tools for Residency Selection

Cited by 3 publications

References 10 publications

Perceptions and Expectations Regarding the Step 1 Score Change Among Surgical and Non-Surgical Program Directors: A Systematic Review and Meta-Analysis

Perceptions and Expectations Regarding the Step 1 Score Change Among Surgical and Non-Surgical Program Directors: A Systematic Review and Meta-Analysis

Residency Program Directors’ Views on Research Conducted During Medical School: A National Survey

Implementing a Holistic Review Process for Psychiatry Residency Screening and Interviewing

Contact Info

Product

Resources

About