A New Way of Evaluating Effectiveness of URM Summer Pipeline Programs

Abstract

Purpose Many academic medical centers fund educational opportunities (pipeline programs) for students who are underrepresented in medicine (URM). However, there is a sparsity of published literature on pipeline programs and an even smaller body of published literature that investigates program effectiveness. Methods In a retrospective cohort study (n=12) of the Provost’s Summer Mentorship Program-Medicine (SMPM), we evaluated students’ rating of program effectiveness, students’ rating of the program’s impact on their mindsets, and SAT scores. Several program mindsets, including sense of belonging (inclusiveness) in the health professions and connection to mentors in the medical field, reflect common barriers that prevent URM students from pursuing careers in medicine as outlined in pipeline literature. We describe program effectiveness using mean and median ratings of SMPM effectiveness, ratings of mindsets, and SAT scores. We used Wilcoxon Rank Sum to assess pre and post program differences in ratings of mindsets and SAT scores. Results SMPM was effective for learners. The overall mean rating for SMPM effectiveness was 4.27. Mindsets for confidence, interest, sense of belonging, college mentorship, and physician mentorship were statistically different from the start to the end of SMPM (p<0.05), with mean improvement of about 34%, 41%, 44%, 180%, and 140% respectively. The mean pre and post SMPM SAT scores as well as 4-month follow-up SAT mean scores were 713 (SD:155), 813 (SD:83), and 1058 (SD:147), respectively. There was a statistically significant difference between all three SAT scores (p<0.05). Conclusion In addition to providing educational support, our pipeline program effectively increased students’ sense of belonging in the medical field and their connections to physician mentors, which are two common barriers for URM students who are interested in medicine.

Racial, Ethnic, and Sex Diversity Trends in Health Professions Programs From Applicants to Graduates

“…Persistent low representation of students and graduates from URM groups reflects structural and economic factors that also play a major role in affecting URM representation in health care programs . Recruitment strategies, holistic admissions, and pipeline programs aimed to address URM underrepresentation and have led to increasing applications, matriculations, and degree completions . Participants in pipeline programs report improved confidence, a sense of belonging, and views of health care as a realistic career option .…”

“…36 Recruitment strategies, holistic admissions, and pipeline programs aimed to address URM underrepresentation and have led to increasing applications, matriculations, and degree completions. 16,[37][38][39][40][41] Participants in pipeline programs report improved confidence, a sense of belonging, and views of health care as a realistic career option. 39,40 Few pipeline programs have tracked participants longitudinally to determine their effect on application, matriculation, and degree conferral in a health professions program.…”

Impact of a Multi-Institutional Initiative to Engage Students and Early-Stage Scholars From Underrepresented Racial and Ethnic Minority Groups in HIV Research: The Centers for AIDS Research Diversity, Equity, and Inclusion Pathway Initiative

“…Through a consensus-building process developed through monthly meetings with all of the CDEIPI evaluation leads, key domains were identified and agreed upon, based on previous evaluations of educational initiatives to enhance racial and ethnic diversity among students and early-stage scholars. [8][9][10][11][12][13][14] To chronicle and evaluate the activities and approaches at all sites, the Core developed instruments to systematically collect program metrics and individual-level participant perspectives. Two data-entry portals using REDCap 15 were developed in collaboration with each of the sites.…”

“…Through a consensus-building process developed through monthly meetings with all of the CDEIPI evaluation leads, key domains were identified and agreed upon, based on previous evaluations of educational initiatives to enhance racial and ethnic diversity among students and early-stage scholars. 8–14…”

Seeking Equity; Pathway Programs in Liaison Committee on Medical Education Medical Schools for Minoritized Students

“…For this study we defined pathway programs by the following 3 parameters: (1) educational program in an LCME accredited US medical school, (2) an educational program dedicated to K-12, undergraduate students, and/or recent graduates/postbaccalaureate students, and (3) a program focused on health science-related curricula. We further categorized the pathway programs into URiM-focused pathways if the program reported targeting only URiM students and non-URiMfocused pathways if the program targeted all students.…”