Developing evidence-based resources for evaluating postgraduate trainees in the biomedical sciences

Abstract

Postgraduate trainees elevate the academic strength of institutions by conducting research, promoting innovation, securing grant funding, training undergraduate students, and building alliances. Rigorous and systematic program evaluation can help ensure that postgraduate training programs are achieving the program’s intended outcomes. The purpose of this project was to develop evidence-based evaluation tools that could be shared across federally funded biomedical training programs to enhance program evaluation capacity. This manuscript describes the evidence-based process used to determine program evaluation needs of these programs at a research-intensive university. Using a multi-phased sequential exploratory mixed methods approach, data were collected from trainees, employers, leaders, and program directors. Data analyses included document analysis of program plans, inductive coding of focus groups and interviews, and descriptive analysis of surveys. Two overarching categories–Trainee Skills and Program Characteristics—were identified including six themes each. Program directors prioritized communication, social and behavioral skills, and collaboration as the trainee skills that they needed the most help evaluating. Furthermore, program directors prioritized the following program characteristics as those that they needed the most help evaluating: training environment, trainee outcomes, and opportunities offered. Surveys, interview scripts, and related resources for the categories and themes were developed and curated on a publicly available website for program directors to use in their program evaluations.

Lessons learned from a non‐traditional application process: Integrating user experiences to inform admission application design

“…User‐experience research methods offer strategies to better understand the users (i.e., participants), their needs, and the potential challenges they encounter when completing a desired task or achieving a desired outcome 10 . User‐centered approaches consistently demonstrate value in higher education to capture participant motivations, needs, and struggles, which can impact programmatic design 11–14 . We posit an enhanced understanding of applicant experiences provides valuable insights into their interactions with admissions teams, wayfinding, and overall satisfaction with the process.…”

“…10 User-centered approaches consistently demonstrate value in higher education to capture participant motivations, needs, and struggles, which can impact programmatic design. [11][12][13][14] We posit an enhanced understanding of applicant experiences provides valuable insights into their interactions with admissions teams, wayfinding, and overall satisfaction with the process. In addition, it can help identify pain points and inefficiencies that can be addressed to create a more streamlined, transparent, and pleasurable experience.…”