How Well Does the Standardized Video Interview Score Correlate with Traditional Interview Performance?

Chung, Arlene S.; Shah, Kaushal; Bond, Michael C.; Ardolic, B.; Husain, Abbas; Li, Ida; Cygan, Lukasz; Caputo, William; Shoenberger, Jan; Dermark, Jeff van; Bronner, Jonathan; Weizberg, Moshe

doi:10.5811/westjem.2019.7.42731

Cited by 7 publications

(5 citation statements)

References 8 publications

(8 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another example of the programs' efforts to improve and ease the interview process is using the virtual systems. However, the comparison of standardized video interviews (SVI) to traditional in-person interviews was recently investigated by two studies, and they both found a positive correlation between SVI and in-person interview scores [ 15 , 16 ]. In addition, Husain et al investigated how SVIs affect an applicant's likelihood to be invited for an interview.…”

Section: Discussionmentioning

confidence: 99%

Perception of medical students and residents about virtual interviews for residency applications in the United States

2020

View full text Add to dashboard Cite

Introduction Residency applications via virtual-interview could potentially mitigate the extensive cost and time required for customary in-person interviews. We outline the perception of medical students and residents on the use of virtual-interview for residency applications in lieu of in-person interviews. Methods We obtained 1824 responses from medical students and residents through an online questionnaire between March2019-Feb2020 in Texas-United States. The survey had 11 statements (five in favor of in-person interviews and 6 in favor of virtual interviews) that respondents could rank on a 5-point Likert scale. All statements' scores were summed based on the response given by each participant to create a total score between 11 and 55. The perception of the two groups was analyzed using an independent sample T-test and ANOVA. Results We received a total of 1711 responses from medical students and 113 from medical residents. Respondents were more female (82.2% of medical students and 47.8% of residents), with a mean age of 22.87±3.42 years old for medical students and 28.72±4.35 years old for residents. Both groups preferred in-person interviews; however, the residents were significantly more in favor (P = 0.03). Both groups agree that virtual-interviews should be as an option, though this was considerably higher in the medical students (P = 0.001). In the multivariate analysis, "travel distance" and "type of medical school" had a significant impact on choosing the virtual-interviews in both groups (p<0.01). Conclusions In-person interviews are favored by both medical students and residents compared to virtual-interview services in normal circumstances. However, both groups agree that programs should offer the option of having virtual-interviews as an available choice. Distance to an

show abstract

Section: Discussionmentioning

confidence: 99%

Perception of medical students and residents about virtual interviews for residency applications in the United States

2020

View full text Add to dashboard Cite

show abstract

“…Twenty-two of these studies evaluated the standardized video interview (SVI), an online unidirectional interview that was developed by the Association of American Medical Colleges (AAMC) and piloted with the Accreditation Council for Graduate Medical Education (ACGME)-accredited emergency medicine programs. Twelve of these studies were abstracts [ 38 – 49 ] and 10 were articles [ 50 – 59 ]. Applicants submitted an audio/video response to six questions which was subsequently scored from 6 to 30.…”

Section: Resultsmentioning

confidence: 99%

Video-based interviewing in medicine: a scoping review

Selvam

Musselman

et al. 2022

Syst Rev

View full text Add to dashboard Cite

Background The Coronavirus 2019 pandemic necessitated a rapid uptake of video-based interviewing within the personnel selection process in healthcare. While video-based interviews have been evaluated previously, we identified a gap in the literature on the implementation of video-based interviews and how they compare to their face-to-face counterparts. Methods A scoping review was conducted to consolidate the available literature on the benefits and limitations of video-based interviews and to understand the perceived barriers associated with transitioning away from face-to-face interviews. A search strategy, developed in concert with an academic health sciences librarian, was run on Ovid MEDLINE, Embase, PsycInfo, and Cochrane Central. The search was performed on March 31, 2020, and updated on February 21, 2021. Studies that implemented and evaluated the impact of video-based interviewing in healthcare were included in our study. Review articles and editorials were excluded. Results Forty-three studies were included in our scoping review, of which 17 were conference abstracts and 26 were peer-reviewed manuscripts. The risk of bias was moderate or high in most studies, with only four studies having a low risk of bias. Both financial costs and opportunity costs associated with the selection process were reported to be improved with video-based interviewing, while no studies explored the impact on environmental costs. Technical limitations, which were not prevalent, were easily managed during the interview process. Overall, video-based interviews were well received by both applicants and interviewers, although most participants still reported a preference for face-to-face interviews. Conclusions While video-based interviewing has become necessary during the Coronavirus 2019 era, there are benefits from a financial, opportunistic, and environmental point of view that argue for its continued use even after the pandemic. Despite its successful implementation with minimal technical issues, a preference still remains for face-to-face interviews. Reasons for this preference are not clear from the available literature. Future studies on the role of nonverbal communication during the video-based interview process are important to better understand how video-based interviewing can be optimized. Systematic review registration This scoping review was registered with Open Science Framework.

show abstract

“…Granted, there was no standardization in what the faculty asked, and they were not blinded to academic performance of the applicants [ 36 ]. While there was an evaluation of six emergency medicine programs that demonstrated a positive linear correlation between the SVI score and the traditional interview score, it was a very low r coefficient; thus the authors concluded that the SVI was not adequate to replace the interview itself [ 37 ].…”

Section: Introductionmentioning

confidence: 99%

Best Practices for Reducing Bias in the Interview Process

2022

View full text Add to dashboard Cite

Purpose of Review Objective measures of residency applicants do not correlate to success within residency. While industry and business utilize standardized interviews with blinding and structured questions, residency programs have yet to uniformly incorporate these techniques. This review focuses on an in-depth evaluation of these practices and how they impact interview formatting and resident selection. Recent Findings Structured interviews use standardized questions that are behaviorally or situationally anchored. This requires careful creation of a scoring rubric and interviewer training, ultimately leading to improved interrater agreements and biases as compared to traditional interviews. Blinded interviews eliminate even further biases, such as halo, horn, and affinity bias. This has also been seen in using multiple interviewers, such as in the multiple mini-interview format, which also contributes to increased diversity in programs. These structured formats can be adopted to the virtual interviews as well. Summary There is growing literature that using structured interviews reduces bias, increases diversity, and recruits successful residents. Further research to measure the extent of incorporating this method into residency interviews will be needed in the future.

show abstract

How Well Does the Standardized Video Interview Score Correlate with Traditional Interview Performance?

Cited by 7 publications

References 8 publications

Perception of medical students and residents about virtual interviews for residency applications in the United States

Perception of medical students and residents about virtual interviews for residency applications in the United States

Video-based interviewing in medicine: a scoping review

Best Practices for Reducing Bias in the Interview Process

Contact Info

Product

Resources

About