Are the Communication and Professionalism Competencies the New Critical Values in a Resident’s Global Evaluation Process?

Haurani, Mounir J.; Rubinfeld, Ilan; Rao, Namrata; Beaubien, J. Matthew; Musial, Joseph L.; Parker, Alton; Reickert, Craig A.; Raafat, Aml; Shepard, Alexander

doi:10.1016/j.jsurg.2007.06.012

Cited by 22 publications

(19 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This could suggest that raters, despite use of an anchored rating scale, have difficulty discriminating between behaviors that represent each domain and thus conceptualize them as a single entity. This observation is consistent with literature suggesting that ICS skills positively affect scoring in many other domains of the ACGME Core Competencies . It is also possible that this correlation is an accurate representation of high covariance between the domains.…”

Section: Discussionsupporting

confidence: 91%

Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine

Hopson

Dorfsman

Branzetti

et al. 2019

AEM Education and Training

View full text Add to dashboard Cite

Objectives: The Association of American Medical Colleges Standardized Video Interview (SVI) was recently added as a component of emergency medicine (EM) residency applications to provide additional information about interpersonal communication skills (ICS) and knowledge of professionalism (PROF) behaviors. Our objective was to ascertain the correlation between the SVI and residency interviewer assessments of PROF and ICS. Secondary objectives included examination of 1) inter-and intrainstitutional assessments of ICS and PROF, 2) correlation of SVI scores with rank order list (ROL) positions, and 3) the potential influence of gender on interview day assessments. Methods:We conducted an observational study using prospectively collected data from seven EM residency programs during 2017 and 2018 using a standardized instrument. Correlations between interview day PROF/ICS scores and the SVI were tested. A one-way analysis of variance was used to analyze the association of SVI and ROL position. Gender differences were assessed with independent-groups t-tests.Results: A total of 1,264 interview-day encounters from 773 unique applicants resulted in 4,854 interviews conducted by 151 interviewers. Both PROF and ICS demonstrated a small positive correlation with the SVI score (r = 0.16 and r = 0.17, respectively). ROL position was associated with SVI score (p < 0.001), with mean SVI scores for top-, middle-, and bottom-third applicants being 20.9, 20.5, and 19.8, respectively. No group differences with gender were identified on assessments of PROF or ICS.Conclusions: Interview assessments of PROF and ICS have a small, positive correlation with SVI scores. These residency selection tools may be measuring related, but not redundant, applicant characteristics. We did not identify gender differences in interview assessments.From the

show abstract

Section: Discussionsupporting

confidence: 91%

Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine

Hopson

Dorfsman

Branzetti

et al. 2019

AEM Education and Training

View full text Add to dashboard Cite

show abstract

“…Medical Licensing Examination scores and academic grade performance were predictive of subsequent formalized testing (ABSITE) but they were poor predictors of clinical performance. Superior faculty rating of resident performance was correlated with better rating on communication and professionalism competencies (residents who are able to communicate better and work in a team), 3 but ratings on communication and professionalism competencies did not correlate with ABSITE scores. 3 ABSITE scores also had a low correlation with technical skills or operative performance in surgical residents.…”

Section: Introductionmentioning

confidence: 86%

“…Faculty ratings, on the other hand, are a better measure of the residents' ability to apply knowledge in a timely fashion, yet they are often subject to bias (positive or negative). 3 Additional techniques are beginning to emphasize different variables of performance, including the need for focus on organizational factors, 4 emergency management, 5 and improvement of performance through structured observations. 6 Tools such as the Oxford Non-Technical Skills (NOTECHS) scale have emerged as a reliable and valid instrument for teamwork analysis.…”

Section: Introductionmentioning

confidence: 99%

Components of Critical Decision Making and ABSITE Assessment: Toward a More Comprehensive Evaluation

Krishnamurthy¹,

Satish²,

Foster³

et al. 2009

Journal of Graduate Medical Education

View full text Add to dashboard Cite

show abstract

“…This component evaluates the residents on tasks that must be performed to provide appropriate emergency medical care. 15 Our study included both the GRS scores and ITE scores since these are the major ways residents are evaluated during training. Our study was focused on four major objectives.…”

Section: Introductionmentioning

confidence: 99%

<p>The Effect of Simulation Wars on EM Residents’ Global Rating Scales and In-Training Examination Scores</p>

Mendez¹,

Takenaka²,

Cardenas‐Turanzas³

et al. 2020

OAEM

View full text Add to dashboard Cite

Purpose: The Accreditation Council for Graduate Medical Education (ACGME) restricted the duty hours for residents training in 2004. With less time to learn medicine, residents may not develop the clinical reasoning skills needed. Simulation can provide a remedy for this lack of time by allowing residents to practice skills and develop clinical reasoning in a simulated environment. Simulation Wars (SimWars), a clinical reasoning simulation has been shown to improve clinical reasoning skills. The purpose of the study was to investigate the effect of Simulation Wars on In-Training Examination (ITE) Scores and Global Rating Scale (GRS) Scores in Emergency Medicine (EM) residents. Methods: The Quasi-Experimental design was used in this retrospective study. The main comparison was between historical controls, the residents who did not participate in the Simulation Wars, and the intervention group comprised of residents who participated in the SimWars. Results: A total of 127 residents were participants in this study including 70 from the intervention and 57 from the historical control group. There were no significant differences found in GRS scores between both groups except for Communication and Professionalism (p<0.001). No overall improvement in ITE scores for the control group and for the intervention group was found. Furthermore, within the intervention group, while comparing those residents who participated in certain subcategories of SimWars and those who did not, there was a significant improvement in ITE scores in the subcategories of Thoracic Disorders, Abdominal/Gastrointestinal, Trauma Disorders and OBGyn. Conclusion: SimWars in the subcategories of Abdominal/Gastrointestinal, Thoracic, OBGyn and Trauma were found to be associated with improved ITE scores in those subcategories. Since Emergency Medicine utilizes extensive clinical reasoning skills, SimWars may provide better educational opportunities for EM residents.

show abstract

Are the Communication and Professionalism Competencies the New Critical Values in a Resident’s Global Evaluation Process?

Cited by 22 publications

References 16 publications

Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine

Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine

Components of Critical Decision Making and ABSITE Assessment: Toward a More Comprehensive Evaluation

<p>The Effect of Simulation Wars on EM Residents’ Global Rating Scales and In-Training Examination Scores</p>

Contact Info

Product

Resources

About