The Relative Contributions of Interpersonal and Specific Clinical Skills to the Perception of Global Clinical Competence

Warf, Benjamin C.; Donnelly, Michael B.; Schwartz, Richard W.; Sloan, David A.

doi:10.1006/jsre.1999.5679

Cited by 24 publications

(15 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…All three stations of the examination demonstrated significant differences between the candidates and examiners. The assessors' marks had greater discriminatory power than computerized methods, possibly because the examiners were aware of the experience of the candidate 39,40 .…”

Section: Discussionmentioning

confidence: 98%

The examination assessment of technical competence in vascular surgery

Pandey

Wolfe

Liapis

et al. 2006

British Journal of Surgery

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 98%

The examination assessment of technical competence in vascular surgery

Pandey

Wolfe

Liapis

et al. 2006

British Journal of Surgery

View full text Add to dashboard Cite

show abstract

“…12-14 Improved communication skills have previously been linked to both advanced year of training 18 and to increased clinical competence. 19 The OSCE has also been adapted to assess competencies within the roles of professional 23,24,26 and scholar, 21,22 with varying amounts of success.…”

Section: Discussionmentioning

confidence: 99%

“…[12][13][14][15][16][17] In fact, there is evidence that improved interpersonal skills are linked to better overall OSCE performance. [18][19][20] There is also some evidence that an OSCE can be used to assess other CanMEDS roles, including the scholar role (application of evidence-base medicine or demonstration of teaching skills) 21,22 and the professional role (cultural awareness and the application of ethical principles). 23,24 An OSCE has also been used to assess multiple CanMEDS competencies in other fields of postgraduate training, such as radiology and neonatology.…”

mentioning

confidence: 99%

How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE)

Dwyer

Takahashi

Hynes

et al. 2014

cjs

View full text Add to dashboard Cite

Background: Assessing residents' understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid. Methods:The OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs).Results: Twenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores. Conclusion:An OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program.Contexte : Évaluer la compréhension et l'application des 6 rôles intrinsèques Can-MEDS (communicateur, professionnel, gestionnaire, collaborateur, promoteur de la santé, érudit) chez les résidents pose un défi pour les responsables de la formation médi-cale postdoctorale. Nous avons émis l'hypothèse selon laquelle un examen clinique objectif structuré (ECOS) conçu pour évaluer plusieurs rôles CanMEDS intrinsèques serait suffisamment fiable et valide.Méthodes : L'ECOS comportait 6 stations de 10 minutes, permettant chacune d'évaluer 2 rôles intrinsèques à l'aide de scénarios basés sur des cas (avec ou sans recours à des patients standardisés). Les résidents ont été notés au moyen d'échelles en 5 points et d'une évaluation globale de leur rendement à chacune des stations. La validité convergente a été vérifiée par corrélation avec les rapports d'évaluation en cours de formation (RÉF) des 12 mois précédents et un classement chiffré créé par les directeurs du programme (DP).Résultats: Vingt-cinq résidents des années 0, 3 et 5 y ont participé. La fiabilité interstation pour les scores totaux aux tests (en pourcentage) a été de 0,87, tandis que la fiabilité pour chacun des rôles de communicateur, collaborateur, gestionnaire et professionnel, a été supérieure à 0,8. Les scores totaux aux tests, les scores aux stations individuelles et les scores pour les rôles CanMEDS indivi...

show abstract

“…The current subjective evaluation of surgical trainees is hindered by many factors that impair accurate overall assessment. Warf and colleagues 7 have described how senior trainees received more favourable subjective evaluations than junior trainees in the performance of a skill at which, objectively, they performed equivalently. The poor correlation between subjective and objective assessment of technical ability has also been shown in the performance of laparoscopic techniques 8 .…”

Section: Discussionmentioning

confidence: 98%