Assessing clinical communication skills in physicians: are the skills context specific or generalizable

Abstract

BackgroundCommunication skills are essential for physicians to practice Medicine. Evidence for the validity and domain specificity of communication skills in physicians is equivocal and requires further research. This research was conducted to adduce evidence for content and context specificity of communication skills and to assess the usefulness of a generic instrument for assessing communication skills in International Medical Graduates (IMGs).MethodsA psychometric design was used for identifying the reliability and validity of the communication skills instruments used for high-stakes exams for IMG's. Data were collected from 39 IMGs (19 men – 48.7%; 20 women – 51.3%; Mean age = 41 years) assessed at 14 station OSCE and subsequently in supervised clinical practice with several instruments (patient surveys; ITERs; Mini-CEX).ResultsAll the instruments had adequate reliability (Cronbach's alpha: .54 – .96). There were significant correlations (r range: 0.37 – 0.70, p < .05) of communication skills assessed by examiner with standardized patients, and of mini-CEX with patient surveys, and ITERs. The intra-item reliability across all cases for the 13 items was low (Cronbach's alpha: .20 – .56). The correlations of communication skills within method (e.g., OSCE or clinical practice) were significant but were non-significant between methods (e.g., OSCE and clinical practice).ConclusionThe results provide evidence of context specificity of communication skills, as well as convergent and criterion-related validity of communication skills. Both in OSCEs and clinical practice, communication checklists need to be case specific, designed for content validity.

Introducing objective structured practical examination as a method of learning and evaluation for undergraduate pharmacology

“…The OSCE has been used extensively to assess communication skills. [22] In our study, there was no OSPE station to evaluate communication skills. This was because of the limited time and workforce in the department.…”

Interrater Reliability of Standardized Actors Versus Nonactors in a Simulation Based Assessment of Interprofessional Collaboration

“…Studies have found that SPs can be effective in rating the simulation participants' performance 6,7 and can do so at least as effectively even as faculty or clinical supervisors when the target behaviors are communication skills or objective patient history checklist items. 8,9 However, such benefits may not accrue until SPs have reached a certain level of experience, and the cognitive demands of portraying the role can inhibit their ability to observe and evaluate learner behaviors. 10 Videotaping encounters for later observation allows such SPs to role-play and assess in series rather than in parallel, likely addressing the issue of cognitive overload.…”

Development of a measure to assess effective listening and interactive communication skills in the delivery of children’s rehabilitation services

“…To our knowledge, no existing measures assess the listening or communication skills of practicing children's health care providers. Listening and communication assessment needs to be context specific because the nature of effective communication varies with context [9,44]. Consequently, there is a particular need for a measure relevant to pediatric rehabilitation-one that captures practitioners' listening and communication skills within the context of ongoing and evolving client-practitioner relationships.…”