How Do Examiners and Examinees Think About Role-Playing of Standardized Patients in an OSCE Setting?

Sadeghi, M R; Taghva, Arsia; Mirsepassi, Gholamreza; Hassanzadeh, Mohammad

doi:10.1176/appi.ap.31.5.358

Cited by 13 publications

(12 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Overall the present findings are in concordance with the Sadeghi et al study as overall rating of portrayal was “ok” or more for any SP (refer to global rating scale in the methods section) [11]. In the present study the SPs provided a good portrayal of the case; however we found differences across tracks and for one case across two locations.…”

Section: Discussionsupporting

confidence: 92%

“…Additional sources of SP error that have been identified include differences in portrayal of the same case by different SPs, demonstration of physical signs not related to the case, order and fatigue, and security breaches [11-17]. One threat to both the validity and reliability of OSCE scores is how well SPs portray the case [6,16].…”

Section: Introductionmentioning

confidence: 99%

“…Their study found that in seven stations the examiners’ rating were identical (87.5%). None of the examiners rated standardized patients as “weak” or “very weak” - they were all rated at 2 or above (ok/fair) [11]. Their study suggested that the portrayal was accurate and appropriate for the cases.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Accuracy of portrayal by standardized patients: Results from four OSCE stations conducted for high stakes examinations

et al. 2014

View full text Add to dashboard Cite

BackgroundThe reliability in Objective Structured Clinical Exams (OSCEs) is based on variance introduced due to examiners, stations, items, standardized patients (SP), and the interaction of one or more of these items with the candidates. The impact of SPs on the reliability has not been well studied. Accordingly, the main purpose of the present study was to assess the accuracy of portrayal by standardized patients.MethodsFour stations from a ten station high-stakes OSCE were selected for video recording. Due to the large number of candidates to be evaluated, the OSCE was administered using four assessment tracks. Four SPs were trained for each case (n = 16). Two physician assessors were trained to assess the accuracy of SP portrayal using a station-specific instrument based on the station guidelines. For the items with disagreement a third physician was asked to review and the mode was used for analysis. Each instrument included case-specific items on verbal and physical portrayal using a 3-point rating scale (“yes”, “yes, but” and “not done”). The physician assessors also scored each SP on their overall performance based on a 5-item anchored global rating scale (“very poor”, “poor”, “ok”, “good”, and “very good”). SPs at location 1 were trained by one trainer and SPs at location 2 had another trainer. All SPs were employed in a high-stakes OSCE for at least the second time.ResultsThe reliability of rating scores ranged from Cronbach’s alpha of .40 to .74. Verbal portrayal by SPs did not significantly differ for most items; however, the facial expressions of the SPs differed significantly (p < .05). An emergency management station that depended heavily on SPs physical presentation and facial expressions differed between all four SPs trained for that station.ConclusionsVariation of trained SP portrayal of the same station across different tracks and at different times in OSCE may contribute substantial error to OSCE assessments. The training of SPs should be strengthened and constantly monitored during the exam to ensure that the examinees’ scores are a true reflection of their competency and devoid of exam errors.

show abstract

Section: Discussionsupporting

confidence: 92%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Accuracy of portrayal by standardized patients: Results from four OSCE stations conducted for high stakes examinations

et al. 2014

View full text Add to dashboard Cite

show abstract

“…4,5 Well-trained SPs demonstrate high accuracy of portrayal in providing history information and physical examination information and acting out psychiatric disorders, according to the requested scenarios. 6,7 Standardized patient simulation is utilized not only to assist students in developing communication and intervention skills 8,9 but also as a powerful assessment tool that helps students acquire clinical skills. The SP evaluation technique has been shown to be beneficial to both students and instructors by providing a method of assessing communication abilities in addition to the knowledge on drug therapy.…”

Section: Introductionmentioning

confidence: 99%

Evaluation of student perceptions of standardized patient simulation on patient counseling confidence during introductory pharmacy practice experiences

Chen

Kiersma

Abdelmageed

2015

Currents in Pharmacy Teaching and Learning

View full text Add to dashboard Cite

“…Além disto, em nosso estudo, não foi preciso desenvolver mais que uma estação com o mesmo caso clínico, não havendo necessidade de vários pacientes simulados para o mesmo caso, o que foi apontado como outro fator de baixa confiabilidade do exame 20 . Corroborando nosso estudo, Sadeghi e colaboradores 21 observaram que houve concordância na avaliação dos pacientes padronizados em sete das oito estações realizadas, sugerindo acurácia dos pacientes padronizados para atuação nos casos clínicos propostos. Embora alguns Osces pareçam ser mais confiáveis do que outros, por motivos que não estão totalmente compreendidos 22 , os autores concordam em que o treinamento dos pacientes simulados deve ser fortalecido e constantemente monitorado durante o exame, a fim de assegurar que o resultado da avaliação seja reflexo real da competência do avaliado, desprovido de erros do Osce 20 .…”

Section: Discussionunclassified

Metodologias Ativas em Fisioterapia: Estudo de Confiabilidade Interexaminador do Método Osce

Cacho¹,

Baroni

Ruaro

et al. 2016

Rev. bras. educ. med.

View full text Add to dashboard Cite

RESUMO O presente estudo relata a experiência da aplicação do Exame Clínico Objetivo Estruturado (do inglês Objective Structured Clinical Examination – Osce) em um curso de Fisioterapia e demonstrar a confiabilidade interexaminador dos instrumentos de avaliação da simulação de atendimento fisioterapêutico. Participaram do estudo 29 estudantes regularmente matriculados no sétimo período do curso de Fisioterapia da Faculdade de Ciências da Saúde do Trairi, da Universidade Federal do Rio Grande do Norte (Facisa/UFRN). Foram elaboradas quatro estações de casos clínicos referentes à área de aparelho locomotor; para cada estação, havia um instrumento de avaliação da simulação do atendimento fisioterapêutico com as opções de resposta “sim”, “não” e “insuficiente”, com avaliação realizada por dois docentes em cada estação. O aluno teve sete minutos em cada estação para realizar a tarefa clínica, sendo que quatro alunos foram avaliados simultaneamente. Houve diferença significativa na distribuição de notas entre as estações 1 e 2 (p < 0,001) e 1 e 3 (p = 0,001). Verificou-se confiabilidade interexaminador excelente nas estações 1 (CCI = 0,89), 2 (CCI = 0,99) e 3 (CCI = 0,99), enquanto na estação 4 a confiabilidade interexaminador foi satisfatória (CCI = 0,73). Dessa forma, os achados indicam que o Osce na prática fisioterapêutica possui confiabilidade interexaminador de satisfatória a excelente, independentemente do perfil de ensino-aprendizagem e do instrumento de avaliação adotado, podendo ser um método útil para o processo avaliativo da formação profissional em saúde.

show abstract

How Do Examiners and Examinees Think About Role-Playing of Standardized Patients in an OSCE Setting?

Abstract: According to these findings, the authors recommend the use of standardized patients in OSCEs for psychiatric board certification exams.

Cited by 13 publications

References 12 publications

Accuracy of portrayal by standardized patients: Results from four OSCE stations conducted for high stakes examinations

Accuracy of portrayal by standardized patients: Results from four OSCE stations conducted for high stakes examinations

Evaluation of student perceptions of standardized patient simulation on patient counseling confidence during introductory pharmacy practice experiences

Metodologias Ativas em Fisioterapia: Estudo de Confiabilidade Interexaminador do Método Osce

Contact Info

Product

Resources

About