Reliability and Validity of an Objective Structured Clinical Examination for Assessing the Clinical Performance of Residents

Petrusa, Emil; Blackwell, Thomas A.; Ainsworth, Michael

doi:10.1001/archinte.1990.00390150069014

Cited by 88 publications

(20 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This lack of convergence could be because OSCEs may be measuring competence in a contrived environment and the instruments utilized during supervised training are assessing performance. 30 This, however, does not mean that OSCE has no place in assessment, as to reach the top of Miller's pyramid competence has to be achieved before performance. 31 The reliability of the ITERs, mini-CEX, and PAR instruments were in the moderate-good range and in concordance with the results reported by others.…”

Section: Discussionmentioning

confidence: 99%

A construct validity study of clinical competence: A multitrait multimethod matrix approach

Baig

Violato

Crutcher

2010

Journal of Continuing Education in the Health Professions

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

A construct validity study of clinical competence: A multitrait multimethod matrix approach

Baig

Violato

Crutcher

2010

Journal of Continuing Education in the Health Professions

View full text Add to dashboard Cite

show abstract

“…the varying stringency in assessment standards from different groups of tutors at the pre-and post-course OSCEs may be a confounding factor. The interrater variability of OSCEs may limit the reliability of clinical examination and could be improved by standardization of the tasks and the scoring criteria [11,18]. A balanced approach is recommended, using checklists for practical and technical skill stations, and global ratings for communication skills and diagnostic task stations [11,19].…”

Section: Standardizedmentioning

confidence: 99%

Evaluation of the Effectiveness of Postgraduate General Medicine Training by Objective Structured Clinical Examination—Pilot Study and Reflection on the Experiences of Kaohsiung Medical University Hospital

Tsai

Liu

Lee

et al. 2008

The Kaohsiung J of Med Scie

View full text Add to dashboard Cite

Objective structured clinical examination (OSCE) is an effective assessment method to evaluate medical students' clinical competencies performance. Postgraduate year 1 (PGY1) residents have been initiated in a general medicine training program in Taiwan since 2003. However, little is known about the learning effectiveness of trainees from this program. This pilot study aimed to evaluate the clinical core competencies of PGY1 residents using OSCE, and to reflect on the strengths and weaknesses of this pilot assessment project. OSCE was conducted for five PGY1 examinees (4 men, 1 woman) with five stations covering core themes, including history taking, physical examination, clinical procedure of airway intubation, clinical reasoning, and communication skills for informing bad news. Itemized checklists and five-point Likert scale global ratings were used for evaluating performance. The results showed that the performance of our PGY1 residents on history taking was significantly better after about 2 months of postgraduate training on general internal medicine. Self-evaluation on performance by examinees revealed significantly lower global ratings on post-course OSCE (4.14 +/- 0.80 vs. 3.68 +/- 0.66; p < 0.02). Surveys from tutors and standardized patients (SPs) completed at pre- and post-course OSCEs showed consistently favorable responses on the purposes, content, process, and environment of this assessment (4.0 +/- 0.17 vs. 4.0 +/- 0.12, nonsignificant). However, a survey of the examinees completed at pre- and post-course OSCEs showed relatively unfavorable responses to the same aspects, and to tutors and SPs (4.1 +/- 0.09 vs. 3.7 +/- 0.18; p < 0.05). Qualitative information revealed that tutors and SPs remarked that PGY1 residents' medical knowledge performance was satisfactory but their clinical reasoning performance, communication skills (giving bad news) and self-confidence were unsatisfactory. In conclusion, this pilot study has demonstrated that OSCE is a rational and feasible assessment method for evaluating the effectiveness of our PGY general medicine training program. The quantitative data and qualitative information provide a foundation to improve the quality of the program design and evaluation in implementing postgraduate general medicine training.

show abstract

“…Recently, experts suggested that a more constructed core competency-based modification of the scoring system of OSCE is mandatory to appropriate evolution of clinical performance of residents. 4e7 In the present study, we had three goals: (1) to determine the reliability of the six-core-competency-based OSCE in sequential testing of PGY 1 residents; (2) to compare corecompetency acquisition before and after the internal medicine training program of PGY 1 residents; and (3) to determine the usefulness of the information gained from PGY 1 resident clinical performance.…”

Section: Introductionmentioning

confidence: 99%

A core competence-based objective structured clinical examination (OSCE) in evaluation of clinical performance of postgraduate year-1 (PGY1) residents

Yang

Lee

Hsu

et al. 2011

Journal of the Chinese Medical Association

View full text Add to dashboard Cite

show abstract

Reliability and Validity of an Objective Structured Clinical Examination for Assessing the Clinical Performance of Residents

Cited by 88 publications

References 6 publications

A construct validity study of clinical competence: A multitrait multimethod matrix approach

A construct validity study of clinical competence: A multitrait multimethod matrix approach

Evaluation of the Effectiveness of Postgraduate General Medicine Training by Objective Structured Clinical Examination—Pilot Study and Reflection on the Experiences of Kaohsiung Medical University Hospital

A core competence-based objective structured clinical examination (OSCE) in evaluation of clinical performance of postgraduate year-1 (PGY1) residents

Contact Info

Product

Resources

About