Improvement of reliability of an oral examination by a structured evaluation instrument

Defining and Assessing Professional Competence

“…Standardized rating forms for direct observation of trainees [127][128][129][130][131][132] and structured oral examination formats have been developed in response to this criticism. 133,134 The Royal College of General Practitioners, dissatisfied with the capability of the OSCE to evaluate competence for the final professional licensing examination, developed a format in which candidates for certification present several best-case videotapes of their performance in real clinical settings to a trained examiner who uses specified criteria for evaluation. 135 Although the face validity of such a measure is high and the format is well accepted by physicians, 136 the number of cases that should be presented to achieve adequate reliability is unclear.…”

The death of the long case?

“…Other studies have obtained similar results, in stark contrast to clinical examinations such as the objective structured clinical examination, which often achieve reproducibility coefficients of 0.80 or better. 4 5 The table presents some typical findings for reproducibility of various formats.…”

Assessment formats in dental medicine: An overview

“…With a Cronbach’s α of 0.65-0.88 [25], [26], [27], SOEs come out ahead of conventional exams (Cronbach’s α of 0.24-0.50) [25], [28], [29]. …”