The objective structured clinical examination (OSCE) is increasingly being used as a method of clinical assessment yet its measurement characteristics have not been well documented. Evidence is accumulating that many OSCEs may be too short to achieve reliable results. This paper reports detailed psychometric analyses of OSCEs which were administered as part of a well-established final-year examination. Generalizability theory guided investigation of test reliability. At the present test length the OSCE components showed low reliabilities relative to written components. Satisfactory reliabilities could potentially be achieved if test length was increased to approximately 6 hours, a time which would create significant logistic problems for most medical schools. Several strategies for dealing with this practical problem have been explored. Firstly, it was shown that more careful selection of stations based on their psychometric characteristics can significantly improve reliability. Secondly, where rater availability is a limiting factor to increasing test length, more can be gained by using one rater per station and having more stations than using two raters per station. Finally, OSCE scores can, with advantage, be combined with other test scores which are obtained by using less resource-intensive methods. By adopting such strategies, a reliable assessment of clinical competence could be obtained in about 4 hours of testing time which was equally divided between an OSCE constructed of practical and clinical stations and a written test.
The in-house examinations were of relatively low quality. The quality of examination questions can be significantly improved by providing question writers with formal training.
Osteochondral lesions of the talus are common injuries that affect a wide variety of active patients. The majority of these lesions are associated with ankle sprains and fractures though several nontraumatic etiologies have also been recognized. Patients normally present with a history of prior ankle injury and/or instability. In addition to standard ankle radiographs, magnetic resonance imaging and computed tomography are used to characterize the extent of the lesion and involvement of the subchondral bone. Symptomatic nondisplaced lesions can often be treated conservatively within the pediatric population though this treatment is less successful in adults. Bone marrow stimulation techniques such as microfracture have yielded favorable results for the treatment of small (<15 mm) lesions. Osteochondral autograft can be harvested most commonly from the ipsilateral knee and carries the benefit of repairing defects with native hyaline cartilage. Osteochondral allograft transplant is reserved for large cystic lesions that lack subchondral bone integrity. Cell-based repair techniques such as autologous chondrocyte implantation and matrix-associated chondrocyte implantation have been increasingly used in an attempt to repair the lesion with hyaline cartilage though these techniques require adequate subchondral bone. Biological agents such as platelet-rich plasma and bone marrow aspirate have been more recently studied as an adjunct to operative treatment but their use remains theoretical. The present article reviews the current concepts in the evaluation and management of osteochondral lesions of the talus, with a focus on the available surgical treatment options.
Performance-based assessment methods have been used in the health professions for centuries, and dozens of studies of their psychometric characteristics have been reported over the past several decades. During that period, the health professions have seen a variety of performance-based assessment methods come and go, and some hard lessons have been learned from the many studies and frequent missteps. This article shares some of those lessons, using four performance-based assessment methods as examples: written clinical simulations (more commonly termed patient management problems), computer-based clinical simulations, oral examinations, and standardized patients (“live” simulations).
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.