Shortcomings in the evaluation of studentsʼ clinical skills and behaviors in medical school

Abstract

The authors review the methods by which U.S. medical schools have evaluated student achievement during the twentieth century, especially for the assessment of noncognitive abilities, including clinical skills and behaviors. With particular reference to the current decade, information collected by the Liaison Committee on Medical Education (LCME) is used to examine the congruence of assessment methods with the rising tide of understanding--and accreditation requirements--that knowledge, competence, and behavioral objectives require different methods of assessment to measure the extent of students' learning in each domain. Amongst 97 medical schools having accreditation surveys between July 1993 and June 1998, only 186 of 751 basic science courses tested students' noncognitive achievements in things such as the preparation for and participation in small-group conferences, the quality of case-based discussion, library research and literature reviews, and research projects, despite staking out scholarship, habits of life-long learning, and reasoned thinking as educational objectives. In the clerkships of these schools, structured and observed assessments of clinical skills--with standardized patients and/or OSCEs--contributed 7.4-23.1% to a student's grade (depending on the clerkship discipline), while the predominant contribution (50-70% across the clerkships) was made by resident and faculty ratings that were based largely on recollections of case presentations and discussions having little relationship to interpersonal skills, rapport with patients, and logical and sequenced history taking and physical examination. On a more optimistic note, the results show that the number of schools using standardized patients in one or more clerkships increased between 1993 and 1998 from 34.1% to 50.4% of the 125 schools in the United States, and the number of schools using standardized patients in comprehensive fourth-year examinations increased from 19.1% to 48% of the total. Despite such progress, this study shows that too many medical schools still fail to employ evaluation methods that specifically assess students' achievement of the skills and behaviors they need to learn to practice medicine. The findings of this article explain why accreditors are paying closer attention to how well schools provide measured assurances that students learn what the faculties set out to teach.

The Illusion of Competency Versus the Desirability of Expertise: Seeking a Common Standard for Support Professions in Sport

“…what jargon terms were and were not essential and why, or the need for declarative knowledge in certain kinds of learner) would be required, further increasing the candidate's ability to make judgments and adapt in different situations to that presented as the test environment Competency Versus Expertise in Support Professions in Sport 5 [4,27]. Such approaches would seem essential if trainees are to go beyond clear knowledge that X means Y towards the more subtle blending and elaboration necessary for professional practice [51]. As another example, we would highlight the use of validated measures of reflective thinking, once again using a range of simulations, which are highly predictive of effective clinical thinking and decision making later in training [52].…”

Role of Simulation in US Physician Licensure and Certification

“…Despite the lack of evidence for improved medical outcomes, 81 the public demand for patient safety and growing acceptance by federal agencies, national accreditation and licensing organizations, state licensing bodies, educational accrediting bodies, specialty medical boards, medical schools, and local credentialing committees 80 -84 signals the likelihood that simulation-based evaluations will expand. Additionally, the development of national simulation accreditation and endorsing programs will likely lead to a national simulation standardization that will validate the use of these technologies for many primary and recertification processes and allow many simulation programs the opportunity to participate in such activities.…”

In-training assessment in an undergraduate clerkship. Feasibility, reliability, effect on learning environment

“…This is in line with earlier research on skills training. 1,3,4,[48][49][50] The findings of these studies suggest that even though competence learning is increasingly being emphasised in undergraduate and graduate education, optimal competence learning in the workplace remains yet to be achieved.…”