In 2000, the Accreditation Council for Medical Education introduced a new initiative that substantively changed the method by which residency programs are evaluated. In this new competency-based approach to residency education, assessment of performance became a main area of interest, and direct observation was offered as a tool to assess knowledge and skills. Despite being an inherent part of medical education as faculty and learners work together in clinical experiences, direct observation has traditionally been an informal and underused assessment method across all specialties. Residents and students report rarely being observed during their educational process, even though they value the experience. Reasons for this include a lack of faculty time, a lack of faculty skills, a potential stressful effect on the learner, and a perceived lack of validation of the assessment. This article examines the literature regarding the use of direct observation in medical education with a focus on validity evidence. We performed a PubMed search of articles pertaining to direct observation, using key words such as direct observation, performance observation, clinical observation, students, and residents. A subsequent search was conducted in known articles, focusing on variations of the term observation in the titles of articles and introducing the concept of clinical competence. In conclusion, direct observation is a unique and useful tool in the assessment of medical students and residents. Assessing learners in natural settings offers the opportunity to see beyond what they know and into what they actually do, which is fundamentally essential to training qualified physicians. Although the literature identifies several threats to its validity as an assessment, it also demonstrates methods to minimize those threats. Based on the current recommendations and need for performance assessment in education and with attention paid to the development and design, direct observation can and should be included in medical education curricula.
Residents serve as critically important teachers of students in the clinical workplace. Current RAT models are based largely on the teaching behaviors of faculty. The content and teaching strategies identified by students in this study should serve as the foundation for future RAT program development.
Discharge summaries (DS) communicate important clinical information from inpatient to outpatient settings. Previous studies noted increased adverse events and rehospitalization due to poor DS quality. We postulated that an audit and feedback intervention of DS completed by geriatric medicine fellows would improve the completeness of their summaries. We conducted a preintervention post intervention study. In phase 1 (AUDIT #1 and FEEDBACK) we scored all DS (n ¼ 89) completed by first year fellows between July 2006 to December 2006 using a 21-item checklist. Individual performance scores were reviewed with each fellow in 30-minute feedback sessions. In phase 2 (AUDIT #2) we scored all DS (n ¼ 79) completed after the first phase between February 2007 to July 2007 using the same checklist. Data were analyzed using generalized estimating equations. Fellows were more likely to complete all required DS data after feedback when compared with prior to feedback (91% vs. 71%, P < 0.001). Feedback was also associated with improved admission (93% vs. 70%, P < 0.001), duration of hospitalization (93% vs 78%, P < 0.001), discharge planning (93% vs. 18%, P < 0.02) and postdischarge care (83% vs. 57%., P < 0.001) section-specific information. In conclusion, audit and feedback sessions were associated with better DS completeness in areas of particular importance to geriatric care.
Students and faculty agreed that the physical examination course was the right time to introduce ultrasound (87% and 80%). Students demonstrated proper use of the ultrasound machine functions (M score = 91.55), and cardiac, thoracic, and abdominal system assessments (M score = 80.35, 79.58, and 71.57, respectively). Students and faculty valued the curriculum, and students demonstrated basic competency in performance and interpretation of ultrasound. Further study is needed to determine how to best incorporate this emerging technology into a robust learning experience for medical students.
As the percentage of time devoted to the care of older adults by internists continues to rise, the need for these physicians to be skilled at their care becomes even more critical. In fact, the Education Committee of the American Geriatrics Society has recommended the development of structured educational curricula to teach the principles of geriatric care. This article describes a comprehensive, evidence-based curriculum for internal medicine house staff in inpatient geriatric medicine. The intervention encompasses a novel instructional method, defined skill and behavioral goals, and a competency-based effectiveness evaluation. Moreover, the principles in this curricular model are those that may affect any hospitalized older adult and so will be important for all house staff taking care of inpatient geriatric patients, regardless of their future subspecialty choice.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.