The measurement characteristics of the mini-CEX are similar to those of other performance assessments, such as standardized patients. Unlike these assessments, the difficulty of the examination will vary with the patients that a resident encounters. This effect is mitigated to a degree by the examiners, who slightly overcompensate for patient difficulty, and by the fact that each resident interacts with several patients. Furthermore, the mini-CEX has higher fidelity than these formats, permits evaluation based on a much broader set of clinical settings and patient problems, and is administered on site.

Accreditation of residency programs and certification of physicians requires assessment of competence in communication and interpersonal skills. Residency and continuing medical education program directors seek ways to teach and evaluate these competencies. This report summarizes the methods and tools used by educators, evaluators, and researchers in the field of physician-patient communication as determined by the participants in the "Kalamazoo II" conference held in April 2002. Communication and interpersonal skills form an integrated competence with two distinct parts. Communication skills are the performance of specific tasks and behaviors such as obtaining a medical history, explaining a diagnosis and prognosis, giving therapeutic instructions, and counseling. Interpersonal skills are inherently relational and process oriented; they are the effect communication has on another person such as relieving anxiety or establishing a trusting relationship. This report reviews three methods for assessment of communication and interpersonal skills: (1) checklists of observed behaviors during interactions with real or simulated patients; (2) surveys of patients' experience in clinical interactions; and (3) examinations using oral, essay, or multiple-choice response questions. These methods are incorporated into educational programs to assess learning needs, create learning opportunities, or guide feedback for learning. The same assessment tools, when administered in a standardized way, rated by an evaluator other than the teacher, and using a predetermined passing score, become a summative evaluation. The report summarizes the experience of using these methods in a variety of educational and evaluation programs and presents an extensive bibliography of literature on the topic. Professional conversation between patients and doctors shapes diagnosis, initiates therapy, and establishes a caring relationship. The degree to which these activities are successful depends, in large part, on the communication and interpersonal skills of the physician. This report focuses on how the physician's competence in professional conversation with patients might be measured. Valid, reliable, and practical measures can guide professional formation, determine readiness for independent practice, and deepen understanding of the communication itself.

No abstract

Blueprint for establishing effective postbaccalaureate medical school pre-entry program for educationally disadvantaged students.

Because of numerous criticisms of the content and structure of residency training, redesigning graduate medical education (GME) has become a high priority for the internal medicine community. From 2005 to 2007, the leadership of the internal medicine community, working under the auspices of the Alliance for Academic Internal Medicine Education Redesign Task Force, developed six recommendations it will pursue to improve residency education: (1) focus education around a "core" of internal medicine, which provides the framework for both the structure and content of residents' educational experiences, (2) fully adopt competency-based evaluation and advancement, which will enhance training by focusing on individual learners' needs, (3) allow for increased, resident-centered education beyond the internal medicine core, because different types of practice require customized knowledge and skills, (4) improve ambulatory training by providing patient-centered longitudinal care that addresses the conflict between inpatient and outpatient responsibilities, (5) use new faculty models that emphasize the creation of a core faculty, and (6) align institutional and programmatic resources with the goals of redesign, balancing the clinical mission of the institution with the educational goals of residency training. Adoption of these recommendations will require significant efforts, including pilot projects, faculty development, changes in accreditation requirements, and modifications of GME funding systems. Opportunities are ample for individual programs to develop creative approaches based on the framework for educational redesign outlined in this article, and for these educational and clinical redesign initiatives to work hand-in-hand for the benefit of patients, faculty, trainees, and institutions.

Federal value-based payment programs require primary care practices to conduct quality improvement activities, informed by the electronic reports on clinical quality measures that their electronic health records (EHRs) generate. To determine whether EHRs produce reports adequate to the task, we examined survey responses from 1,492 practices across twelve states, supplemented with qualitative data. Meaningful-use participation, which requires the use of a federally certified EHR, was associated with the ability to generate reports-but the reports did not necessarily support quality improvement initiatives. Practices reported numerous challenges in generating adequate reports, such as difficulty manipulating and aligning measurement time frames with quality improvement needs, lack of functionality for generating reports on electronic clinical quality measures at different levels, discordance between clinical guidelines and measures available in reports, questionable data quality, and vendors that were unreceptive to changing EHR configuration beyond federal requirements. The current state of EHR measurement functionality may be insufficient to support federal initiatives that tie payment to clinical quality measures.

A renewed emphasis on clinical competence and its assessment has grown out of public concerns about the safety, efficacy, and accountability of health care in the United States. Medical schools and residency training programs are paying increased attention to teaching and evaluating basic clinical skills, stimulated in part by these concerns and the responding initiatives of accrediting, certifying, and licensing bodies. This paper, from the Residency Review Committee for Internal Medicine of the Accreditation Council for Graduate Medical Education, proposes a new outcomes-based accreditation strategy for residency training programs in internal medicine. It shifts residency program accreditation from external audit of educational process to continuous assessment and improvement of trainee clinical competence.

Self-assessment using the ABIM diabetes PIM as part of recertification provides valuable practice information and can lead to meaningful behavioral change by physicians. Collaboration with an educator in quality improvement appears to facilitate the effects of the practice improvement module. Future work should investigate the effect on patient outcomes.