Performance of Residents and Anesthesiologists in a Simulation-based Skill Assessment

Abstract

This simulation-based assessment provided a valid method to distinguish the skills of more experienced anesthesia residents and anesthesiologists from residents in early training. The overall score provided a reliable measure of a participant's ability to recognize and manage simulated acute intraoperative events. Additional studies are needed to determine whether these simulation-based assessments are valid measures of clinical performance.

“GIOSAT”: a tool to assess CanMEDS competencies during simulated crises

“…Eighteen publications were finally selected. The retained articles were classified according to their main focus as NTSs, 8,14,[20][21][22][23][24] Medical Expert competency, 16,17,[25][26][27][28][29][30] or both. 13,15,31 The assessment tools were classified as checklists and global rating scales (GRS) (Fig.…”

Review article: Assessment in anesthesiology education

“…Validity evidence for such assessments can take the form of predictive relationships between examination performance and practice performance and/or the documentation of performance differences between individual groups known to have differences in ability or experience. [26][27][28][29] Unfortunately, validity evidence based on consequences of testing is often ignored. Throughout the education of anesthesiologists, assessments are administered with the expectation that some benefit will be realized from the intended use of the scores or results.…”

“…6,28,31 Unfortunately, for the most part, these articles often do not make a specific link between assessment methods and the competencies required for practice as an anesthesiologist. In this section, the ACGME core competencies are used as an organizing framework for the discussion of applicable assessment methods.…”

Review article: Simulation in anesthesia: state of the science and looking forward

“…86 As such, multiple stations (8)(9)(10)(11)(12)(13)(14)(15) were recommended in order to ensure that the scores obtained are reliably precise enough for an examiner to make decisions regarding an examinee's level of competence. 99,[101][102][103][104] Boulet and Murray 99 also discussed research into the validity of simulation-based assessments. To date, most of the work towards making inferences regarding the validity of simulation-based examinations has been directed towards content validity, i.e., seeking to ensure that simulation scenarios are modelled and scripted based on actual practice characteristics.…”