Validation of the imperial college surgical assessment device for spinal anesthesia

Abstract

BackgroundTraditionally, technical proficiency for spinal anesthesia has been assessed using observational scales such as global rating scales or task specific checklists. However more objective metrics are required in order to improve novice’s training programs. The aim of this study is to validate the hand motion analysis of the Imperial College Surgical Assessment Device (ICSAD) in a simulated model of spinal anesthesia.MethodsThree groups of physicians with different levels of experience were video recorded performing a spinal anesthesia in a simulated lumbar puncture torso. Participants’ technical performance was assessed with ICSAD, a Global Rating Scale (GRS) and a specific Checklist. Differences between the 3 groups were determined by Kruskal-Wallis test with post hoc Dunn’s correction for multiple comparisons. Spearman correlation coefficient between ICSAD variables and the scores of the observational scales were calculated to establish concurrent validity.ResultsThirty subjects participated in the study: ten novice (first year residents), 10 intermediate (third year residents) and 10 experts (attending anesthesiologists). GRS scores were significantly higher in experts, than intermediates and novices. Regarding total path length, number of movements and procedural time measured with ICSAD, all groups had significant differences between them (p = 0.026, p = 0.045 and p = 0.005 respectively). Spearman correlation coefficient was −0,46 (p = 0.012) between total path length measured with ICSAD and GRS scores.ConclusionsThis is the first validation study of ICSAD as an assessment tool for spinal anesthesia in a simulated model. Using ICSAD can discriminate proficiency between expert and novices and correlates with previously validated GRS. Its use in the assessment of spinal anesthesia proficiency provides complementary data to existing tools. Our results could be used to design future training programs with reliable goals to accomplish.Electronic supplementary materialThe online version of this article (10.1186/s12871-017-0422-3) contains supplementary material, which is available to authorized users.

Identifying patient safety competences among anesthesiology residents: systematic review

“… Article number Authors/Journal Title of publication Year of publication Country of publication 1 Fehr et al 12 / Anesthesiology Simulation-based Assessment of Pediatric Anesthesia Skills 2011 USA 2 Riem et al 13 / British Journal of Anaesthesia Do technical skills correlate with non-technical skills in crisis resource management: a simulation study 2012 UK 3 Oliveira Junior et al 14 / Anesthesia & Analgesia The prevalence of burnout and depression and their association with adherence to safety and practice standards: a survey of United States anesthesiology trainees 2013 USA 4 BLUM et al 15 / Anesthesiology Simulation-based Assessment to Identify Critical Gaps in Safe Anesthesia Resident Performance 2014 USA 5 Iblher et al 16 / BMC Medical Education What motivates young physicians? – a qualitative analysis of the learning climate in specialist medical training 2015 UK 6 Doyle et al 17 / BMJ Quality and Safety Self-reported patient safety competence among Canadian medical students and postgraduate trainees: a cross-sectional survey 2015 UK 7 Dalband; Mohseni; Rosani 18 / Advances in Natural and Applied Sciences The impact of anesthesiologists' level of expertise on orodental injuries in patients undergoing general anesthesia 2015 Jordan 8 Kumar et al 19 / Anesthesia Essays and Researches Perioperative communication practices of anesthesiologists: A need to introspect and change 2016 India 9 Corvetto et al 20 / BMC Anesthesiology Validation of the imperial college surgical assessment device for spinal anesthesia 2017 UK 10 Gauger et al …”

“…Corvetto et al 20 enrolled 30 residents to perform spinal anesthesia simulations and evaluated the number of movements made by trainees, and time for executing the procedure. The authors observed that the highest scores were obtained by third-year residents.…”

Motion analysis of the JHU-ISI Gesture and Skill Assessment Working Set using Robotics Video and Motion Assessment Software

“…Previous studies have examined the correlation between hand motion and surgical skill [9,10,12,30,34]. Hand motion has also been used in the training of anesthesiologists [35]. Motion tracking devices have been attached to surgeons' hands during actual surgery and the data analyzed by ROVIMAS [12].…”

Validity evidence of a task trainer for normal and difficult lumbar puncture

“…A small proportion of task-trainer simulators were reported as validated in that report and in more recent LP simulator validation studies. [ 23 , 24 , 26 ]…”