Development and validation of a tool for non-technical skills evaluation in robotic surgery—the ICARS system

Raison, Nicholas; Wood, Thomas Charles; Abe, Takashige; Ross, Talisa; Challacombe, Benjamin; Khan, Mohammed Shamim; Novara, Giacomo; Buffi, Nicolò Maria; Poel, Henk van der; McIlhenny, Craig; Ahmed, Kamran

doi:10.1007/s00464-017-5622-x

Cited by 54 publications

(46 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…64 Inter-rater reliability was assessed for SPLINTS (percentage ¼ 86%-95%; ICC ¼ 0. 51 and BARS (r ¼ 0.73). 68 Internal consistency was assessed for SPLINTS (r s r ¼ 0.84), 87 CATME (r ¼ 0.811), 97 workplace-based assessment (G ¼ 0.42-0.50), 98 Ottawa GRS (Cronbach a ¼ 0.96), 64 Cannon-Bowers Scale (Cronbach a ¼ 0.8), 95 OSANTS (Cronbach a ¼ 0.80), 90 and ICARS (Cronbach a ¼ 0.85-0.94).…”

Section: Observational Teamwork Assessment For Surgerymentioning

confidence: 99%

“…Content validity was established for SO-DIC-OR, 17 SPLINTS, 87 CATME, 97 OSANTS, 90 Ottawa GRS, 64 BMS-NNTS, 94 ICARS, 51 one unnamed tool, 99 and BARS. 68 Concurrent validity was established for SPLINTS, 9,47,86,87 SO-DIC-OR, 88 OSANTS, 90 Ottawa GRS, 64 two unnamed tools, 8,100 ICARS, 51 STCT, 96 BARS, 68 and Cannon-Bowers Scale. 95 Face validity was established for Ottawa GRS.…”

Section: Observational Teamwork Assessment For Surgerymentioning

confidence: 99%

See 1 more Smart Citation

Observational Tools That Quantify Nontechnical Skills in the Operating Room: A Systematic Review

McMullan

Urwin

Sunderland

et al. 2020

Journal of Surgical Research

View full text Add to dashboard Cite

a b s t r a c tBackground: Errors and adverse events in the operating room (OR) are associated with not only poor technical performance but also deficits in nontechnical skills (NTSs). Numerous tools have been developed to assess NTS in the OR. Our aim was to conduct a systematic review of observational tools and report on their implementation and psychometric properties to guide healthcare professionals, educators, and researchers in tool selection and use.Methods: A systematic literature search (January 1, 1990eMay 28, 2019) was conducted across databases (MEDLINE, Embase, CINAHL, and PsycINFO) and reference lists of included studies. Reviewers independently screened articles for inclusion, assessed study quality, and extracted data.Results: Thirty-one tools were identified across 88 studies, most commonly conducted in a real-world OR (n ¼ 50), involving two observers (n ¼ 50). The NTS of individuals (n ¼ 62)were assessed more often than that of subteams (n ¼ 21) or entire teams (n ¼ 20). The NOn-Technical Skills for Surgeons demonstrated content validity, concurrent validity, predictive validity, and face validity across a range of studies. Oxford NOn-TECHnical Skills demonstrated content validity, concurrent validity, and predictive validity with good inter-rater reliability and test-retest validity. Conclusions:The NOn-Technical Skills for Surgeons has the strongest evidence of validity and reliability for assessing individuals, whereas the most robust tool for evaluating teams was Oxford NOn-TECHnical Skills. We recommend continued investigation of these observational tools regarding their feasibility and reproducibility of methods. Further research is needed to determine the training requirements for observers and the potential of video and audio recordings in the OR. CrownThe operating room (OR) is a complex, high-risk environment in which many factors influence team performance and patient safety. The complexity that is manifested within and across the patient, procedure, equipment, team, and culture increases the likelihood of adverse events. 1 It has been estimated that approximately 40% to 65% of all in-hospital ScienceDirect jo urnal homepage: www.J ou rn alofS urgicalR esearch.com j o u r n a l o f s u r g i c a l r e s e a r c h m a r c h 2 0 2 0 ( 2 4 7 ) 3 0 6 e3 2 2

show abstract

Section: Observational Teamwork Assessment For Surgerymentioning

confidence: 99%

Section: Observational Teamwork Assessment For Surgerymentioning

confidence: 99%

Observational Tools That Quantify Nontechnical Skills in the Operating Room: A Systematic Review

McMullan

Urwin

Sunderland

et al. 2020

Journal of Surgical Research

View full text Add to dashboard Cite

show abstract

“…New challenges include the new technology, the surgeon being physically displaced from their team, a change in the surgeons' role and additional staff members to communicate with. The team must adapt their interactions and maintain excellent situational awareness and communication, for example staying aware of patient status and any equipment failure [1,4,12,28]. Other NTS areas to consider in robotic training include cognitive skills: technically demanding robotic procedures require a high level of decision making and planning.…”

Section: Training For Robotic Surgerymentioning

confidence: 99%

“…Other NTS areas to consider in robotic training include cognitive skills: technically demanding robotic procedures require a high level of decision making and planning. The assistant surgeon also has a higher responsibility as they are at the patients' side without the lead surgeon [1,12,28]. VR simulation can be used for robotic NTS training to further skills [1].…”

Section: Training For Robotic Surgerymentioning

confidence: 99%

See 1 more Smart Citation

Non-technical skills: a review of training and evaluation in urology

et al. 2019

Self Cite

View full text Add to dashboard Cite

Purpose With non-technical skills (NTS) deficits being recognised as a major cause for error in surgery, there is an increasing interest in their training and evaluation. A growing number of training courses are emerging and some NTS curricula have also been created. Many different training methods are described in the literature but there is still uncertainty with regards to their optimum combination within a curriculum. Methods A literature review of the electronic database Medline was performed. All articles published before December 2018 were screened by abstract and included if deemed relevant by the author. The included articles' reference lists were also screened for further relevant studies. Results Simulation training is accepted as the most effective way to train NTS. Within simulation training, it is shown that the 'igloo' full immersion/distributed simulation environment is appropriate for teaching NTS in urological scenarios where a designated operating room or space is not available. The use of multiple settings, for example wards and clinics as well as the operating room, is advantageous, as is training in an interprofessional team. Classroom teaching also plays a role in NTS training as an adjunct to simulation, with evidence that it improves some parameters of NTS. All levels, including qualified surgeons, benefit from NTS training; however, adaptation to both trainee level and specialty is important. Although less time consuming, training juniors and seniors together mainly benefits juniors, and training NTS at the same time as technical skills detracts from the quality of teaching. Debriefing is an important part of training and should be well structured; there are many debriefing models in existence, allowing for choice of method based on examiner preference and participant demographic. Furthermore, examiners should be well briefed in their task and trained in NTS assessment. Conclusion To move forward, studies should combine tried and tested learning techniques into a curriculum covering all training levels, which should then be validated and followed up long term to ensure a positive impact on patient safety.

show abstract