Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

Boal, Matthew W E; Anastasiou, Dimitrios; Tesfai, Freweini; Ghamrawi, Walaa; Mazomenos, Evangelos; Curtis, Nathan; Collins, Justin W; Sridhar, Ashwin; Kelly, John; Stoyanov, Danail; Francis, Nader K

doi:10.1093/bjs/znad331

Cited by 8 publications

(3 citation statements)

References 262 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Assessment of the appropriate difficulty of procedural steps for a trainees may be achieved through learning curve analysis, with steps assigned to the component console surgeon in consideration of their previous experience. Further studies into the standardisation of assessment of technical skills is required [ 6 ].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

The deconstructed procedural description in robotic colorectal surgery

Larkins,

Quirke,

Ong

et al. 2024

J Robotic Surg

View full text Add to dashboard Cite

Increasing robotic surgical utilisation in colorectal surgery internationally has strengthened the need for standardised training. Deconstructed procedural descriptions identify components of an operation that can be integrated into proficiency-based progression training. This approach allows both access to skill level appropriate training opportunities and objective and comparable assessment. Robotic colorectal surgery has graded difficulty of operative procedures lending itself ideally to component training. Developing deconstructed procedural descriptions may assist in the structure and progression components in robotic colorectal surgical training. There is no currently published guide to procedural descriptions in robotic colorectal surgical or assessment of their training utility. This scoping review was conducted in June 2022 following the PRISMA-ScR guidelines to identify which robotic colorectal surgical procedures have available component-based procedural descriptions. Secondary aims were identifying the method of development of these descriptions and how they have been adapted in a training context. 20 published procedural descriptions were identified covering 8 robotic colorectal surgical procedures with anterior resection the most frequently described procedure. Five publications included descriptions of how the procedural description has been utilised for education and training. From these publications terminology relating to using deconstructed procedural descriptions in robotic colorectal surgical training is proposed. Development of deconstructed robotic colorectal procedural descriptions (DPDs) in an international context may assist in the development of a global curriculum of component operating competencies supported by objective metrics. This will allow for standardisation of robotic colorectal surgical training and supports a proficiency-based training approach.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Specialty specific training in colorectal surgery, however, is not yet standardised and has been implemented in differing formats internationally [ 4 , 5 ]. Furthermore, defining standardised objective assessments for accreditation can be challenging, as discussed in a recent systematic review [ 6 ].…”

Section: Introductionmentioning

confidence: 99%

The deconstructed procedural description in robotic colorectal surgery

Larkins,

Quirke,

Ong

et al. 2024

J Robotic Surg

View full text Add to dashboard Cite

show abstract

“…De Backer et al [57] proposed an annotation guide that could provide the basis for AI-based quality assessment, including instrument detection, segmentation and pose estimation. As recently highlighted, manual and automated assessment tools for robotic surgery are not yet well validated and require further evaluation before use in the accreditation process [58]. Future research, beyond this consensus, should focus on validating existing assessment tools and developing and piloting a new AI-specific study quality assessment tool.…”

Section: Plos Onementioning

confidence: 99%

European Robotic Surgery Consensus (ERSC): Protocol for the development of a consensus in robotic training for gastrointestinal surgery trainees

Fadel,

Walshaw,

Pecchini

et al. 2024

PLoS ONE

View full text Add to dashboard Cite

Background The rapid adoption of robotic surgical systems across Europe has led to a critical gap in training and credentialing for gastrointestinal (GI) surgeons. Currently, there is no existing standardised curriculum to guide robotic training, assessment and certification for GI trainees. This manuscript describes the protocol to achieve a pan-European consensus on the essential components of a comprehensive training programme for GI robotic surgery through a five-stage process. Methods and analysis In Stage 1, a Steering Committee, consisting of international experts, trainees and educationalists, has been established to lead and coordinate the consensus development process. In Stage 2, a systematic review of existing multi-specialty robotic training curricula will be performed to inform the formulation of key position statements. In Stage 3, a comprehensive survey will be disseminated across Europe to capture the current state of robotic training and identify potential challenges and opportunities for improvement. In Stage 4, an international panel of GI surgeons, trainees, and robotic theatre staff will participate in a three-round Delphi process, seeking ≥ 70% agreement on crucial aspects of the training curriculum. Industry and patient representatives will be involved as external advisors throughout this process. In Stage 5, the robotic training curriculum for GI trainees will be finalised in a dedicated consensus meeting, culminating in the production of an Explanation and Elaboration (E&E) document. Registration details The study protocol has been registered on the Open Science Framework (https://osf.io/br87d/).

show abstract