Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback

Moorthy, Krishna; Munz, Yaron; Jiwanji, M.; Bann, Simon; Chang, Avril; Darzi, Ara

doi:10.1007/s00464-003-8513-2

Cited by 74 publications

(5 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This research suggests that exposing trainees to simulators in the beginning of their training may accelerate initial skills acquisition in addition to improving confidence in completing procedures early on, but does not necessarily correlate to long‐term outcomes of training. Simulation is currently being used in adult endoscopy, and studies have shown reliability in measuring skill acquisition …”

Section: Discussionmentioning

confidence: 99%

Paediatric gastroenterology fellows’ self‐assessment of endoscopy skills

Gamboa

2019

GastroHep

View full text Add to dashboard Cite

Background: Endoscopy is a fundamental skill learned during a paediatric gastroenterology fellowship. The aim of this study was to determine the number of procedures performed during fellowship and to evaluate a trainee's self-perceived competency of their endoscopic skills. Methods:A survey link was emailed to the NASPGHAN PEDI GI Fellows listserv composed of 372 fellows. Procedural count of eight routine procedures and a visual analogue scale measuring fellow's self-perceived competency for each procedure were evaluated. The data were collected and stored using REDCap. Data analysis was completed using descriptive statistics. Results: One hundred and sixty-seven fellows (45%) completed the survey: 28% first year, 41% second year and 31% third year. 50% or fewer of third-year fellows felt competent and met the complete procedural number thresholds recommended by the 2013 NASPGHAN training guidelines for routine procedures except for diagnostic oesophagogastroduodenoscopy (EGD). Subjects felt competent regarding colonoscopy but only 24% reached the threshold. There was no difference in EGD counts between small vs large training programmes (P = .51). Therapeutic endoscopy scored the lowest on self-reported competency scale. Conclusion: This study showed that a majority of third-year trainees feel competent regarding EGD and colonoscopy skills, but only reached threshold counts in EGD. Although paediatric gastroenterologists and trainees are thought to perform safe and effective gastrointestinal endoscopy, this data suggest that time could be dedicated to more complex procedural training. Additional research should be completed in this area to evaluate the value of self-reported competency and to consider revision of the 2013 NASPGHAN training guidelines. How to cite this article: Gamboa HE, Friedlander JA. Paediatric gastroenterology fellows' self-assessment of endoscopy skills.

show abstract

Section: Discussionmentioning

confidence: 99%

Paediatric gastroenterology fellows’ self‐assessment of endoscopy skills

Gamboa

2019

GastroHep

View full text Add to dashboard Cite

show abstract

“…Similar studies on assessment tools have been performed by assessing videotaped performance of procedural skills after masking the identity of the trainees or by employing assessors not known to the trainees and vice versa. [11121819] We were not able to arrange this methodology because of lack of funds. Efforts were made to reduce this bias by the inclusion of residents who were not rotating with either of the two assessors at the time of assessment.…”

Section: Discussionmentioning

confidence: 99%

“…Reliability of a tool is its ability to assess skills consistently by different assessors at different times while construct validity is the ability of the tool to differentiate among varying levels of expertise. [67111213]…”

Section: Introductionmentioning

confidence: 99%

Reliability and validity of a tool to assess airway management skills in anesthesia trainees

Ahmed

Khan

Ismail

2016

J Anaesthesiol Clin Pharmacol

View full text Add to dashboard Cite

Background and Aims:Gaining expertise in procedural skills is essential for achieving clinical competence during anesthesia training. Supervisors have the important responsibility of deciding when the trainee can be allowed to perform various procedures without direct supervision while ensuring patient safety. This requires robust and reliable assessment techniques. Airway management with bag-mask ventilation and tracheal intubation are routinely performed by anesthesia trainees at induction of anesthesia and to save lives during a cardiorespiratory arrest. The purpose of this study was to evaluate the construct validity, and inter-rater and test-retest reliability of a tool designed to assess competence in bag-mask ventilation followed by tracheal intubation in anesthesia trainees.Material and Methods:Informed consent was obtained from all participants. Tracheal intubation and bag-mask ventilation skills in 10 junior and 10 senior anesthesia trainees were assessed by two investigators on two occasions at a 3-4 weeks interval, using a procedure-specific assessment tool.Results:Average kappa value for inter-rater reliability was 0.91 and 0.99 for the first and second assessments, respectively, with an average agreement of 95%. The average agreement for test-retest reliability was 82% with a kappa value of 0.39. Senior trainees obtained higher scores compared to junior trainees in all areas of assessment, with a significant difference for patient positioning, preoxygenation, and laryngoscopy technique, depicting good construct validity.Conclusion:The tool designed to assess bag-mask ventilation and tracheal intubation skills in anesthesia trainees demonstrated excellent inter-rater reliability, fair test-retest reliability, and good construct validity. The authors recommend its use for formative and summative assessment of junior anesthesia trainees.

show abstract

“…A recent study comparing clinical training alone to simulator training revealed that adopting a combined training approach is the best method to learn diagnostic EGD [ 20 ]. Studies describing simulator-based training for EGD are few compared to those reporting on colonoscopy or therapeutic endoscopy [ 19 , 21 , 22 ]. Existing literature suggests that simulator training can reduce the overall procedure time and significantly improve technical accuracy.…”

Section: Teaching Aidsmentioning

confidence: 99%

Training in Endoscopy: Esophagogastroduodenoscopy

Kim

2017

Clin Endosc

View full text Add to dashboard Cite

Gastrointestinal endoscopy is important in diagnosis, treatment, and prevention of many diseases of the digestive tract. The ability to perform esophagogastroduodenoscopy (EGD) safely, effectively, and efficiently has become the mainstay of gastroenterology practice. In Korea, EGD education is usually imparted as a component of gastroenterology training programs during fellowship. In this review, we discuss the general principles of EGD training. Formal curriculum development with devising clear goals and effective training methods should be developed in the future.

show abstract

Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback

Abstract: The upper gastrointestinal simulator may be a useful tool for determining whether a trainee has achieved a desired level of competence in endoscopy. The next step will be to validate the VES score in real procedures.

Cited by 74 publications

References 12 publications

Paediatric gastroenterology fellows’ self‐assessment of endoscopy skills

Paediatric gastroenterology fellows’ self‐assessment of endoscopy skills

Reliability and validity of a tool to assess airway management skills in anesthesia trainees

Training in Endoscopy: Esophagogastroduodenoscopy

Contact Info

Product

Resources

About