Development and validation of a recommended checklist for assessment of surgical videos quality: the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS) video assessment tool

Celentano, Valerio; Smart, Neil; Ra, Chisei; Spinelli, Antonino; Giglio, Mariano Cesare; McGrath, John; Obermair, Andreas; Pellino, Gianluca; Hasegawa, Hirotoshi; Lal, Pawanindra; Lorenzon, Laura; Angelis, Nicola De; Boni, Luigi; Gupta, Suman Lata; Griffith, John P.; Acheson, Austin G; Cecil, Tom; Coleman, Mark

doi:10.1007/s00464-020-07517-4

Cited by 47 publications

(35 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Apart from the two domains (items 5 and 9), the domain information was incompletely presented (or not presented) by the majority of the videos. Consistent with the findings of the previous studies [ 5 ], a moderate and statistically significant agreement existed among the observers in terms of the LAP-VEGaS scoring. No significant differences were observed among the videos of group A versus group B in terms of the %VPI or JAMA, suggesting that the overall quality of the minimally-invasive procedure (depicted by LAP-VEGaS) is an independent variable and has no relation with video popularity or medical information contained within the video.…”

Section: Discussionsupporting

confidence: 91%

“…Two authors (BJ and GS), with five years and more than ten years of experience in pediatric laparoscopic surgery respectively, assessed the quality of the operative videos using the LAP-VEGaS tool [ 5 ]. Developed in accordance with the Laparoscopic surgery video educational guidelines (LAP-VEGaS), this tool has nine domains of assessment.…”

Section: Methodsmentioning

confidence: 99%

“…Due to the recent popularity of this approach, pediatric LP has been incorporated in the training programs of various centers; senior trainees are expected to perform LP at the end of their multimodal learning program [ 3 ]. It has been demonstrated that a combination of hands-on experience on endo-trainer and watching operative videos provides an ideal training of the laparoscopic procedures [ 4 , 5 ].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Quality of YouTube Videos on Laparoscopic Pyeloplasty in Children: An Independent Assessment by Two Pediatric Surgeons

Anand¹,

Jadhav²,

Sandlas³

2021

Cureus

View full text Add to dashboard Cite

BackgroundYouTube (YT) is the most common video platform accessed by surgical trainees for the preparation of surgery. However, the quality of the YT videos has been questioned time and again. This study was performed to comprehensively assess the quality of the available YT videos on pediatric laparoscopic pyeloplasty (LP). Materials and MethodsThe term "laparoscopic pyeloplasty in children" was searched in YT on June 3, 2021, and ten most-viewed videos on LP were included. The percentage video power index (%VPI), the Journal of American Medical Association (JAMA) benchmark criteria, and the laparoscopic surgery video educational guidelines (LAP-VEGaS) video assessment tool were used to assess the video popularity, the quality of medical information, and the overall quality of the included videos respectively. Videos were defined as acceptable (score of 11 or more) or poor quality (score <11) based on LAP-VEGaS scores. The inter-observer agreement, in terms of the LAP-VEGaS scoring, was observed among two surgeons using the kappa statistics. ResultsThe median values of the %VPI and JAMA scores of the included YT videos were 68.1 (range 0-13570) and 2 (range 1-2) respectively. The median LAP-VEGaS score of these videos was 6.75 (range 2-16.5) with only two videos having acceptable quality. The quality of these videos was poor in 7/9 domains of the LAP-VEGaS tool. A moderate inter-observer agreement (kappa=0.542) was observed in terms of the LAP-VEGaS scores assigned to the videos (p<0.0001). ConclusionA comprehensive assessment of the ten most-viewed YT videos on pediatric LP revealed poor overall quality. The included videos depicted sub-optimal presentation of the medical information and weak conformity to the LAP-VEGaS guidelines.

show abstract

Section: Discussionsupporting

confidence: 91%

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Quality of YouTube Videos on Laparoscopic Pyeloplasty in Children: An Independent Assessment by Two Pediatric Surgeons

Anand¹,

Jadhav²,

Sandlas³

2021

Cureus

View full text Add to dashboard Cite

show abstract

“…Finally, each video was graded according to the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS), a validated video assessment tool. 14,15 LAP-VEGaS guidelines include nine line items with every item being scored from 0 (item not present in the video) to 2 (item extensively presented in the video), with a total marking score ranging from 0 to 18. The assessment tool was developed for identifying and selecting videos for acceptance for conference presentation and publication and as such, provides an assessment tool with a high level of internal consistency and generalizability.…”

Section: Methodsmentioning

confidence: 99%

“…The assessment tool was developed for identifying and selecting videos for acceptance for conference presentation and publication and as such, provides an assessment tool with a high level of internal consistency and generalizability. The authors grouped scores into categories of low, medium, or high quality (low: 0-6, medium: 7-12, high: [13][14][15][16][17][18]. Because the authors wanted to focus on free-to-access videos on YouTube as opposed to videos created for submission to conferences and presentations, they also performed a modified subgroup analysis based on the original LAP-VEGaS assessment scale to focus on the audiovisual and content quality of the surgery itself; this scale used items 3, 4, 5, 8, and 9 from the LAP-VEGaS guidelines to derive a modified 10-point scale (low: 0-3, medium: 4-7, high: 8-10).…”

Section: Methodsmentioning

confidence: 99%

Assessment of YouTube as an Educational Tool in Teaching Key Indicator Cases in Otolaryngology During the COVID-19 Pandemic and Beyond: Neck Dissection

Luu

Yver

Douglas

et al. 2021

Journal of Surgical Education

View full text Add to dashboard Cite

of 0.84) and good inter-rater reliability between resident physicians (Cohen's kappa coefficient of 0.58). There was no correlation between total view count, video age, or number of likes/dislikes and the overall LAP-VEGaS score. The presence of audio or written commentary had a moderate positive correlation with LAP-VEGaS score (adjusted R 2 of 0.36). There was no statistically significant difference in video quality between videos posted by US and non-US based physicians (95% confidence interval À0.10 to 4.10; p = 0.06). However, videos made by an otolaryngology-trained physician had a LAP-VEGaS score that was 3.93 points higher (95% confidence interval 2.34-5.52; p < 0.001) than that of videos made by a nonotolaryngology-trained physician. CONCLUSIONS: Online videos of neck dissection represent an increasingly ubiquitous and appropriate resource for trainees in learning otolaryngology key indicator cases. While free-to-access video repositories, such as YouTube, have become increasingly popular among trainees as a primary resource for learning and preparing for surgical cases, they lack consistent quality and as such, global efforts should be taken to improve the breadth and depth of educational video content in otolaryngology.

show abstract

Comparing the educational quality of free flap technique videos on public and paid platforms

Mulvihill

Lammers

et al. 2023

Microsurgery

View full text Add to dashboard Cite

BackgroundSurgical videos are reshaping the landscape for surgical education. As this form of education has rapidly grown and become a valuable resource for experienced surgeons, residents, and students, there is great variability in the presentation of what is offered. This study aimed to assess and compare the educational quality of free flap instructional videos on public and paid platforms.MethodsFree flap videos from public (YouTube) and paid (American Society of Plastic Surgeons Education Network and Plastic and Reconstructive Surgery Journal) sources were screened independently by three reviewers. Sample size was calculated to reach 80% power. The educational quality of the videos was determined using a modified version of Laparoscopic Surgery Video Educational Guidelines (0–6 low, 7–12 medium, 13–18 high). Professionally‐made videos were identified per lighting, positioning, and video/imaging quality. Interrater reliability between the three reviewers was calculated. The educational quality of the videos was compared between public and paid sources using Mood's median test. Pearson's correlation coefficient was utilized to assess the correlation between video length and educational quality.ResultsSeventy‐six videos were included (40 public, 36 paid). The median video lengths for public and paid platforms were 9.43(IQR = 12.33) and 5.07(IQR = 6.4) min, respectively. There were 18 high, 16 medium, and 6 low‐quality public videos, versus 13 high, 21 medium, and 2 low‐quality paid videos. Four public and seven paid videos were identified as professionally made. Interrater reliability was high (α = .9). No differences in educational quality were identified between public and paid platforms. Video length was not correlated with quality (p = .15). A video library compiling public high‐quality videos was created (https://www.youtube.com/playlist?list=PL‐d5BBgQF75VWSkbvEq6mfYI‐‐9579oPK).ConclusionsPublic and paid platforms may provide similar surgical education on free tissue transfer. Therefore, whether to subscribe to a paid video platform for supplemental free flap education should be determined on an individual basis.

show abstract

Development and validation of a recommended checklist for assessment of surgical videos quality: the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS) video assessment tool

Cited by 47 publications

References 29 publications

Quality of YouTube Videos on Laparoscopic Pyeloplasty in Children: An Independent Assessment by Two Pediatric Surgeons

Quality of YouTube Videos on Laparoscopic Pyeloplasty in Children: An Independent Assessment by Two Pediatric Surgeons

Assessment of YouTube as an Educational Tool in Teaching Key Indicator Cases in Otolaryngology During the COVID-19 Pandemic and Beyond: Neck Dissection

Comparing the educational quality of free flap technique videos on public and paid platforms

Contact Info

Product

Resources

About