TikTok Tracheostomy Video Analysis of Quality, Credibility, and Readability

Abstract

Objective The goal of this study is to analyze the quality, credibility, and readability of videos on TikTok related to tracheostomy in order to assess the adequacy of the information for patient and parental education purposes. Study design This was a cross-sectional analysis of online content. Methods The social media platform TikTok was explored for videos related to tracheostomy. The search function was utilized with multiple hashtags related to tracheostomy and videos were reviewed and scored for quality, credibility, and readability. Each of the videos was assessed using the DISCERN criteria, JAMA benchmark, and readability score based on text either presented in the video or written in the caption. Pearson’s correlation coefficient was calculated for each of the studied parameters. Results The TikTok search bar was queried using multiple hashtags, including “#trach,” “#tracheostomy,” “#trachea,” and “#tracheotomy” for relevant videos from October 14 to October 15, 2021. Overall, 60 videos were selected for complete review and analysis. The total views for all related videos analyzed was 17,712,281. The total likes were 693,812. The videos were primarily posted by non-healthcare professionals making up approximately 72% of all videos. Videos created by physicians generated 63% of all views. The average DISCERN score for each video was 24.83 out of 75. The average Flesch Reading Ease score was 70.59 and the average Flesch-Kincaid Grade level was 5.5. There was a positive DISCERN score and views with R = 0.255 (p = 0.049), positive correlation between DISCERN and likes R = 0.334 (p = 0.009), positive correlation between DISCERN and JAMA R = 0.56 (p=<0.0001), positive correlation between DISCERN and Flesch-Kincaid Grade Level R = 0.330 (p=0.010) and a negative correlation between DISCERN and Flesch Reading Ease Score R = -0.337 (p=0.009). There was also a statistically significant positive correlation between JAMA and Flesch-Kincaid Grade Level R = 0.260 (p=0.045). Conclusion Overall, the quality of the videos on TikTok regarding tracheostomy rated poorly on the DISCERN quality index but included text that was fairly easy to read. Currently, medical videos on TikTok do not meet the quality metrics needed to properly educate the public and should not be used as a primary resource.