A quality assessment of online patient information regarding tonsillitis using the EQIP tool

Kwan, Lok Yin; Yip, Ho Cheung Anthony; Tan, Sen; Fan, Ka Siu

doi:10.1016/j.ijporl.2022.111224

Cited by 10 publications

(5 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In contrast to these studies, which investigated common elective procedures, the urgent nature of foreign bodies means that financial considerations are unlikely to influence the presentation of information. Furthermore, it appears that commercial interests are not the key driver of a reduction in information quality: similarly poor content quality was seen in other infective conditions that affect airways, such as tonsillitis (median EQIP 19) [28] and COVID (median EQIP 17.8) [39]. This suggests that moderate and poor-quality information is likely the norm for ENT-related complaints regardless of its commercial influences.…”

Section: Evaluation Of Quality Of Health Informationmentioning

confidence: 99%

“…With foreign bodies often presenting urgently, a layperson may turn to information on the Internet for immediate advice. As with other common conditions, a plethora of websites provide information and advice on the insertion, ingestion, or inhalation of foreign bodies; the quality of these websites may vary considerably, as demonstrated in other ENT studies [13,14]. The impact of information can be optimised if the content is readable, accurate, and easily comprehended by individuals [15].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Evaluation of the Quality and Readability of Web-Based Information Regarding Foreign Bodies of the Ear, Nose, and Throat: Qualitative Content Analysis (Preprint)

Ko,

Tan,

Fan

2023

Preprint

View full text Add to dashboard Cite

BACKGROUND Foreign body inhalation, ingestion and insertion account for 11% of emergency admissions under Ear, Nose, and Throat (ENT). Children are disproportionately affected, and urgent intervention may be needed to maintain airway patency and prevent blood vessel occlusion. High-quality, readable online information could help reduce poor outcomes from foreign bodies. OBJECTIVE To determine the quality and readability of available online health information relating to foreign bodies. METHODS Six search phrases were queried using the Google Search Engine. For each search term, the first 30 results were captured. Websites in the English language and displaying health information were included. The provider and country of origin were recorded. The modified thirty-six-item Ensuring Quality Information for Patients (EQIP) tool was used to assess information quality. Readability was assessed using a combination of tools: Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning-Fog Index (GFI), and Simple Measure of Gobbledygook (SMOG). RESULTS After removal of duplicates, 73 websites were assessed, with the majority originating from from the United States (63%). Overall, the quality of the content was of moderate quality, with a median EQIP score of 21 (IQR 18-25, max 29) out of a maximum possible score of 36. Precautionary measures were not mentioned on 40% of websites and 30% did not identify disc batteries as a risky foreign body. Red flags necessitating urgent care were identified on 95% of websites, with 89% advising patients to seek medical attention and 38.4% advising on safe foreign body removal. Readability scores (FRES: 12.4 years; FKGL: 6.2; GFI: 6.5; SMOG: 5.9) showed most websites (56%) were below the recommended 6th-grade level. CONCLUSIONS The EQIP score suggests that information quality should be improved to provide patients and parents with clear information to help identify high-risk foreign bodies such as disc batteries and magnets, while providing guidance for removal of low-risk foreign bodies. Readability should also be optimised to 6th-grade/12-years-old literacy level where possible. Future research should focus on strategies for improving information quality and readability of information on websites appearing on the first page of search results. CLINICALTRIAL nil

show abstract

Section: Evaluation Of Quality Of Health Informationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Evaluation of the Quality and Readability of Web-Based Information Regarding Foreign Bodies of the Ear, Nose, and Throat: Qualitative Content Analysis (Preprint)

Ko,

Tan,

Fan

2023

Preprint

View full text Add to dashboard Cite

show abstract

“…The modified EQIP score was used for the analysis [14,15]. This score consists of 36 items and is divided into 3 domains: content (questions 1-18), identification (19)(20)(21)(22)(23)(24), and structure data (items [25][26][27][28][29][30][31][32][33][34][35][36]. Each condition was assessed using a spreadsheet including all of the 36 modified EQIP tool items.…”

Section: Modified Eqip Tool and Data Entrymentioning

confidence: 99%

“…Comparison of ChatGPT median Ensuring Quality Information for Patients scores with previously reported scores in the literature, divided into overall, content, identification and structure scores for appendicitis, gallstone, tonsillitis, bariatric surgery, and COVID-19[21][22][23][24][25].…”

mentioning

confidence: 99%

Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

Walker¹,

Ghani²,

Kümmerli³

et al. 2023

J Med Internet Res

View full text Add to dashboard Cite

Background ChatGPT-4 is the latest release of a novel artificial intelligence (AI) chatbot able to answer freely formulated and complex questions. In the near future, ChatGPT could become the new standard for health care professionals and patients to access medical information. However, little is known about the quality of medical information provided by the AI. Objective We aimed to assess the reliability of medical information provided by ChatGPT. Methods Medical information provided by ChatGPT-4 on the 5 hepato-pancreatico-biliary (HPB) conditions with the highest global disease burden was measured with the Ensuring Quality Information for Patients (EQIP) tool. The EQIP tool is used to measure the quality of internet-available information and consists of 36 items that are divided into 3 subsections. In addition, 5 guideline recommendations per analyzed condition were rephrased as questions and input to ChatGPT, and agreement between the guidelines and the AI answer was measured by 2 authors independently. All queries were repeated 3 times to measure the internal consistency of ChatGPT. Results Five conditions were identified (gallstone disease, pancreatitis, liver cirrhosis, pancreatic cancer, and hepatocellular carcinoma). The median EQIP score across all conditions was 16 (IQR 14.5-18) for the total of 36 items. Divided by subsection, median scores for content, identification, and structure data were 10 (IQR 9.5-12.5), 1 (IQR 1-1), and 4 (IQR 4-5), respectively. Agreement between guideline recommendations and answers provided by ChatGPT was 60% (15/25). Interrater agreement as measured by the Fleiss κ was 0.78 (P<.001), indicating substantial agreement. Internal consistency of the answers provided by ChatGPT was 100%. Conclusions ChatGPT provides medical information of comparable quality to available static internet information. Although currently of limited quality, large language models could become the future standard for patients and health care professionals to gather medical information.

show abstract

“…This checklist consists of 36 items, split into 3 domains, that evaluate written healthcare information and they cover a range of aspects, including clarity of language, logical and coherent presentation, the quality of website design, identification of authors and financers. This tool has been proven to be robust and applicable to a variety of conditions and therefore was selected for this study [11][12][13][14][15].…”

Section: Introductionmentioning

confidence: 99%

Assessment of Internet Available Patient Information on Chronic Pancreatitis Using the Ensuring Quality Information for Patients Tool: A Systematic Search and Evaluation

Staubli,

Ghani,

Walker

et al. 2023

Dig Dis

View full text Add to dashboard Cite

Introduction: Chronic pancreatitis (CP) is a relevant chronic medical problem whereby delayed presentation and poor patient understanding can cause adverse effects. Quality of patient information available on the internet about CP is not known. Methods: A systematic review of the information about CP available online using the search term “chronic pancreatitis” in using the search engine Google has been conducted. The quality of the top 100 websites returned from this search term were analysed using the validated Ensuring Quality Information for Patients (EQIP) tool (maximum score 36). Additional items were included in the website analysis specific to CP. Results: In total, 45 websites were eligible for analysis. The median EQIP score of the websites was 16 (IQR 12-19.5). The majority of websites originated from the United States and the United Kingdom with 31 and 11 websites, respectively. Provision of additional information was inconsistent, with most websites covering information regarding aetiology and advocating alcohol and tobacco cessation, but only few reporting on more complex issues. Conclusion: Internet available information about CP is of limited quality. There is an immediate need for high quality, patient targeted and informative literature accessible on the internet about this topic.

show abstract

A quality assessment of online patient information regarding tonsillitis using the EQIP tool

Cited by 10 publications

References 10 publications

Evaluation of the Quality and Readability of Web-Based Information Regarding Foreign Bodies of the Ear, Nose, and Throat: Qualitative Content Analysis (Preprint)

Evaluation of the Quality and Readability of Web-Based Information Regarding Foreign Bodies of the Ear, Nose, and Throat: Qualitative Content Analysis (Preprint)

Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

Assessment of Internet Available Patient Information on Chronic Pancreatitis Using the Ensuring Quality Information for Patients Tool: A Systematic Search and Evaluation

Contact Info

Product

Resources

About