Assessment of the readability and quality of online patient education materials for the medical treatment of open-angle glaucoma

Crabtree, Lois; Lee, Edward

doi:10.1136/bmjophth-2021-000966

Cited by 9 publications

(17 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Many internet users seek health-related information, but most internet information comes from unregulated or unverified sources and may be unreliable. 1,2 Artificial intelligence (AI) language platforms can respond interactively to user inquiries by generating paragraph-form responses. 3 Given these platforms' popularity, large language model (LLM)-based platforms, such as chatbots, may be used for health information.…”

mentioning

confidence: 99%

“…Patients require accurate information about ophthalmic conditions to make informed medical decisions. Many internet users seek health-related information, but most internet information comes from unregulated or unverified sources and may be unreliable . Artificial intelligence (AI) language platforms can respond interactively to user inquiries by generating paragraph-form responses .…”

mentioning

confidence: 99%

See 1 more Smart Citation

Accuracy of Vitreoretinal Disease Information From an Artificial Intelligence Chatbot

et al. 2023

View full text Add to dashboard Cite

show abstract

mentioning

confidence: 99%

mentioning

confidence: 99%

Accuracy of Vitreoretinal Disease Information From an Artificial Intelligence Chatbot

et al. 2023

View full text Add to dashboard Cite

show abstract

“…They found online material to be of low quality with poor readability scores, requiring an 11th grade level or higher 16 . Other studies have produced similar findings on the topic of glaucoma 17–19 …”

Section: Introductionmentioning

confidence: 78%

“…16 Other studies have produced similar findings on the topic of glaucoma. [17][18][19] Glaucoma is the leading cause of irreversible blindness worldwide, and it affects the lives of over 60 million people. 20,21 Despite the availability of various pharmacologic and laser therapies, many patients require glaucoma surgery to better control their disease.…”

Section: Introductionmentioning

confidence: 99%

Can ChatGPT Aid Clinicians in Educating Patients on the Surgical Management of Glaucoma?

Kianian,

Sun,

Giaconi

2023

Journal of Glaucoma

View full text Add to dashboard Cite

Précis: ChatGPT can help healthcare providers automate the quality assessment of online health information, but it does not produce easier to understand responses compared to existing online health information. Purpose: To compare the readability of ChatGPT-generated health information about glaucoma surgery to existing material online, and to evaluate ChatGPT’s ability to analyze the quality of information found online about glaucoma surgery. Methods: ChatGPT was asked to create patient handouts on glaucoma surgery using 7 independent prompts aiming to generate 6th grade level reading material. Existing patient-targeted online health information about glaucoma surgery was selected from the top 50 search results of three search engines, excluding advertisements, blog posts, information intended for health professionals, irrelevant content, and duplicate links. Four validated tools were used to assess readability, and the readability of the ChatGPT-generated material was compared with the readability of existing online information. The DISCERN Instrument was used for quality assessment of online materials. The DISCERN instrument was also programmed to ChatGPT to evaluate its ability to analyze quality. The R software and descriptive statistics were used for data analysis. Results: 35 webpages were included. There was no difference between the reading level of online webpages (12th grade) and the reading level of ChatGPT-generated responses (11th grade), despite the ChatGPT prompts asking for simple language and a 6th grade reading level. The quality of health content was “fair” with only 5 resources receiving an “excellent” score. ChatGPT scored the quality of health resources with high precision (r=0.725). Conclusions: Patient-targeted information on glaucoma surgery is beyond the reading level of the average patient, and therefore at risk of not being understood, and is of subpar quality, per DISCERN tool scoring. ChatGPT did not generate documents at a lower reading level as prompted, but this tool can aid in automating the time-consuming and subjective process of quality assessment.

show abstract

“…The findings indicated that 229 studies evaluated readability in the context of patient education, with 91 of those evaluated using only readability criteria (Abdul Rahman et al, 2020;Ahmadzadeh et al, 2014;Al Aqeel et al, 2018;Alderson et al, 2020;Alejos et al, 2021;Alpaydin et al, 2021;Alshaikh et al, 2021;Alshehri & Joury, 2019;Alwani et al, 2021;Ang et al, 2022;Arif & Ghezzi, 2018;Arslan et al, 2020;Avancini et al, 2021;Azer et al, 2017;Azer et al, 2018;Bacher et al, 2020;Bai et al, 2019;Barnes & Davies, 2015;Bernstam et al, 2005;Best et al, 2015;Betschart et al, 2017;Bojrab 2nd et al, 2020;Boureanu et al, 2021;Brennan et al, 2021;Carden et al, 2007;Cheah et al, 2020;Cheng et al, 2016;Choudhery et al, 2020;Colaco et al, 2013;Coleman et al, 2022;Cook et al, 2017;Corredera et al, 2018;Crabtree & Lee, 2022;Dalton et al, 2015;Davis et al, 1998;De Felippe & Kar, 2015;Docimo Jr. et al, 2022;Dorcely et al, 2015;Doubleday et al, 2021;…”

Section: Acknowledgementsmentioning

confidence: 99%

Patient education information material assessment criteria: A scoping review

Ahmadzadeh

Bahrami

Zare–Farashbandi

et al. 2023

Health Info Libraries J

View full text Add to dashboard Cite

Background: Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.Objective: This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.Methods: National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.Results: Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability. Conclusion: This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

show abstract

Assessment of the readability and quality of online patient education materials for the medical treatment of open-angle glaucoma

Cited by 9 publications

References 35 publications

Accuracy of Vitreoretinal Disease Information From an Artificial Intelligence Chatbot

Accuracy of Vitreoretinal Disease Information From an Artificial Intelligence Chatbot

Can ChatGPT Aid Clinicians in Educating Patients on the Surgical Management of Glaucoma?

Patient education information material assessment criteria: A scoping review

Contact Info

Product

Resources

About