Health Literacy Gaps in Online Resources for Cirrhotic Patients

Kaundinya, Trisha; Mazumder, Nikhilesh; Atiemo, Kofi; Spellman, Ari; Daud, Amna; Curtis, Laura M.; Ladner, Daniela P.

doi:10.14740/jcs401

Cited by 12 publications

(13 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…(15) Another study showed that online resources available to patients through health platforms and hepatology centers were lengthy and complex, highlighting the limited availability of easyto-understand information for this patient population. (16) ChatGPT (Generative Pre-trained Transformer) is a natural language processing (NLP) model developed by OpenAI. (17) It generates human-like text for use in chatbot conversations.…”

Section: Introductionmentioning

confidence: 99%

Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma

Yeo¹,

Samaan²,

Ng³

et al. 2023

Clin Mol Hepatol

274

View full text Add to dashboard Cite

Background & Aims: Patients with cirrhosis and hepatocellular carcinoma (HCC) require extensive and personalized care to improve outcomes. ChatGPT (Generative Pre-trained Transformer), a large language model, holds the potential to provide professional yet patient-friendly support. We aimed to examine the accuracy and reproducibility of ChatGPT in answering questions regarding knowledge, management, and emotional support for cirrhosis and HCC.Methods: ChatGPT's responses to 164 questions were independently graded by two transplant hepatologists and resolved by a third reviewer. The performance of ChatGPT was also assessed using two published questionnaires and 26 questions formulated from the quality measures of cirrhosis management. Finally, its emotional support capacity was tested. Results:We showed that ChatGPT regurgitated extensive knowledge of cirrhosis (79.1% correct) and HCC (74.0% correct), but only small proportions (47.3% in cirrhosis, 41.1% in HCC) were labeled as comprehensive. The performance was better in basic knowledge, lifestyle, and treatment than in the domains of diagnosis and preventive medicine. For the quality measures, the model answered 76.9% of questions correctly but failed to specify decision-making cut-offs and treatment durations. ChatGPT lacked knowledge of regional guidelines variations, such as HCC screening criteria. However, it provided practical and multifaceted advice to patients and caregivers regarding the next steps and adjusting to a new diagnosis. Conclusions:We analyzed the areas of robustness and limitations of ChatGPT's responses on the management of cirrhosis and HCC and relevant emotional support. ChatGPT may have a role as an adjunct informational tool for patients and physicians to improve outcomes.

show abstract

Section: Introductionmentioning

confidence: 99%

Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma

Yeo¹,

Samaan²,

Ng³

et al. 2023

Clin Mol Hepatol

274

View full text Add to dashboard Cite

show abstract

“…15 Another study showed that online resources available to patients through health platforms and hepatology centers were lengthy and complex, highlighting the limited availability of easy-to-understand information for this patient population. 16 ChatGPT (Generative Pre-trained Transformer) is a natural language processing (NLP) model developed by OpenAI. 17 It generates human-like text for use in chatbot conversations.…”

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma

Yeo

Samaan

et al. 2023

Preprint

View full text Add to dashboard Cite

Background: Patients with cirrhosis and hepatocellular carcinoma (HCC) require extensive care. Personalized education can improve their outcomes. ChatGPT (Generative Pre-trained Transformer), a natural language processing model, has shown potential to provide professional yet patient-freindly responses. Aim: To examine the accuracy and reproducibility of ChatGPT in responding to questions regarding knowledge, management, and emotional support for cirrhosis and HCC. Method: ChatGPT's responses to 164 frequently asked questions were independently graded by two transplant hepatologists, with a third reviewer resolving any discrepancies. We also compared the performance of ChatGPT on two previously validated and published questionnaires to the physicians or trainees who were tested in the included publications. Furthermore, we formulated the 26 quality measures of cirrhosis management into questions and tested ChatGPT's knowledge in cirrhosis care. Finally, the capacity to provide emotional support to patients or caregivers was tested. Results: ChatGPT regurgitated extensive knowledge about both cirrhosis and HCC, but for questions with correct responses, only a small proportion was labelled as comprehensive. The performance was better in basic knowledge, lifestyle, and treatment than in the domains of diagnosis and preventive medicine. For the quality measures, the model answered 76.9% of questions correctly but failed to specify the cut-off values for making medical decisions and treatment durations. When compared to physicians/trainees, ChatGPT fell short in knowledge of guidelines varying across geographic regions, such as HCC screening criteria. The model also provided practical and multifaceted advice to patients and caregivers regarding the next steps and adjusting to a new diagnosis. Conclusion: In summary, we analyzed the areas of robustness and limitations of ChatGPT's responses on the management of cirrhosis and HCC and relevant emotional support. ChatGPT may have a role as an adjunct informational tool for patients and physicians to improve outcomes.

show abstract

“…37,38 However, informed decision-making can be difficult to achieve for patients who have low health literacy. [78][79][80][81][82] Furthermore, improved knowledge does not always translate into better decision-making and improved access to SOT or LDKT. A randomized study involving 499 patients with ESKD presenting for KT evaluation assessed the efficacy of a 25-min video (information about donor evaluation, surgery, and life after donation) followed by a 15-min meeting with a transplant educator compared with standard pretransplant education (90-min slide presentation without a transplant educator session).…”

Section: Transplant-related Knowledge and Treatment Decisionsmentioning

confidence: 99%

Pretransplant Patient Education in Solid-organ Transplant: A Narrative Review

et al. 2021

View full text Add to dashboard Cite

Education for pretransplant, solid-organ recipient candidates aims to improve knowledge and understanding about the transplant process, outcomes, and potential complications to support informed, shared decision-making to reduce fears and anxieties about transplant, inform expectations, and facilitate adjustment to posttransplant life. In this review, we summarize novel pretransplant initiatives and approaches to educate solid-organ transplant recipient candidates. First, we review approaches that may be common to all solid-organ transplants, then we summarize interventions specific to kidney, liver, lung, and heart transplant. We describe evidence that emphasizes the need for multidisciplinary approaches to transplant education. We also summarize initiatives that consider online (eHealth) and mobile (mHealth) solutions. Finally, we highlight education initiatives that support racialized or otherwise marginalized communities to improve equitable access to solid-organ transplant. A considerable amount of work has been done in solid-organ transplant since the early 2000s with promising results. However, many studies on education for pretransplant recipient candidates involve relatively small samples and nonrandomized designs and focus on short-term surrogate outcomes. Overall, many of these studies have a high risk of bias. Frequently, interventions assessed are not well characterized or they are combined with administrative and data-driven initiatives into multifaceted interventions, which makes it difficult to assess the impact of the education component on outcomes. In the future, well-designed studies rigorously assessing well-defined surrogate and clinical outcomes will be needed to evaluate the impact of many promising initiatives.

show abstract

Health Literacy Gaps in Online Resources for Cirrhotic Patients

Cited by 12 publications

References 26 publications

Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma

Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma

Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma

Pretransplant Patient Education in Solid-organ Transplant: A Narrative Review

Contact Info

Product

Resources

About