Training ChatGPT Models in Assisting Urologists in Daily Practice

Abstract

Artificial Intelligence (AI) has shown the ability to enhance the accuracy and efficiency of physicians. ChatGPT is an AI chatbot that can interact with humans through text, over the internet. It is trained with machine learning algorithms, using large datasets. In this study, we compare the performance of using a ChatGPT API 3.5 Turbo model to a general model, in assisting urologists in obtaining accurate, valid medical information. The API was accessed through a Python script that was applied specifically for this study based on 2023 EAU guidelines in PDF format. This custom-trained model leads to providing doctors with more precise, prompt answers about specific urologic subjects, thus helping them, ultimately, providing better patient care.

Expanding horizons and navigating challenges for enhanced clinical workflows: ChatGPT in urology

“…This strategy will equip ChatGPT with the necessary skills and reduce the likelihood of patients and medical students receiving incorrect information. Indeed, training with clinical guidelines significantly improves the accuracy of ChatGPT responses, as was confirmed by Manolitis et al previously ( 40 ). UroChat ( https://urochat.streamlit.app ) was recently developed using the GPT 3.5-turbo model and 2023 EAU Guidelines.…”

“…Ayoub et al ( 39 ) conducted a cross-sectional analysis to evaluate ChatGPT's capabilities as a source of medical knowledge, using Google Search as a comparison, and discovered that ChatGPT performed better than Google Search when providing general medical knowledge, but worse when providing medical recommendations. Manolitis et al ( 40 ) assessed the efficacy of a ChatGPT API 3.5 Turbo model to a standard model in supporting urologists in getting precise, reliable medical information. The API was accessed using a Python script written particularly for this study and based on 2023 EAU guidelines in PDF format.…”

The “Flapbot”: A Global Perspective on the Validity and Usability of a Flap Monitoring Chatbot

“…Practitioners could input patient comorbidities and receive monitoring support aligned with patient-specific evidence-based local and national guidelines. 20 Moreover, users can understand the evidence and rationale behind each prompt, enriching their learning with each interaction.…”