The Role of ChatGPT in Medical Research: Progress and Limitations

Ashraf, Hamza; Ashfaq, Haider

doi:10.1007/s10439-023-03311-0

Cited by 10 publications

(10 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although a few comments were provided regarding the strengths and limitations of both types of SCTs, they align with what is commonly reported in the literature for similar tasks. Some respondents noted caricature-like scenarios, possibly attributed to the robotic and dehumanized nature often associated with vignettes produced by LLMs [ 33 ]. It is plausible that more intricate prompts could have resulted in more nuanced scenarios.…”

Section: Discussionmentioning

confidence: 99%

Using ChatGPT in Psychiatry to Design Script Concordance Tests in Undergraduate Medical Education: Mixed Methods Study

Hudon,

Kiepura,

Pelletier

et al. 2024

JMIR Med Educ

View full text Add to dashboard Cite

Background Undergraduate medical studies represent a wide range of learning opportunities served in the form of various teaching-learning modalities for medical learners. A clinical scenario is frequently used as a modality, followed by multiple-choice and open-ended questions among other learning and teaching methods. As such, script concordance tests (SCTs) can be used to promote a higher level of clinical reasoning. Recent technological developments have made generative artificial intelligence (AI)–based systems such as ChatGPT (OpenAI) available to assist clinician-educators in creating instructional materials. Objective The main objective of this project is to explore how SCTs generated by ChatGPT compared to SCTs produced by clinical experts on 3 major elements: the scenario (stem), clinical questions, and expert opinion. Methods This mixed method study evaluated 3 ChatGPT-generated SCTs with 3 expert-created SCTs using a predefined framework. Clinician-educators as well as resident doctors in psychiatry involved in undergraduate medical education in Quebec, Canada, evaluated via a web-based survey the 6 SCTs on 3 criteria: the scenario, clinical questions, and expert opinion. They were also asked to describe the strengths and weaknesses of the SCTs. Results A total of 102 respondents assessed the SCTs. There were no significant distinctions between the 2 types of SCTs concerning the scenario (P=.84), clinical questions (P=.99), and expert opinion (P=.07), as interpretated by the respondents. Indeed, respondents struggled to differentiate between ChatGPT- and expert-generated SCTs. ChatGPT showcased promise in expediting SCT design, aligning well with Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria, albeit with a tendency toward caricatured scenarios and simplistic content. Conclusions This study is the first to concentrate on the design of SCTs supported by AI in a period where medicine is changing swiftly and where technologies generated from AI are expanding much faster. This study suggests that ChatGPT can be a valuable tool in creating educational materials, and further validation is essential to ensure educational efficacy and accuracy.

show abstract

Section: Discussionmentioning

confidence: 99%

Using ChatGPT in Psychiatry to Design Script Concordance Tests in Undergraduate Medical Education: Mixed Methods Study

Hudon,

Kiepura,

Pelletier

et al. 2024

JMIR Med Educ

View full text Add to dashboard Cite

show abstract

“…ChatGPT streamlines research by automating literature review and analysis. Additionally, ChatGPT aids medical researchers in study design and data analysis [ 21 ]. By expediting data processing, extracting data features and patterns, generating research design proposals, and offering statistical analysis methods and data visualization tools, ChatGPT facilitates improved experiment design and data analysis.…”

Section: Potential Benefits Of Chatgpt In Medical Educationmentioning

confidence: 99%

Embracing ChatGPT for Medical Education: Exploring Its Impact on Doctors and Medical Students

Wu,

Zheng,

Feng

et al. 2024

JMIR Med Educ

View full text Add to dashboard Cite

ChatGPT (OpenAI), a cutting-edge natural language processing model, holds immense promise for revolutionizing medical education. With its remarkable performance in language-related tasks, ChatGPT offers personalized and efficient learning experiences for medical students and doctors. Through training, it enhances clinical reasoning and decision-making skills, leading to improved case analysis and diagnosis. The model facilitates simulated dialogues, intelligent tutoring, and automated question-answering, enabling the practical application of medical knowledge. However, integrating ChatGPT into medical education raises ethical and legal concerns. Safeguarding patient data and adhering to data protection regulations are critical. Transparent communication with students, physicians, and patients is essential to ensure their understanding of the technology’s purpose and implications, as well as the potential risks and benefits. Maintaining a balance between personalized learning and face-to-face interactions is crucial to avoid hindering critical thinking and communication skills. Despite challenges, ChatGPT offers transformative opportunities. Integrating it with problem-based learning, team-based learning, and case-based learning methodologies can further enhance medical education. With proper regulation and supervision, ChatGPT can contribute to a well-rounded learning environment, nurturing skilled and knowledgeable medical professionals ready to tackle health care challenges. By emphasizing ethical considerations and human-centric approaches, ChatGPT’s potential can be fully harnessed in medical education, benefiting both students and patients alike.

show abstract

“…There is also dialogue on the use of AI in publishing covering topics such as editorial decision-making (COPE Council, 2021). In comparison, in the broader literature, there is a burgeoning of publications on AI related to authorship, ethics, plagiarism, bias, accuracy, performance, and scientific integrity (see, for example, Ashraf & Ashfaq, 2023;Baker et al, 2023;Cohen et al, 2023;Conroy et al, 2023;Dergaa et al, 2023;Dien, 2023;Doshi et al, 2023;Doyal et al, 2023;Farina & Lavazza, 2023;Garcia, 2023;Jeyaraman et al, 2023;Leung et al, 2023;Meyer et al, 2023;Ruffle et al, 2023;Takeda, 2023;Wang et al, 2023). However, there is a paucity of academic research on ChatGPT and qualitative research (Tabone & de Winter, 2023).…”

Section: What Does Chatgpt Mean For Qualitative Health Research?mentioning

confidence: 99%

What Does ChatGPT Mean for Qualitative Health Research?

van Manen

2023

Qual Health Res

View full text Add to dashboard Cite

The Role of ChatGPT in Medical Research: Progress and Limitations

Cited by 10 publications

References 4 publications

Using ChatGPT in Psychiatry to Design Script Concordance Tests in Undergraduate Medical Education: Mixed Methods Study

Using ChatGPT in Psychiatry to Design Script Concordance Tests in Undergraduate Medical Education: Mixed Methods Study

Embracing ChatGPT for Medical Education: Exploring Its Impact on Doctors and Medical Students

What Does ChatGPT Mean for Qualitative Health Research?

Contact Info

Product

Resources

About