Medical students’ patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study

Abstract

Purpose: This study aimed to analyze patterns of using ChatGPT before and after group activities and to explore medical students’ perceptions of ChatGPT as a feedback tool in the classroom.Methods: The study included 99 2nd-year pre-medical students who participated in a “Leadership and Communication” course from March to June 2023. Students engaged in both individual and group activities related to negotiation strategies. ChatGPT was used to provide feedback on their solutions. A survey was administered to assess students’ perceptions of ChatGPT’s feedback, its use in the classroom, and the strengths and challenges of ChatGPT from May 17 to 19, 2023.Results: The students responded by indicating that ChatGPT’s feedback was helpful, and revised and resubmitted their group answers in various ways after receiving feedback. The majority of respondents expressed agreement with the use of ChatGPT during class. The most common response concerning the appropriate context of using ChatGPT’s feedback was “after the first round of discussion, for revisions.” There was a significant difference in satisfaction with ChatGPT’s feedback, including correctness, usefulness, and ethics, depending on whether or not ChatGPT was used during class, but there was no significant difference according to gender or whether students had previous experience with ChatGPT. The strongest advantages were “providing answers to questions” and “summarizing information,” and the worst disadvantage was “producing information without supporting evidence.”Conclusion: The students were aware of the advantages and disadvantages of ChatGPT, and they had a positive attitude toward using ChatGPT in the classroom.

Opportunities, challenges, and future directions of large language models, including ChatGPT in medical education: a systematic scoping review

“…ChatGPT has the potential to create realistic clinical simulation scenarios and build interactive teaching environments; therefore, it can be applied in various innovative teaching methods [ 22 , 39 , 52 ]. While this could revolutionize medical education, careful consideration is necessary to determine whether these changes are beneficial for clinical teaching rather than solely focusing on efficiency or economic benefits.…”

ChatGPT and Clinical Training: Perception, Concerns, and Practice of Pharm-D Students

“…The majority of students agreed that it was useful in providing answers and summarizing information, but it did not provide correct evidence. 20 In Saudi Arabia, a large survey was conducted among 1057 healthcare workers to assess their perceptions of the advantages of ChatGPT and intentions for future utilization. Two-thirds of the participants believed that although it could positively contribute to healthcare provision, concerns regarding the accuracy and legal issues hinder its current use and should be accompanied by human supervision.…”

Embracing ChatGPT for Medical Education: Exploring Its Impact on Doctors and Medical Students

“…ChatGPT’s application in medical education should be complemented by other teaching methods, such as CBL, TBL, and small-group sessions. The model’s ability to generate diverse perspectives and solutions enhances the overall TBL experience [ 14 ]. In CBL scenarios, ChatGPT can function as a case facilitator, generating realistic scenarios, asking probing questions, and providing nuanced feedback.…”