Background The competence of ChatGPT (Chat Generative Pre-Trained Transformer) in non-English languages is not well studied. Objective This study compared the performances of GPT-3.5 (Generative Pre-trained Transformer) and GPT-4 on the Japanese Medical Licensing Examination (JMLE) to evaluate the reliability of these models for clinical reasoning and medical knowledge in non-English languages. Methods This study used the default mode of ChatGPT, which is based on GPT-3.5; the GPT-4 model of ChatGPT Plus; and the 117th JMLE in 2023. A total of 254 questions were included in the final analysis, which were categorized into 3 types, namely general, clinical, and clinical sentence questions. Results The results indicated that GPT-4 outperformed GPT-3.5 in terms of accuracy, particularly for general, clinical, and clinical sentence questions. GPT-4 also performed better on difficult questions and specific disease questions. Furthermore, GPT-4 achieved the passing criteria for the JMLE, indicating its reliability for clinical reasoning and medical knowledge in non-English languages. Conclusions GPT-4 could become a valuable tool for medical education and clinical support in non–English-speaking regions, such as Japan.
Types of original research of peer‐reviewed publications by hospitalists.
Purpose The training of generalist physicians in university hospitals needs to emphasize development of their research role in order to continue improving their research capacity and their standing in academic hospitals in Japan. This cross-sectional descriptive study aimed to survey departments of general medicine (GM) in university hospitals in Japan to identify the research areas and themes pursued by academic generalist physicians. Patients and Methods The heads of the departments of GM from 71 university hospitals in Japan were enrolled. The main outcomes studied were the identification of the main research areas and themes in academic departments of GM, based on the classification of the National Grants-in-Aid for Scientific Research (KAKENHI): clinical research, public health, preventive medicine, medical education, basic science, health services and safety and quality. Results We received 47 of 71 replies (66.2% response rate). Clinical research was the most common area of research (62%), followed by public health and preventive medicine (14%), medical education (11%), and basic sciences (9%). Only one department identified health services and safety and quality as a research area (2%). There was marked variability in research areas across the different departments, with 23% of the research targeting the highest specialties, particularly organ-specific research in the fields of gastroenterology, cardiology, immunology, neurology, metabolic endocrinology, and hematology-oncology. Conclusion The training of generalist physicians in university hospitals needs to emphasize development of their research role in order to continue improving the research capacity and the standing generalist physicians in academic hospitals in Japan.
Background Diagnostic errors are prevalent and associated with increased economic burden; however, little is known about their characteristics at the national level in Japan. This study aimed to investigate clinical outcomes and indemnity payment in cases of diagnostic errors using Japan's largest database of national claims. Methods We analyzed characteristics of diagnostic error cases closed between 1961 and 2017, accessed through the national Japanese malpractice claims database. We compared diagnostic error-related claims (DERC) with non-diagnostic error-related claims (non-DERC) in terms of indemnity, clinical outcomes, and factors underlying physicians' diagnostic errors. Results All 1,802 malpractice claims were included in the analysis. The median patient age was 33 years (interquartile range = 10-54), and 54.2% were men. Deaths were the most common outcome of claims (939/1747; 53.8%). In total, 709 (39.3%, 95% CI: 37.0%-41.6%) DERC cases were observed. The adjusted total billing amount, acceptance rate, adjusted median claims payments, and proportion of deaths were significantly higher in DERC than non-DERC cases. Departments of internal medicine and surgery were 1.42 and 1.55 times more likely, respectively, to have DERC cases than others. Claims involving the emergency room (adjusted odds ratio [OR] = 5.88) and outpatient office (adjusted OR = 2.87) were more likely to be DERC than other cases. The initial diagnoses most likely to lead to diagnostic error were upper respiratory tract infection, non-bleeding digestive tract disease, and "no abnormality." Conclusions Cases of diagnostic errors produced severe patient outcomes and were associated with high indemnity. These cases were frequently noted in general exam and emergency rooms
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.