Introduction:Large language models have demonstrated impressive capabilities, but application to medicine remains unclear. We seek to evaluate the use of ChatGPT on the American Urological Association Self-assessment Study Program as an educational adjunct for urology trainees and practicing physicians.Methods:One hundred fifty questions from the 2022 Self-assessment Study Program exam were screened, and those containing visual assets (n=15) were removed. The remaining items were encoded as open ended or multiple choice. ChatGPT’s output was coded as correct, incorrect, or indeterminate; if indeterminate, responses were regenerated up to 2 times. Concordance, quality, and accuracy were ascertained by 3 independent researchers and reviewed by 2 physician adjudicators. A new session was started for each entry to avoid crossover learning.Results:ChatGPT was correct on 36/135 (26.7%) open-ended and 38/135 (28.2%) multiple-choice questions. Indeterminate responses were generated in 40 (29.6%) and 4 (3.0%), respectively. Of the correct responses, 24/36 (66.7%) and 36/38 (94.7%) were on initial output, 8 (22.2%) and 1 (2.6%) on second output, and 4 (11.1%) and 1 (2.6%) on final output, respectively. Although regeneration decreased indeterminate responses, proportion of correct responses did not increase. For open-ended and multiple-choice questions, ChatGPT provided consistent justifications for incorrect answers and remained concordant between correct and incorrect answers.Conclusions:ChatGPT previously demonstrated promise on medical licensing exams; however, application to the 2022 Self-assessment Study Program was not demonstrated. Performance improved with multiple-choice over open-ended questions. More importantly were the persistent justifications for incorrect responses—left unchecked, utilization of ChatGPT in medicine may facilitate medical misinformation.
Evidence has been sought for minor degrees of thiamin and pyridoxine deficiency in patients undergoing surgery who have been infused with xylitol as a parenteral nutrient. Some metabolic changes which are associated with this practice have been studied; the findings are compared with those obtained in similar patients infused with glucose solutions. The thiamin status of all of the subjects was normal. Some of the patients showed slight biochemical evidence of pyridoxine deficiency, but there were no untoward effects of xylitol infusion. The concentration of oxalate in the blood and the excretion of oxalate in the urine did not exceed the normal range in any patient. The plasma and urine orthophosphate and urinary pyrophosphate levels decreased in association with the infusion of both xylitol and glucose. Plasma pyrophosphate and calcium levels, and the urinary calcium level, were essentially unaltered. A detailed quantitative study of the urinary organic acid excretion by means of gas chromatography/mass spectrometry showed that there was an abnormal glycolic aciduria and tetronic aciduria associated with xylitol infusion, but not with glucose infusion. There was no evidence of increased oxalate excretion in any patient by this method. The biochemical and clinical significance of these findings is discussed.
(1) Postoperative increased plasma levels of alanine stimulate gluconeogenesis and reduce the plasma levels of lipolytic metabolites. The induced stimulation of insulin and glucagon is dependent on the duration of the alanine infusion for during extended infusion of alanine the insulin stimulation diminishes while the glucagon secretion continuously increases. (2) Alanine is a potent anabolic substrate in the immediate postoperative situation.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.