Artificial intelligence software can generate residency application personal statements that program directors find acceptable and difficult to distinguish from applicant compositions

Johnstone, Robert E.; Neely, Grant A.; Sizemore, Daniel

doi:10.1016/j.jclinane.2023.111185

Cited by 13 publications

(3 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A Pace of Speech Tool provides rate of speaking feedback presuming that there is an ideal pace to decrease the impression that the applicant is nervous. Johnstone et al 18 used ChatGPT (https://chat.openai.com/auth/login) to generate 2 personal statements for anesthesia residency applicants. Based on survey responses from 31 program directors, 22 rated the statements as good or excellent.…”

Section: U T I S D O N O T C O P Ymentioning

confidence: 99%

See 1 more Smart Citation

The Potential for Artificial Intelligence Tools in Residency Recruitment

Ruiz De Luzuriaga

2024

Cutis

View full text Add to dashboard Cite

Section: U T I S D O N O T C O P Ymentioning

confidence: 99%

“…Based on survey responses from 31 program directors, 22 rated the statements as good or excellent. 18…”

Section: U T I S D O N O T C O P Ymentioning

confidence: 99%

The Potential for Artificial Intelligence Tools in Residency Recruitment

Ruiz De Luzuriaga

2024

Cutis

View full text Add to dashboard Cite

“…One study has shown that ChatGPT can generate resident applicant personal statements that most anesthesiology program directors found acceptable for applicants to their programs. 62 The value of such statements generated by such artificial intelligence platforms requires further investigation, especially if such technologies can produce high-quality statements and invented narratives that may be difficult to detect. A varied application format with directed questions instead may provide increased benefit for program review.…”

Section: Recruitment Problems and Reformsmentioning

confidence: 99%

Resident Recruitment in a New Era

Collins,

Baker

2024

International Anesthesiology Clinics

View full text Add to dashboard Cite

show abstract

Quantitative Comparison of Chatbots on Common Rhinology Pathologies

Bellinger,

Kwak,

Ramos

et al. 2024

The Laryngoscope

View full text Add to dashboard Cite

ObjectivesUnderstanding the strengths and weaknesses of chatbots as a source of patient information is critical for providers in the rising artificial intelligence landscape. This study is the first to quantitatively analyze and compare four of the most used chatbots available regarding treatments of common pathologies in rhinology.MethodsThe treatment of epistaxis, chronic sinusitis, sinus infection, allergic rhinitis, allergies, and nasal polyps was asked to chatbots ChatGPT, ChatGPT Plus, Google Bard, and Microsoft Bing in May 2023. Individual responses were analyzed by reviewers for readability, quality, understandability, and actionability using validated scoring metrics. Accuracy and comprehensiveness were evaluated for each response by two experts in rhinology.ResultsChatGPT, Plus, Bard, and Bing had FRE readability scores of 33.17, 35.93, 46.50, and 46.32, respectively, indicating higher readability for Bard and Bing compared to ChatGPT (p = 0.003, p = 0.008) and Plus (p = 0.025, p = 0.048). ChatGPT, Plus, and Bard had mean DISCERN quality scores of 20.42, 20.89, and 20.61, respectively, which was higher than the score for Bing of 16.97 (p < 0.001). For understandability, ChatGPT and Bing had PEMAT scores of 76.67 and 66.61, respectively, which were lower than both Plus at 92.00 (p < 0.001, p < 0.001) and Bard at 92.67 (p < 0.001, p < 0.001). ChatGPT Plus had an accuracy score of 4.39 which was higher than ChatGPT (3.97, p = 0.118), Bard (3.72, p = 0.002), and Bing (3.19, p < 0.001).ConclusionOn aggregate of the tested domains, our results suggest ChatGPT Plus and Google Bard are currently the most patient‐friendly chatbots for the treatment of common pathologies in rhinology.Level of EvidenceN/A Laryngoscope, 2024

show abstract

Artificial intelligence software can generate residency application personal statements that program directors find acceptable and difficult to distinguish from applicant compositions

Cited by 13 publications

References 11 publications

The Potential for Artificial Intelligence Tools in Residency Recruitment

The Potential for Artificial Intelligence Tools in Residency Recruitment

Resident Recruitment in a New Era

Quantitative Comparison of Chatbots on Common Rhinology Pathologies

Contact Info

Product

Resources

About