Voice Assistant with AI Chat Integration using OpenAI

A, Gobinath; C, Manjula Devi; S J, Suthan raja; P, Prakash; M, Anandan; A, Srinivasan

doi:10.1109/incos59338.2024.10527726

2024 Third International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS) 2024

DOI: 10.1109/incos59338.2024.10527726

|View full text |Cite

Voice Assistant with AI Chat Integration using OpenAI

Gobinath A,

Manjula Devi C,

Suthan raja S J

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

ChatGPT Yields a Passing Score on a Pediatric Board Preparatory Exam but Raises Red Flags

Le,

Davis

2024

Global Pediatric Health

View full text Add to dashboard Cite

Objectives We aimed to evaluate the performance of a publicly-available online artificial intelligence program (OpenAI’s ChatGPT-3.5 and -4.0, August 3 versions) on a pediatric board preparatory examination, 2021 and 2022 PREP® Self-Assessment, American Academy of Pediatrics (AAP). Methods We entered 245 questions and answer choices from the Pediatrics 2021 PREP® Self-Assessment and 247 questions and answer choices from the Pediatrics 2022 PREP® Self-Assessment into OpenAI’s ChatGPT-3.5 and ChatGPT-4.0, August 3 versions, in September 2023. The ChatGPT-3.5 and 4.0 scores were compared with the advertised passing scores (70%+) for the PREP® exams and the average scores (74.09%) and (75.71%) for all 10 715 and 6825 first-time human test takers. Results For the AAP 2021 and 2022 PREP® Self-Assessments, ChatGPT-3.5 answered 143 of 243 (58.85%) and 137 of 247 (55.46%) questions correctly on a single attempt. ChatGPT-4.0 answered 193 of 243 (79.84%) and 208 of 247 (84.21%) questions correctly. Conclusion Using a publicly-available online chatbot to answer pediatric board preparatory examination questions yielded a passing score but demonstrated significant limitations in the chatbot’s ability to assess some complex medical situations in children, posing a potential risk to this vulnerable population.

show abstract

ChatGPT Yields a Passing Score on a Pediatric Board Preparatory Exam but Raises Red Flags

Le,

Davis

2024

Global Pediatric Health

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Voice Assistant with AI Chat Integration using OpenAI

Cited by 1 publication

References 19 publications

ChatGPT Yields a Passing Score on a Pediatric Board Preparatory Exam but Raises Red Flags

ChatGPT Yields a Passing Score on a Pediatric Board Preparatory Exam but Raises Red Flags

Contact Info

Product

Resources

About