Artificial intelligence in medical education curriculum: An e-Delphi study for competencies

Abstract

Background Artificial intelligence (AI) has affected our day-to-day in a great extent. Healthcare industry is one of the mainstream fields among those and produced a noticeable change in treatment and education. Medical students must comprehend well why AI technologies mediate and frame their decisions on medical issues. Formalizing of instruction on AI concepts can facilitate learners to grasp AI outcomes in association with their sensory perceptions and thinking in the dynamic and ambiguous reality of daily medical practice. The purpose of this study is to provide consensus on the competencies required by medical graduates to be ready for artificial intelligence technologies and possible applications in medicine and reporting the results. Materials and methods A three-round e-Delphi survey was conducted between February 2020 and November 2020. The Delphi panel accorporated experts from different backgrounds; (i) healthcare professionals/ academicians; (ii) computer and data science professionals/ academics; (iii) law and ethics professionals/ academics; and (iv) medical students. Round 1 in the Delphi survey began with exploratory open-ended questions. Responses received in the first round evaluated and refined to a 27-item questionnaire which then sent to the experts to be rated using a 7-point Likert type scale (1: Strongly Disagree—7: Strongly Agree). Similar to the second round, the participants repeated their assessments in the third round by using the second-round analysis. The agreement level and strength of the consensus was decided based on third phase results. Median scores was used to calculate the agreement level and the interquartile range (IQR) was used for determining the strength of the consensus. Results Among 128 invitees, a total of 94 agreed to become members of the expert panel. Of them 75 (79.8%) completed the Round 1 questionnaire, 69/75 (92.0%) completed the Round 2 and 60/69 (87.0%) responded to the Round 3. There was a strong agreement on the 23 items and weak agreement on the 4 items. Conclusions This study has provided a consensus list of the competencies required by the medical graduates to be ready for AI implications that would bring new perspectives to medical education curricula. The unique feature of the current research is providing a guiding role in integrating AI into curriculum processes, syllabus content and training of medical students.

Use of Artificial Intelligence for Acquisition of Limited Echocardiograms: A Randomized Controlled Trial for Educational Outcomes

“…This lack of trust despite improved performance with AI is well described outside of POCUS, 22,28,29 which underscores the need for effective curricula on how to optimally integrate AI with clinical care. 30 Moreover, the AI group did not report higher confidence levels in their own skills despite significantly higher levels of performance. This finding is consistent with previous investigations that have demonstrated a novice's actual ability to acquire ultrasound images does not correlate with their expressed confidence.…”

Artificial Intelligence in Orthopedic Radiography Analysis: A Narrative Review

“…Since medicine is in the process of digitalization, it is also important to familiarize junior doctors with the topic of AI for clinical practice. As Çalışkan and colleagues state, medical students need to understand why AI can support doctors in clinical practice [ 82 ]. On the other hand, we cannot rule out the possibility that medical students and junior doctors could rely too much on AI, which can become a hindrance in developing analytical and observational skills as well as in learning the process of decision-making.…”

Forecasting Food Innovations with a Delphi Study

“…This study experienced some limitations. Delphi studies have been used as a prediction tool in a variety of disciplines [ 17 , 19 , 30 , 33 , 49 ]. While the Delphi technique utilizes expert opinions to predict a scenario of the future, forecasting the availability of food innovations is challenging.…”

“…The Delphi technique aims to explore a likely outcome or reliably establish new structures rather than generalizing results [ 21 , 30 ]. The panel composition should “represent the synthesis of opinion of the particular group, no more, no less” [ 31 ] (p.4).…”